# Multimodal

Concept · [Building with AI](https://ecosystem.samcarlton.com/ai)

Also called: multi-modal, multimodal model, multimodal AI, vision, image input, voice mode

Describes a model that works with more than one type of content, such as text plus images or audio.

**For example:** A user uploads a photo of a receipt and asks for the total. A multimodal model reads the image and answers in text.

## Connects to (10)

- [Model](https://ecosystem.samcarlton.com/model): The trained system at the center of an AI product.
- [LLM](https://ecosystem.samcarlton.com/llm): Large language model.
- [Speech-to-text](https://ecosystem.samcarlton.com/speech-to-text): Software that turns spoken words into written text.
- [Prompt](https://ecosystem.samcarlton.com/prompt): The instructions or question you give an AI tool in everyday words.
- [Diffusion model](https://ecosystem.samcarlton.com/diffusion-model): A kind of AI model that creates images, and sometimes audio or video, by starting from random noise and removing it step by step until a…
- [Virtual try-on](https://ecosystem.samcarlton.com/virtual-try-on): Showing how clothing, glasses or makeup would look on a person by generating or overlaying an image, so shoppers can preview items before…
- [Gemini Live](https://ecosystem.samcarlton.com/gemini-live): A mode of the Gemini app for talking with Gemini out loud in real time, and showing it the phone's camera or screen.
- [Veo](https://ecosystem.samcarlton.com/veo): Google DeepMind's family of AI models that make video, with sound, from text or image prompts.
- [Google Flow](https://ecosystem.samcarlton.com/google-flow): A Google tool for making short films with AI, built on its Veo video models.
- [Midjourney](https://ecosystem.samcarlton.com/midjourney): An AI tool that makes images from text prompts.

Map view: https://ecosystem.samcarlton.com/multimodal