Browse Foundations

What Is a Vision-Language Model (VLM)?

The technology behind an AI that can look at a photo and answer questions about it — combining image understanding with a language model in one system.

Seeing and talking, together

A vision-language model (VLM) is trained to jointly process images and text — given a photo and a question, it can describe what's in the image, answer specific questions about it, or reason about the relationship between visual content and the text prompt, all through the same conversational interface.

How images become something a language model can use

Under the hood, an image typically gets converted into a sequence of numeric representations — conceptually similar to embeddings — that get fed into the model alongside the text tokens of the prompt, letting the same underlying transformer architecture attend across both image and text content together.

Why this matters practically

VLMs are the technology behind features like uploading a screenshot and asking an AI assistant to explain it, or a photo of a receipt and asking it to extract the total — tasks that need both visual understanding and natural language reasoning working together, rather than as two separate, disconnected systems.

Frequently Asked Questions

What is a vision-language model?

An AI model trained to jointly understand images and text, able to describe, answer questions about, or reason over visual content through the same conversational interface used for text.

Is a vision-language model the same as an image generator?

No — a VLM understands and reasons about existing images (input), while an image generator like a diffusion model creates new images (output). Some products combine both capabilities, but they're distinct technologies.

Keep Exploring