What sets them apart

These models accept both images and text in the same context window and reason across them jointly — describing a chart, answering a question about a photo, or reading text embedded in a screenshot.

How they work

A vision encoder converts image content into representations the language model can process alongside text tokens, letting the same reasoning machinery operate across both modalities.

Where they fit

Document understanding, visual QA, and any agent workflow that needs to interpret a screenshot or photo as part of a larger task all depend on this class of model.

Choosing the right model for your agent? Model selection and integration is part of every build we do — let's talk through your use case.

Start a conversation →