Asking questions about an image and getting answers. What does this chart show, how many items are on the shelf, what does this form say, is there anything wrong in this photograph of the equipment. It is where a lot of the practical value of multimodal models sits.
Technical view
Evaluated on benchmarks covering natural images, charts and diagrams, documents and scientific figures. Performance is strong on holistic description and weaker where precision matters: exact values from charts, counting beyond small numbers, and fine spatial relations. Failure is silent, producing a plausible number rather than an admission of illegibility, which makes verification necessary for any quantitative use.
Related
Part of AI Terminology Index, section: Modalities and Applications.