✨✨[NeurIPS 2025] VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction
[ICCV 2025] Implementation for Describe Anything: Detailed Localized Image and Video Captioning
Curated visual catalog of 155+ vision-language model (VLM/MLLM) architectures: papers, diagrams, training recipes, datasets, and a release timeline for multimodal AI agents.
[NeurIPS 2024] An official implementation of "ShareGPT4Video: Improving Video Understanding and Generation with Better Captions"
A Framework of Small-scale Large Multimodal Models
A collection of resources on applications of multi-modal learning in medical imaging.
LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"
LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.
An open-source implementation for training LLaVA-NeXT.
[CVPR 2024 Highlight] OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocation
Stream-Omni is a GPT-4o-like language-vision-speech chatbot that simultaneously supports interaction across various modality combinations.
A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision, llama-3.2-vision, qwen-vl, qwen2-vl, phi3-v etc.
A curated list of awesome Multimodal studies.
Open Platform for Embodied Agents
[ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions
[CVPR 2026] LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Calling
The official evaluation suite and dynamic data release for MixEval.
Official implementation of GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agents
a comprehensive and critical synthesis of the emerging role of GenAI across the full autonomous driving stack
Add a description, image, and links to the large-multimodal-models topic page so that developers can more easily learn about it.
To associate your repository with the large-multimodal-models topic, visit your repo's landing page and select "manage topics."