video-conversation

[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding

PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models

[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

A Python tool that converts 2D videos into immersive 3D formats using MiDaS depth estimation models. Supports Red/Cyan Anaglyph and Side‑by‑Side stereo output, with CUDA acceleration, mixed precision, and optional FFmpeg pre‑encoding for smooth, high‑quality results.