AI Dose
0
Likes
0
Saves
Back to updates

[r/LocalLLaMA] nvidia/NVILA-8B-HD-Video · Hugging Face

Impact: 8/10
Swipe left/right

Summary

NVIDIA's NVILA-HD-Video is an 8B parameter multi-modal LLM capable of understanding and answering questions about videos up to 4K resolution and 1K frames. It utilizes a technique called AutoGaze to drastically reduce redundant tokens by up to 100x, leading to significant latency reductions (up to 19x for ViT and 10x for LLM). This efficiency allows the model to effectively process and scale to very large video inputs, overcoming a major challenge in video AI.

Continue Reading

Explore related coverage about community news and adjacent AI developments: [r/ML] [D] MYTHOS-INVERSION STRUCTURAL AUDIT, [r/LocalLLaMA] karpathy / autoresearch, [r/ML] [R] Agentic AI and Occupational Displacement: A Multi-Regional Task Exposure Analysis (236 occupations, 5 US metros), [r/ML] Building behavioural response models of public figures using Brain scan data (Predict their next move using psychological modelling) [P].

Related Articles

Comments

Sign in to leave a comment.

Loading comments...