0
Likes
0
Saves
Back to updates

[r/LocalLLaMA] Mistral NEMO upscale, but kinda weird

Impact: 3/10
Swipe left/right

Summary

A community-modified version of the Mistral Nemo model, dubbed 'Fat Fish,' has been released. This model underwent significant upscaling, pruning, and 'unhinged modifications' after consuming 3 billion tokens. Its creator claims it exhibits improved coherence, instruction following, and knowledge of new information and languages, and is available on Hugging Face.

Editorial note

AI Dose summarizes public reporting and links to original sources when they are available. Review the Editorial Policy, Disclaimer, or Contact page if you need to flag a correction or understand how this site handles sources.

Continue Reading

Explore related coverage about community news and adjacent AI developments: [r/ML] [D] MYTHOS-INVERSION STRUCTURAL AUDIT, [r/LocalLLaMA] karpathy / autoresearch, [r/ML] KIV: 1M token context window on a RTX 4070 (12GB VRAM), no retraining, drop-in HuggingFace cache replacement - Works with any model that uses DynamicCache [P], [r/ML] LLMs learn backwards, and the scaling hypothesis is bounded. [D].

Related Articles

Next read

[r/ML] [D] MYTHOS-INVERSION STRUCTURAL AUDIT

Stay with the thread by reading one adjacent story before leaving this update.

Comments

Sign in to leave a comment.

Loading comments...