AI Dose
0
Likes
0
Saves
Back to updates

[r/LocalLLaMA] Benchmarked all unsloth Qwen3.5-27B Q4 models on a 3090

Impact: 4/10
Swipe left/right

Summary

A user on r/LocalLLaMA benchmarked seven different Qwen3.5-27B Q4 models on an RTX 3090 GPU. The tests measured various performance metrics including load time, prompt evaluation speed, generation speed, and perplexity. Results showed generation speeds for models like IQ4_XS and IQ4_NL to be around 42-44 tokens per second, providing practical performance data for local LLM users.

Continue Reading

Explore related coverage about community news and adjacent AI developments: [r/ML] [D] MYTHOS-INVERSION STRUCTURAL AUDIT, [r/LocalLLaMA] karpathy / autoresearch, [r/ML] [R] Agentic AI and Occupational Displacement: A Multi-Regional Task Exposure Analysis (236 occupations, 5 US metros), [r/ML] Building behavioural response models of public figures using Brain scan data (Predict their next move using psychological modelling) [P].

Related Articles

Comments

Sign in to leave a comment.

Loading comments...