AI Dose
0
Likes
0
Saves
Back to updates
Community News
March 11, 2026

[r/LocalLLaMA] What tokens/sec do you get when running Qwen 3.5 27B?

Impact: 2/10
Swipe left/right

Summary

A user on r/LocalLLaMA is inquiring about token generation speeds for the Qwen 3.5 27B model on a 4090 GPU with 32GB RAM, noting that reported speeds often lack context details. They report achieving 32-38 tokens/sec with context under 50k using LM Studio and quantized models like Bartowski Q4KM and Unsloth Q4KXL, acknowledging their setup might not be optimal and speeds depend on context length.

Editorial note

AI Dose summarizes public reporting and links to original sources when they are available. Review the Editorial Policy, Disclaimer, or Contact page if you need to flag a correction or understand how this site handles sources.

Continue Reading

Explore related coverage about community news and adjacent AI developments: [r/ML] [D] MYTHOS-INVERSION STRUCTURAL AUDIT, [r/LocalLLaMA] karpathy / autoresearch, [r/ML] Zero-shot World Models Are Developmentally Efficient Learners [R], [HN] Do I Stop Learning Coding? DSA?.

Related Articles

Next read

[r/ML] [D] MYTHOS-INVERSION STRUCTURAL AUDIT

Stay with the thread by reading one adjacent story before leaving this update.

Comments

Sign in to leave a comment.

Loading comments...