[r/LocalLLaMA] What tokens/sec do you get when running Qwen 3.5 27B?

Summary

A user on r/LocalLLaMA is inquiring about token generation speeds for the Qwen 3.5 27B model on a 4090 GPU with 32GB RAM, noting that reported speeds often lack context details. They report achieving 32-38 tokens/sec with context under 50k using LM Studio and quantized models like Bartowski Q4KM and Unsloth Q4KXL, acknowledging their setup might not be optimal and speeds depend on context length.

Continue Reading

Explore related coverage about community news and adjacent AI developments: [r/ML] [D] MYTHOS-INVERSION STRUCTURAL AUDIT, [r/LocalLLaMA] karpathy / autoresearch, [r/ML] [R] Agentic AI and Occupational Displacement: A Multi-Regional Task Exposure Analysis (236 occupations, 5 US metros), [r/ML] Building behavioural response models of public figures using Brain scan data (Predict their next move using psychological modelling) [P].

Related Articles

• [r/ML] [D] MYTHOS-INVERSION STRUCTURAL AUDIT

  March 29, 2026

• [r/LocalLLaMA] karpathy / autoresearch

  March 10, 2026

• [r/ML] [R] Agentic AI and Occupational Displacement: A Multi-Regional Task Exposure Analysis (236 occupations, 5 US metros)

  April 7, 2026

• [r/ML] Building behavioural response models of public figures using Brain scan data (Predict their next move using psychological modelling) [P]

  April 5, 2026