AI Dose
0
Likes
0
Saves
Back to updates

[r/LocalLLaMA] Qwen3.5 27B vs 35B Unsloth quants - LiveCodeBench Evaluation Results

Impact: 6/10
Swipe left/right

Summary

This report details an evaluation of various Qwen3.5 models (27B, 35B, 9B, 4B) using Unsloth quantizations on consumer-grade hardware, specifically an RTX 4060 Ti GPU. It outlines the specific hardware configuration, necessary Windows compatibility fixes for the LiveCodeBench evaluation framework, and compares different quantization levels and their resulting model sizes.

Continue Reading

Explore related coverage about community news and adjacent AI developments: [r/ML] [D] MYTHOS-INVERSION STRUCTURAL AUDIT, [r/LocalLLaMA] karpathy / autoresearch, [r/ML] [R] Agentic AI and Occupational Displacement: A Multi-Regional Task Exposure Analysis (236 occupations, 5 US metros), [r/ML] Building behavioural response models of public figures using Brain scan data (Predict their next move using psychological modelling) [P].

Related Articles

Comments

Sign in to leave a comment.

Loading comments...