[r/LocalLLaMA] Codebook Lossless LLM Compression: 10–25%+ RAM reduction with bitwise generic packing of indexed weights

Summary

A new "Codebook Lossless LLM Compression" technique has been developed, offering 10-25% RAM reduction for large language models. This method exploits the observation that LLM weights often use fewer unique values than their fp16 representation, allowing for efficient bitwise packing. The compression achieves significant memory savings, though it involves a slight trade-off in inference speed.

Continue Reading

Explore related coverage about community news and adjacent AI developments: [r/ML] [D] MYTHOS-INVERSION STRUCTURAL AUDIT, [r/LocalLLaMA] karpathy / autoresearch, [r/ML] [R] Agentic AI and Occupational Displacement: A Multi-Regional Task Exposure Analysis (236 occupations, 5 US metros), [r/ML] Building behavioural response models of public figures using Brain scan data (Predict their next move using psychological modelling) [P].

Related Articles

• [r/ML] [D] MYTHOS-INVERSION STRUCTURAL AUDIT

  March 29, 2026

• [r/LocalLLaMA] karpathy / autoresearch

  March 10, 2026

• [r/ML] [R] Agentic AI and Occupational Displacement: A Multi-Regional Task Exposure Analysis (236 occupations, 5 US metros)

  April 7, 2026

• [r/ML] Building behavioural response models of public figures using Brain scan data (Predict their next move using psychological modelling) [P]

  April 5, 2026