[HN] Ask HN: What makes it so hard to keep LLMs online?

Summary

The Hacker News discussion "Ask HN: What makes it so hard to keep LLMs online?" addresses the frequent unreliability, including downtime and slowness, of major AI services. The author questions whether this is due to unexpected demand or fundamental differences in serving AI models compared to traditional web applications, despite these services being run by well-funded companies. It highlights a significant operational challenge in the current AI landscape.

Continue Reading

Explore related coverage about community news and adjacent AI developments: [r/ML] [D] MYTHOS-INVERSION STRUCTURAL AUDIT, [r/LocalLLaMA] karpathy / autoresearch, [r/ML] KIV: 1M token context window on a RTX 4070 (12GB VRAM), no retraining, drop-in HuggingFace cache replacement - Works with any model that uses DynamicCache [P], [r/ML] LLMs learn backwards, and the scaling hypothesis is bounded. [D].

Related Articles

• [r/ML] [D] MYTHOS-INVERSION STRUCTURAL AUDIT

  March 29, 2026

• [r/LocalLLaMA] karpathy / autoresearch

  March 10, 2026

• [r/ML] KIV: 1M token context window on a RTX 4070 (12GB VRAM), no retraining, drop-in HuggingFace cache replacement - Works with any model that uses DynamicCache [P]

  April 13, 2026

• [r/ML] LLMs learn backwards, and the scaling hypothesis is bounded. [D]

  April 12, 2026