AI Dose
0
Likes
0
Saves
Back to updates

[r/LocalLLaMA] Self hosting, Power consumption, rentability and the cost of privacy, in France

Impact: 4/10
Swipe left/right

Summary

A user in France details their two-year journey self-hosting AI models, upgrading from a gaming PC to rigs featuring dual 3090s. They highlight the significant power consumption, with their dual-3090 setup drawing 120W idle and 700-800W during inference. The discussion also touches upon the cost implications of privacy and power in France for such personal AI infrastructure.

Continue Reading

Explore related coverage about community news and adjacent AI developments: [r/ML] [D] MYTHOS-INVERSION STRUCTURAL AUDIT, [r/LocalLLaMA] karpathy / autoresearch, [r/ML] [R] Agentic AI and Occupational Displacement: A Multi-Regional Task Exposure Analysis (236 occupations, 5 US metros), [r/ML] Building behavioural response models of public figures using Brain scan data (Predict their next move using psychological modelling) [P].

Related Articles

Comments

Sign in to leave a comment.

Loading comments...