[r/ML] Phosphene local video and audio generation for Apple Silicon open source (LTX 2.3) [P]

Phosphene, a free desktop panel for generating video and audio, has been released as an open-source project for Apple Silicon Macs.

Phosphene wraps Lightricks' LTX 2.3 model, which runs natively on Apple's MLX framework. It offers a one-click installation via Pinokio. A key differentiator is the model's ability to generate both video and audio in a single forward pass, sharing the same diffusion process. This design ensures that timing is tied at the frame level, allowing for precise synchronization where elements like footsteps, lip movements, and ambient sounds align accurately with the visual content.

This development could influence the quality and integration of audio-visual elements in locally generated AI content, particularly for creators using Apple Silicon hardware.