Apple has launched an open-source on-device AI model, SHARP, that quickly transforms images into 3D scenes, accessible via the Splat Studio app for Vision Pro users. Since visionOS 26, the Photos app includes a simple feature turning images into “Spatial Scenes,” allowing limited movement. In contrast, SHARP delivers a fully interactive volumetric scene in under a second on standard devices, utilizing Nvidia CUDA and Apple Silicon for hardware acceleration. While other models, like Marble, require extensive processing time, SHARP’s efficiency stands out. Users can download it from GitHub and run it on Macs. Splat Studio is a free app that integrates SHARP, permitting seamless user interaction with images turned into 3D scenes. This innovative experience contrasts with the Apple Photos app, providing greater freedom of movement but may involve some detail loss. For users seeking to immerse themselves in their own visual content, Splat Studio offers a compelling solution in the realm of AI-driven 3D reconstruction.
Source link
