A prototype developed for Snap’s fifth-generation AR glasses, Snap Spectacles, utilizes Google’s Gemini AI to instantly identify and mask branded content in real-time. Upon detecting ads, the app places a bright red square over the imagery, labeling the concealed brand (e.g., “Bol. billboard”). This innovation aims to empower users to control their visual content. Developer Spanhove hinted at further features, allowing users to replace the red square with personal images or notes. Utilizing Snap’s Depth Cache API, the app registers 3D objects and maintains spatial consistency as users move. Although it effectively covers ads on various surfaces, including cereal boxes and public signage, some limitations exist. The software is still in an experimental phase, with slight delays in ad detection and transparency issues that let original ads faintly show through. Additionally, the devices have a limited 46-degree field of view, restricting coverage to what is directly ahead.
Source link
Share
Read more