Meta has launched Spatial Lingo: Language Practice, an innovative open-source app for the Quest 3 that merges mixed reality passthrough and AI object recognition for language learning. This cutting-edge application allows users to enhance their English or Spanish skills using real-world objects, overlaying translated terms directly onto them via the Quest’s Passthrough Camera API.
Spatial Lingo includes an AI-driven 3D companion that listens to users, evaluates their pronunciation, and offers real-time feedback, making it particularly beneficial for beginners. As an open-source project, developers can access its code on GitHub to create custom experiences.
While Spatial Lingo provides foundational vocabulary practice, true fluency requires immersive interaction with native speakers. This app serves as a stepping stone for language learners, facilitating vocabulary acquisition and pronunciation. Available for free on the Horizon Store, Spatial Lingo is an intriguing launch in the realm of XR language education.
