Running the 8-Billion Parameter 1-Bit Bonsai AI Model Locally on My iPhone 17 Pro: A Review of the Free Locally AI App

On March 31, 2026, PrismML launched the groundbreaking AI model 1-bit Bonsai 8B, designed for efficiency with 8 billion parameters and a mere 1.15GB memory requirement. Notably, this model can operate locally on devices like the iPhone 17 Pro. To test its capabilities, I used the demo app ‘Locally AI’ from the App Store. After installation, selecting the Bonsai model for download was straightforward, enabling me to engage with the AI. Initial interactions revealed mixed responses; while it correctly advised against using a screen protector, the reasoning was peculiar. Additionally, it successfully solved a basic math problem, showcasing its computational skills. The 1-bit Bonsai 8B outperforms models requiring 14 times more memory, making it an excellent choice for local AI applications. Benchmark results and further resources can be found on GIGAZINE and PrismML’s official website. Explore the full potential of this innovative AI today!

Source link