PrismML and Qualcomm Run 1-bit Bonsai AI Model Locally on Snapdragon AR1 Gen 1 Smart Glasses

PrismML unveiled its 1-bit Bonsai model, a 2-billion-parameter vision-language model running locally on Qualcomm's Snapdragon AR1 Gen 1 platform for smart glasses. It fits 4X more parameters into the same memory footprint and generates text tokens more than twice as fast as a 4-bit model.

• 1-bit Bonsai with 2B parameters runs locally on Snapdragon AR1 Gen 1
• Fits 4X more parameters in the same memory footprint
• Generates tokens more than twice as fast as a 4-bit model
• Optimized for Qualcomm Hexagon NPU