Apple: iPhones Run 14B-Parameter LLMs, Mac Studio Clusters Hit 1.6T
Apple published a chart detailing which local LLMs its devices can run. iPhones and iPads with 16GB unified memory handle 14B active-parameter models, MacBook Pros with 128GB reach 120B, and a four-unit Mac Studio M5 Ultra cluster with 2TB memory supports up to 1.6 trillion parameters.
- iPhone and iPad with 16GB memory: up to 14B active parameters
- MacBook Air and Mac mini with 64GB: up to 70B parameters
- Mac Studio M5 Ultra with 512GB: up to 480B parameters
- Four-unit Mac Studio cluster with 2TB: up to 1.6T parameters
Read next
AI