Geniatech launches RK1828 and Hailo-10 M.2 AI accelerators for local LLM inference

Geniatech has listed two M.2 2280 AI accelerator cards for edge inference: the AIM-M-R28 based on Rockchip's RK1828 with 20 TOPS and 5GB of in-package DRAM, and the AIM-M-H10 using Hailo-10 with up to 40 TOPS and up to 16GB LPDDR4/4X. Both connect over PCIe and target local LLM, computer vision and audio workloads on embedded systems.

• AIM-M-R28: RK1828, 20 TOPS INT8, 5GB in-package DRAM, PCIe 2.1 x1, 20W TDP
• AIM-M-H10: Hailo-10, up to 40 TOPS, up to 16GB LPDDR4/4X, 12W typical power
• Claimed generation above 100 tokens/s for 3B-7B models
• Pricing and availability not disclosed