Audit of 110 AI usage tools finds 45+ bugs in token and cost accounting
Developers audited 110 open-source tools that count tokens, track costs, and enforce AI budgets, finding more than 45 verified bugs. 23 fixes have been merged upstream, including langfuse (34k stars) and codeburn (11k), and an independent auditor confirmed a cache-accounting path that under-reports usage by 98.9%.
- 45+ verified bugs found across 110 AI usage-tracking tools
- 23 fixes merged upstream, including langfuse and codeburn
- Independent auditor confirmed cache accounting under-reports by 98.9%
- None of 20 vendors publish a dispute process for meter errors
Read next
AI