Mercor: AI benchmarks cover only 208 of 923 US occupations
Mercor released a Benchmark Map showing that only 208 of 923 US occupations have at least one task covered by five or more prompts from AI benchmarks. Those tasks account for under 10% of paid working hours in the country, and six of 22 job families, including healthcare and education, have no real coverage.
- 208 of 923 US occupations have tasks with 5+ benchmark prompts
- 90% of US paid working hours fall outside AI test coverage
- 29 benchmarks mapped to 18,797 O*NET tasks
- 6 of 22 job families, including healthcare, lack coverage
Read next
AI