Anthropic outlines metrics to track AI development at frontier labs

Anthropic published a set of metrics to track AI progress at frontier labs: the share of R&D performed by AI, the quality of oversight of agents, and the allocation of compute. The company notes that AI systems are becoming more powerful and increasingly automating their own creation.

• Metric 1: what share of AI R&D is done by AI itself
• Metric 2: how well AI agents are overseen
• Metric 3: how compute resources are allocated
• Anthropic: AI is increasingly automating its own creation