What Is Recursive Self-Improvement? Why AI Researchers Are Worried

An explainer on recursive self-improvement (RSI): AI helps create more capable AI, which builds the next. Anthropic CEO Dario Amodei in a September 12 essay called for slowing the growth of model capabilities; Sam Altman, Elon Musk and Demis Hassabis agreed. Anthropic says a full recursive cycle does not yet exist.

• Amodei: uncontrolled RSI could outpace humans' ability to understand and manage AI
• Altman, Musk and Hassabis publicly agreed on the need to curb the pace
• Darwin Gödel Machine raised coding benchmark success from 20% to 50%
• Amodei warned of a botnet risk causing hundreds of billions in damage in 6-12 months