chiprook
← AI
AIOctober 27, 2026, 05:41

Ex-OpenAI researcher says neural networks may be far more interpretable than thought

Nick Cammarata of Goodfire, who helped establish mechanistic interpretability at OpenAI, published a 26,000-word post arguing the "black box" view of neural networks is overstated. He reports that roughly 90% of neurons in Qwen3-32B track a single main concept, and that the famous cat-car neuron actually responded to a shared V shape.

Ex-OpenAI researcher says neural networks may be far more interpretable than thought
#OpenAI#Goodfire#Qwen3
Read next
AI

Neural network study sheds light on how AI chatbots 'reason' like humans

AI

A neural network wired to a fruit fly connectome learned to play Doom

Hardware

Neural networks speed up 3nm nanosheet SPICE simulation up to 8x

Science

Wits researchers build optical neural network that reads light without imaging