Researchers extract spatial, temporal and pain data from LLMs

Researchers found that mathematical probing of large language models like ChatGPT reveals surprisingly specific information: a city's location on a map, when a historical figure lived, and what emotion a character feels, including descriptions of pain.

• LLM internal activity can be probed with mathematical tools
• Models encode a city's coordinates and a figure's era
• Character emotions and pain descriptions are detectable