chiprook
← AI
AIOctober 19, 2026, 09:35

95% recall, 80% answers: LongMemEval retrieval scores mislead

A developer benchmarked two AI-agent memory layers on the same 500 LongMemEval questions: agentmemory's 95.2% recall_any@5 translated to 80.4% answer accuracy, while Graph-MIND reached 89.0% using ~3.4k tokens versus ~16.5k. The gap is statistically significant (exact McNemar p = 3.3e-6).

95% recall, 80% answers: LongMemEval retrieval scores mislead
#LongMemEval#Graph-MIND#Agentmemory
Read next
AI

OpenSearch veterans launch Infino, a retrieval layer for AI agents

AI

Perplexity launches Photon: Rust retrieval engine cuts p99 latency from 800 ms to 65 ms

AI

ChatGPT Search Can Pre-Select Brands Before Retrieval, Research Shows

AI

Google Research Introduces Retrieve-for-Train (R4T): RL-Compiled Diffusion Retriever for 12× to 20× Faster Query Fan-Out