Mobilerun hits 100% on AndroidWorld, beating Google ARTEMIS
Mobilerun achieved a perfect 100% official score on Google Research's AndroidWorld benchmark, completing all 116 tasks. Google's open-source ARTEMIS reports 99%+. The run used mobile-harness on a Pixel 6 emulator with Android 13 and gpt-6-astra.
- Mobilerun scored 116/116 tasks on AndroidWorld — 100%
- Google ARTEMIS reports 99%+ on the same benchmark
- Setup: Pixel 6 emulator, Android 13, gpt-6-astra, 1,419 interactions
- Earlier Droidrun results rose from 63% to 91.4% after an architecture change
Read next
Software