Darwin-27B-ZTC-v5 tops Japanese S1MB leaderboard without Japanese training
The open S1MB leaderboard added a Japanese version (japanese-v1, 27 benchmarks). Darwin-27B-ZTC-v5 took first place with a Borda score of 84.57, beating Perplexity (80.86) by 3.71 points, while also leading the English version (90.80). The model was not trained on Japanese data — the result comes from transfer of evaluation skills.
- Borda 84.57 on Japanese version, 3.71 points above Perplexity (80.86)
- First place in 10 of 27 benchmarks, top-3 in 16
- JMMLU 88.4 joint best, JaNLI 83.7
- Trained only on English; Japanese result is skill transfer
Read next
AI