Tencent open-sources Hy4 preview with 770B parameters under Apache 2.0
Tencent released Hy4 preview, a 770B-parameter MoE model with 49B active parameters per token, under Apache 2.0 and a 1M-token context. IQuest simultaneously launched IQuest-Q1, a 320B MoE with only 15B active parameters, under a Modified MIT license.
- Hy4 preview: 770B parameters, 49B active, 78 layers, 1M-token context
- Hy4 weights total about 1.56 TB and require server-grade hardware
- IQuest-Q1: 320B parameters, 15B active, 524,288-token context
- In a blind test on 203 engineering tasks Hy4 scored 2.99 vs 2.92 for GLM 5.3
Read next
AI