WeChat dropped its own LLM. Called WeLM.
Both versions are MoE:
- WeLM-80B: 80B total params, 3B active. Already live in WeChat's Xiaowei assistant
- WeLM-617B: 617B total, 23B active. Still in dev
3B active carrying 80B total. First time I've seen an MoE compress that hard.
Xiaowei needs no install, you just open WeChat. That might be the most widely-reachable LLM front end out there right now.