feedd.›AI
AIMarkTechPost · 33d ago

Alibaba’s Qwen Team Releases Qwen3.8-Flash-Next: A 125B Multimodal MoE With 6B Active Parameters Previewing the Qwen4 Architecture

A 125-billion parameter multimodal mixture-of-experts model with 6 billion active parameters per token combines Gated DeltaNet attention, N-gram embedding, and Gated Residual architecture. The model requires 172.78 gigabytes storage in FP8 format and reportedly costs one-ninth the training expense of Qwen3.7-Plus.

Read full story →
More from AI

Hyundai Motor Group activated its Data Flywheel system and demonstrated Level 2++ autonomous driving technology at an event in South Korea on September 13, 2026. The Group presented a dual-track autonomous driving roadmap alongside development strategies and implementation plans at 42dot headquarters in Gyeonggi Province.

01

A fruit fly connectome with 166,700 neurons and 25.6 million connections was integrated into a 1.2 billion parameter frozen language model, training only 278,528 additional parameters. The connectome integration achieved 0.0222 nat per token improvement, but control models without the biological wiring performed slightly better across all random seeds.

02

OpenAI committed to embedding independent evaluators with employee-level access to its systems, matching Anthropic's earlier pledge on the same day. Both companies endorsed slowing frontier AI development pace, with OpenAI promising to share additional details soon.

03

Get feedd. daily

Top stories in your inbox every morning. Pick what you want.

No spam. Unsubscribe anytime.