Moonshot AI Open-Sources MoonEP: A Perfectly Balanced Expert Parallelism Library for MoE Training

Moonshot AI has open-sourced MoonEP, an Expert Parallelism (EP) communication library for distributed Mixture-of-Experts (MoE) workloads. The team announced the release as a library built to make expert-parallel communication more efficient at scale. It ships under an MIT license. MoonEP arrived as part of Kimi K3 Open Day. Alongside the K3 model weights and technical…

Read Full News

Tencent Open-Sources AngelSpec: A Unified Training Framework for MTP and Block-Parallel Speculative Decoding on Hy3 Models

Tencent has released AngelSpec, an open-source, torch-native training framework for speculative-decoding draft models. The release covers both autoregressive multi-token prediction (MTP) and the block-parallel DFlash family. Most speculative-decoding work searches for one drafter that scores well on an averaged benchmark mixture. Real serving traffic does not look like that mixture….

Read Full News
LinkedIn Received’t Be Increasing Its Information Facilities within the Subsequent 12 months

LinkedIn Received’t Be Increasing Its Information Facilities within the Subsequent 12 months

In contrast to many different huge tech platforms, LinkedIn has determined it gained’t spend aggressively on increasing its AI information facilities this fiscal yr. Executives on the skilled social community inform WIRED that it plans to maintain its funding in GPUs regular, and its compute and storage footprint can be remaining flat. The spending calculations…

Read Full News