Naveed Ahmad

NVIDIA Open Sources Run:ai Under Apache 2.0 for Kubernetes GPU Orchestration

Google Cloud Ships llm-d 1.0 With Cache-Aware Routing for TPU and GPU Fleets

Google team have released llm-d 1.0, the first stable version of its distributed inference stack. This open-source, Kubernetes-native layer turns vLLM or SGLang model servers into one coordinated pool. They released it at the PyTorch Conference North America. It targets self-hosted agent and RL workloads, where round-robin load balancing breaks down. TL;DR A serving stack:…

Read Full News

PSG stun Barcelona in Champions League

Holders Paris Saint-Germain made it three wins from three in this season’s Champions League. Photo: AFP LONDON: Holders Paris Saint-Germain made it three wins from three in this season’s Champions League, beating Barcelona 4-2 thanks to late goals from Vitinha and Fabian Ruiz on Tuesday, while Liverpool clinched a dramatic comeback victory over Villarreal.  Phil…

Read Full News