In this tutorial, we explore how NVIDIA Transformer Engine accelerates transformer workloads by combining fused GPU kernels, BF16 computation, and hardware-aware FP8 execution. We begin by installing Transformer Engine and detecting the active GPU architecture so that we can determine whether the runtime supports TE kernels, FP8 tensor cores, or only the pure-PyTorch fallback path….
Hank Green, a novelist, comedian, and YouTuber with 3.2 million subscribers, recently apologized to his audience for his growing reliance on AI chatbots. The controversy started when, in the middle of a video posted on the educational channel Complexly, Green incongruously used the phrase “I appreciate the pushback,” leading viewers to speculate that he’d written…
Six twentysomethings in East London have built what they say is the anti-San Francisco hacker house. The goal is a “holistic improvement in life,” rather than “12 weeks, Demo Day is coming,” Rowan Aldean, 26, explained. Intrigued, I spent an afternoon visiting the house, meeting its residents, and doing a vibe check. I arrived after…
AMD released Instella-MoE-16B-A3B, a fully open Mixture-of-Experts language model trained from scratch on Instinct MI300X and MI325X GPUs. The model holds 16B total parameters but activates only 2.8B per token. AMD is publishing weights from every training stage, along with data mixtures, training configs, and inference code. Two systems-level choices carry the release: Gated Multi-head…
Despite a lawsuit from xAI, a Minnesota ban on apps that allow users to “nudify” images can move forward, according to NBC News. U.S. District Judge Donovan Frank’s ruling focused as much on the timing of xAI’s lawsuit as on the substance of the law itself. Frank wrote that xAI filed its request for a…
The smartphone industry’s next battleground may not be the phone itself, but how consumers get it. As premium devices become more expensive, Apple, Samsung, and others are betting that leasing, subscriptions, and guaranteed buyback programs can make upgrading more attractive. This week, Apple launched Apple Upgrade in the U.S. in partnership with Klarna, allowing consumers…
It’s summer. You are sweaty. There’s some unprecedented heat wave that’s even worse than the last unprecedented heat wave. You are uncomfortable. You’re getting sweatier by the second. What do you do? This predicament — one that’s becoming more and more common — just flat out sucks. But if you have a handheld mini fan…
OpenAI CEO Sam Altman seemed excited to share what he called a “cool use case” on Friday, posting that parents could “connect your family calendars and explain your kids’ interests” to the company’s new product ChatGPT Work, then “every morning for the drive to school, have it make a podcast that talks about one kid’s…
Screen-time apps aren’t effective for many people because, in the end, they depend on your willpower. They remind you to stop scrolling or let you set timers, but such notifications can be easy to ignore. Autonomous Key takes a different approach to this issue simply by being a physical device. It’s an NFC key that…
Uber has partnered with — and in some cases made direct investments in — more than 30 autonomous vehicle companies over the past two years. And it’s taking a global approach. Here, TechCrunch tracks every one of those moves in one place. But first, a bit of history. Uber was, at one time, developing and testing…
