AI & Tech

Pretraining frontier-scale LLMs in FP8 is now standard practice, but moving to 4-bit floating point has remained an open research problem because narrower formats compress dynamic range and amplify quantization error at long token horizons. A new research from NVIDIA describes a pretraining methodology built around NVFP4, a 4-bit microscaling format supported natively by Blackwell…

import subprocess, sys def pip(*pkgs): subprocess.check_call([sys.executable, “-m”, “pip”, “install”, “-q”, *pkgs]) pip(“llmcompressor”, “compressed-tensors”, “transformers>=4.45”, “accelerate”, “datasets”) import os, gc, time, json, math from pathlib import Path import torch from transformers import AutoModelForCausalLM, AutoTokenizer from datasets import load_dataset assert torch.cuda.is_available(), \ “Enable a GPU: Runtime > Change runtime type > T4 GPU” print(“GPU:”, torch.cuda.get_device_name(0), “| CUDA:”,…

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. To get this in your inbox, sign up here for free — just click TechCrunch Mobility! There is a bit of a theme emerging in transportation — and really every industry: AI is creating jobs for some…

Commencement season has come around again — and this year, at least a couple speakers have discovered that it’s tough to get graduating students excited about a future shaped by artificial intelligence. Last week, Gloria Caulfield, an executive at real estate firm Tavistock Development Company, gave a speech at the University of Central Florida acknowledging…

Vercel Labs 01 / 09  ·  Overview ZeroThe Programming Languagefor Agents An experimental systems language that gives AI agents structured diagnostics,typed repair metadata, and machine-readable docs — alongside sub-10 KiB native binaries. Systems Language Agent-Native v0.1.1 Apache-2.0 Experimental Context 02 / 09  ·  Why Zero Exists The Agent Repair Loop Problem Most programming languages produce…