Yann LeCun’s New LeWorldModel (LeWM) Analysis Targets JEPA Collapse in Pixel-Based mostly Predictive World Modeling
World Fashions (WMs) are a central framework for growing brokers that purpose and plan in a compact latent area. Nevertheless, coaching these fashions straight from pixel information usually results in ‘illustration collapse,’ the place the mannequin produces redundant embeddings to trivially fulfill prediction goals. Present approaches try to stop this by counting on complicated heuristics:…
