This chip startup simply raised $135M on a guess that AI’s largest bottleneck is not compute — it is reminiscence
Each time you ask ChatGPT a query, your request triggers an information relay race. Data leaves reminiscence, passes by means of a CPU for preprocessing, travels to a GPU for heavy computation, after which makes its method again — and that complete journey repeats for each single phrase the AI generates. The bottleneck is structural…