Crucial market of the longer term might be in LLM tokens — and monetary teams are speeding to construct new infrastructure for them.
China’s Shanghai Futures Alternate is presently designing a derivatives marketplace for AI tokens, Reuters reports. The information comes as main derivatives change CME Group and the Intercontinental Exchange (the proprietor of the NYSE) have individually stated they’re engaged on launching futures contracts for renting GPUs.
GPU markets are nonetheless maturing, however given the wide selection of corporations utilizing, promoting, and renting GPUs, there’s a strong marketplace for spot costs on GPU rental, usually charged by the hour. Based on information from AI Mining Co., which tracks each day GPU rental pricing throughout 28 marketplaces and cloud suppliers, median costs for Nvidia H100 GPUs ranged from $1.40 to $4.27 per hour throughout 13 marketplaces, whereas the common worth for H200 GPUs have been between $2.34 and $5 per hour throughout 10 marketplaces. And simply over the previous seven days, common H100 costs ranged from $2.79 to $3.33.
However whereas mature markets exist for GPUs, there’s much less infrastructure round tokens themselves — the basic constructing blocks of up to date AI fashions. Enterprise plans for main AI corporations are generally denominated in tokens: OpenAI, for instance, prices $5 per million enter tokens, and $30 per million output tokens if you wish to use the API for its newest GPT-5.5 mannequin. Even cloud suppliers are more and more providing the chance to cost per token, as in Amazon’s Bedrock system.
The hassle comes amid an unprecedented buildout of AI infrastructure. Cloud service suppliers, non-public fairness corporations, and infrastructure gamers alike have poured tons of of billions into constructing information facilities, anticipating that demand for GPUs and compute will proceed to rise. An rising crop of world neocloud corporations can be vying for a bit of this demand. A few of these new entrants are specializing, specializing in inference, whereas others are competing with cloud giants like Oracle, AWS, and Google Cloud to supply their companies to AI corporations.
By concentrating on AI tokens, the Shanghai change’s by-product product can be tied to how AI corporations worth their companies, giving companies, traders, and information heart operators a solution to hedge in opposition to the price of compute.
Once you buy via hyperlinks in our articles, we might earn a small fee. This doesn’t have an effect on our editorial independence.
