Crucial market of the long run may very well be in LLM tokens — and monetary teams are speeding to construct new infrastructure for them.
China’s Shanghai Futures Alternate is at the moment designing a derivatives marketplace for AI tokens, Reuters reports. The information comes as main derivatives trade CME Group and the Intercontinental Exchange (the proprietor of the NYSE) have individually mentioned they’re engaged on launching futures contracts for renting GPUs.
GPU markets are nonetheless maturing, however given the wide selection of corporations utilizing, promoting, and renting GPUs, there’s a sturdy marketplace for spot costs on GPU rental, sometimes charged by the hour. In keeping with knowledge from AI Mining Co., which tracks each day GPU rental pricing throughout 28 marketplaces and cloud suppliers, median costs for Nvidia H100 GPUs ranged from $1.40 to $4.27 per hour throughout 13 marketplaces, whereas the typical value for H200 GPUs had been between $2.34 and $5 per hour throughout 10 marketplaces. And simply over the previous seven days, common H100 costs ranged from $2.79 to $3.33.
However whereas mature markets exist for GPUs, there’s much less infrastructure round tokens themselves — the elemental constructing blocks of latest AI fashions. Enterprise plans for main AI corporations are generally denominated in tokens: OpenAI, for instance, fees $5 per million enter tokens, and $30 per million output tokens if you wish to use the API for its newest GPT-5.5 mannequin. Even cloud suppliers are more and more providing the chance to cost per token, as in Amazon’s Bedrock system.
The hassle comes amid an unprecedented buildout of AI infrastructure. Cloud service suppliers, personal fairness corporations, and infrastructure gamers alike have poured a whole bunch of billions into constructing knowledge facilities, anticipating that demand for GPUs and compute will proceed to rise. An rising crop of worldwide neocloud companies can also be vying for a bit of this demand. A few of these new entrants are specializing, specializing in inference, whereas others are competing with cloud giants like Oracle, AWS, and Google Cloud to supply their companies to AI corporations.
By focusing on AI tokens, the Shanghai trade’s by-product product can be tied to how AI corporations value their companies, giving companies, traders, and knowledge heart operators a option to hedge towards the price of compute.
If you buy by hyperlinks in our articles, we may earn a small commission. This doesn’t have an effect on our editorial independence.
