What happened
Recent onchain data reveals a significant surge in the activity of inference markets, with usage volumes jumping approximately 2.3x in less than 30 days. On October 18, 2024, surplus usage hit a historic peak of 312.6 billion tokens. This milestone is driven by the expansion of platforms like Surplus and its competitors, reflecting a broader trend where AI model execution is increasingly migrating toward decentralized blockchain environments.
Technology context
AI inference is the stage where a pre-trained machine learning model processes input data to provide an output, such as generating text or identifying an image. Traditionally, this happens on centralized cloud servers (AWS, Google Cloud). Onchain inference decentralizes this process, utilizing a global network of hardware providers. Users interact with these models via blockchain protocols, paying for computing power in crypto-native tokens, which ensures that the AI's operations are verifiable and permissionless.
Why it matters
This record usage proves that decentralized physical infrastructure (DePIN) is becoming a viable alternative to Big Tech's monopoly on AI. It offers a censorship-resistant way to access powerful Large Language Models (LLMs). However, the industry is at a crossroads; while token usage is skyrocketing, critics emphasize the need for "dollar-denominated" revenue transparency to prove that these networks are generating actual economic value rather than just high-volume, low-margin activity.
Key terms explained
- AI Inference: The process of running data through a trained model to get a result (e.g., asking a chatbot a question).
- Onchain: Refers to activities or data that are recorded and verified on a blockchain ledger.
- Token Usage: In AI, this refers to the chunks of text (tokens) processed; in this context, it measures the total workload handled by the network.
- DePIN: Decentralized Physical Infrastructure Networks that use blockchain to coordinate real-world hardware resources.
Impact
In the short term, the market will see increased volatility as various protocols vie for dominance in the AI compute space. In the medium term, the reliability of onchain inference could lead to the rise of "AI Agents"—autonomous programs capable of managing DeFi portfolios or executing smart contracts based on real-time AI analysis, all without human oversight.
What's next
We expect a shift in how these projects report growth, moving toward standardized financial metrics to satisfy institutional investors. As the cost of decentralized compute continues to drop due to network effects, we may see the first major consumer applications that bypass traditional AI providers entirely in favor of onchain alternatives.
*
Educational analysis generated with AI and editorially reviewed.
Sources
- Bankless
- Dune Analytics (Inference Market Dashboards)