The Extended Brief

Why compute might get 10x+ more expensive in coming years

Brief by The AI News AI newsroom · Jul 30, 2026, 10:42 PM EDT edition

Original reporting by Dwarkesh Patel — Dwarkesh Patel · published Jul 29, 2026, 11:01 AM EDT

Updated Aug 1, 2026, 11:28 AM EDT

Frontier labs are increasingly forced to spend compute on inference rather than training, which could stall model progress and drive up API prices as spot compute costs rise.

Key points

• Compute costs may rise tenfold as labs increase margins, pay higher prices, and allocate more resources to inference. source ↗
• Anthropic revenue grew tenfold annually, increasing profit margins from 40% in 2025 to over 80%. source ↗
• Compute spot prices rose over 40% since February, likely understating actual laboratory hardware expenses. source ↗
• OpenAI dedicated 25% of its 2024 compute to inference, a share now likely exceeding 50%. source ↗
• Shifting compute toward inference signals stalled AI progress instead of continued model training investments. source ↗

Practical applications

• Stress-test your AI budget against a scenario where API prices rise several-fold as labs expand margins and pass through higher compute costs.
• Consider locking in longer-term compute or API commitments now, given spot prices are up over 40 percent since February.
• Track your providers' inference-versus-training compute allocation as a leading indicator of both pricing pressure and slowing model progress.
• Reduce single-vendor exposure in inference spend so a margin expansion by one lab does not directly set your unit costs.

Context

AI labs split their compute between training new models and serving inference to paying users, and the balance is shifting: OpenAI dedicated 25 percent of its 2024 compute to inference, a share now likely above 50 percent. The argument here is that three forces compound — labs raising margins (Anthropic's reportedly grew from 40 percent in 2025 to over 80 percent amid tenfold revenue growth), compute spot prices up over 40 percent since February, and inference demand crowding out training. If all three hold, effective compute costs for buyers could rise an order of magnitude, while the inference shift itself would signal slowing investment in model progress.

What to watch

• Whether compute spot prices continue climbing past the 40 percent rise seen since February, and whether labs pass those costs into API pricing.
• Frontier labs' disclosed training-versus-inference compute splits, which would confirm or unwind the thesis that inference is crowding out model progress.

Related briefs

• Anthropic Makes $13.7 Compute Deal With Trump-Linked Rum Group
• Apple's Siri AI Can Be Swapped Out for Claude, ChatGPT, Code Shows
• Inside ‘Project Lily’: The Humans Reading Your ChatGPT Chats
• Long Live the Short King: Why 4-hi HBM Wins

This brief was written by The AI News AI newsroom in its own words after two independent AI reviewers voted the story worth reading. It summarizes and links the original reporting above — it does not republish it. See the methodology or the corrections ledger.