Cloudflare CEO: We're Ready To Block Millions of Websites From AI — With Matthew Prince

Summary

Matthew Prince argues that the web has crossed a major threshold: automated traffic has surpassed human traffic, and the next phase will be dominated by AI agents, not just model training crawlers. He says this changes everything from infrastructure costs to publishing economics, because the current ad/subscription model does not work when machines consume content at massive scale. Cloudflare wants to reduce serving costs, use lighter-weight infrastructure like workers and isolates, and eventually support micropayments and other compensation rails for machine access. Prince also singles out Google as the key strategic issue, saying it uses one crawler for search and AI and that Cloudflare will default ad-supported sites into a stricter block starting mid-September unless they opt out. Beyond media, he warns that agentic commerce could consolidate markets and make it much harder for small businesses to compete unless brands and merchant data become verifiable, machine-readable signals.

Notes

• Automated web traffic passed human traffic in May 2026, per Cloudflare’s internal estimates.
• Prince forecasts automated traffic could reach 1,000x human traffic within five years.
• The growth thesis is driven by AI agents interacting with websites, not only model-training crawlers.
• Prince wants the model-producer ecosystem to be much more open and competitive.
• Cloudflare is trying to make AI delivery more efficient by serving markdown instead of heavy HTML when possible.
• The target is a 1/1000th cost per page served.
• Cloudflare thinks current server stacks are too heavy for future agent load.
• Workers and isolates are positioned as lighter-weight alternatives to containers.
• Prince says every knowledge worker with an agent in a traditional container would overwhelm current compute supply.
• Cloudflare says publisher-side crawl-to-click economics have deteriorated sharply over the last year.
• The company is also building infrastructure for machine monetization and micropayments.
• Cloudflare handles about 0.5 billion internet transactions per second.
• Visa’s holiday peak is used as a payments benchmark at roughly 20,000 transactions per second.
• He estimates 1% to 10% of current traffic could be monetizable on day one via micropayments.
• A micropayments rail would need to scale from around 10 to over 100 million transactions per second.
• Google is the main strategic adversary in Prince’s telling because it uses one crawler for two purposes.
• Cloudflare plans to block Google by default for ad-supported and subscription-supported sites in mid-September unless publishers opt out.
• The default change is framed as a stronger gate, not just a robots-style warning.
• Prince says millions of sites may drop off Google’s radar after the policy change.
• Cloudflare also plans to tighten controls on AI crawlers beyond simple access denial.
• Prince argues Google is trying to convert yesterday’s monopoly into tomorrow’s monopoly.
• He says content-creation incentives collapse if the market is not fixed.
• Cloudflare’s scale gives it leverage because a huge percentage of the internet uses it.
• The web’s business model for the next 30 years will not look like the last 30 years.
• Prince says media monetization has improved versus a year ago, but the problem has broadened to the broader economy.
• He says the future he wants is one with many AI companies and many creators, not a few giants.
• Today, small businesses buy reach on Instagram, Facebook, or Google Ads to acquire customers.
• He defines brand as a shortcut humans use to infer value and quality.
• Agents will not rely on emotional brand loyalty the way humans do.
• Agentic commerce will make discovery much more data-intensive and harder for new entrants.
• Prince says a startup may struggle to get its first customer if all buyers are agentic.
• He warns agentic commerce could become a consolidation engine favoring big companies.
• Prince wants brand to become a verifiable attestation of quality and operations.
• The proposed merchant reputation layer would combine ratings, fulfillment time, returns, and chargebacks.
• He says old SEO playbooks will not work in the agentic future.
• Cloudflare is talking with Shopify, PayPal, Visa, Mastercard, American Express, and Intuit on small-business tools.
• Prince warns AI could widen inequality if wealthy users buy premium, fully honest agents.
• He expects a better answer for small businesses to emerge over the next year through outside collaboration.