Cloud infrastructure has long been built for human users who interact with the internet through predictable behaviors like searching, clicking, and streaming. However, AI agents operate differently, generating sudden bursts of activity that can spin up multiple sub-agents to query databases, search documents, and call APIs in seconds before disappearing. To address this, Amazon is redesigning a core part of its cloud infrastructure. On Thursday, AWS launched its next generation of OpenSearch Serverless, a fully managed search and vector database designed specifically for agentic workloads. AWS claims the system can instantly scale up when agents trigger tasks and scale down to zero when idle. This shift reflects a growing industry recognition that traditional infrastructure, built for human-driven internet, struggles with the increasing prevalence of machine-generated traffic. Cloudflare reported that bots accounted for 31% of HTTP traffic over the last six months, with AI crawlers, search engines, and assistants making up roughly a quarter of all bot requests. "Non-human traffic will exceed human traffic sometime in the first half of 2027," said Lai Yi Ohlsen, senior product manager at Cloudflare. Meanwhile, Google’s I/O developer conference highlighted plans to allow users to delegate tasks to AI systems, such as researching purchases, booking travel, and interacting with apps. Enterprises are also deploying agents internally and for customers, creating new machine-generated traffic. As a result, cloud providers are adapting systems to handle agents that autonomously retrieve information and generate machine-to-machine traffic. AWS’s new OpenSearch Serverless addresses this by decoupling compute from storage, enabling compute to scale up instantly to accommodate agent traffic and scale down to zero when idle. "Previously, even in our prior Serverless version, you had to have at least one instance operational and running because storage and compute were coupled," said Tia White, general manager for Amazon OpenSearch Service. "You couldn’t just automatically spin up [compute] at the rate you needed to, so you always had idle compute reserved for your workload, whether you were using it or not." The service now integrates natively with AI development platforms like Vercel and Kiro, allowing developers to deploy production-ready search and vector backends without managing infrastructure. Other companies like Databricks, Snowflake, and Microsoft are also repositioning their services to handle AI agent traffic. *Source: [techcrunch](https://techcrunch.com/2026/05/28/the-internet-is-being-rebuilt-for-machines/)*