AWS released DevOps Agent and AgentCore Evaluations to monitor multi-agent systems, tackling challenges such as silent errors and quality regressions in production environments. This marks the company's first major update to its AI agent monitoring tools since the launch of the AgentCore runtime in 2023.
The new tools are built on AWS services like Amazon Bedrock and OpenTelemetry, targeting complex use cases like multi-agent coordination in airline reservations. Availability began in July 2024, initially for developers and enterprise customers building AI-driven applications.
"Infrastructure issues often manifest as reduced agent behavior rather than clear errors," said AWS Machine Learning blog. "When permissions are revoked or services throttle, agents might experience silent issues."
The announcement follows AWS's focus on improving AI agent observability in its cloud services. AWS did not specify the exact number of companies using the tools, and the open question remains about how well the system handles dynamic, multi-agent workflows.
Source: awsml
