Amazon announced Amazon Bedrock AgentCore Runtime Instances on April 2024, saying it supports multi-agent workflows with persistent sessions and GPU access for creative tasks. It is the company's first software update in the machine learning category since the launch of Amazon Bedrock in 2023.
Amazon reported the runtime instances can support sessions up to 14 days, measured on the Amazon Bedrock platform, with GPU access on supported instance families. That compares with the previous MicroVMs, which capped at 8 hours.
Bedrock AgentCore Runtime Instances are built on AWS EC2 infrastructure and target complex workflows like multi-agent music production. Availability begins in April 2024, initially for developers and enterprises using AWS services.
"Runtime Instances are the new option: AWS managed EC2 infrastructure for persistent, long-running agent workflows," said Amazon. The runtime adds multi-day sessions, GPUs, persistent volumes, and the ability to colocate multiple agents on a single instance.
The announcement follows the release of Amazon Bedrock in 2023. Amazon framed the significance as an evolution of its machine learning infrastructure to support more complex and collaborative workflows.
Amazon did not say how the runtime will scale beyond its current capabilities, and raised the open question of how the persistent storage will be managed across multiple sessions. The company said developers can now build and deploy multi-agent systems without disrupting existing workflows.
Source: awsml
