Amazon has introduced QA Studio, an agentic QA automation solution built with Amazon Nova Act, designed to streamline software testing and integration into CI/CD pipelines. The platform enables developers to organize individual use cases into test suites that run in parallel, significantly reducing execution time by running up to 20 tests concurrently. This approach supports structured regression testing across functional areas, offering a scalable solution for automated quality assurance. QA Studio also includes a command-line interface (CLI) for seamless integration into CI/CD environments, allowing for non-interactive test execution and structured output. The CLI connects to the same API backend as the web interface, enabling tests to run on the machine where the CLI is executed, such as a CI/CD runner, with results reported back to the QA Studio deployment. The CLI supports OAuth 2.0 client credentials authentication, allowing CI/CD pipelines to securely run tests without requiring interactive browser logins. It also provides mechanisms to override environments and variables, enabling tests to target different stages like development, staging, or production without duplicating test definitions. Additionally, the CLI uses exit codes to communicate test results to pipelines, distinguishing between test failures and infrastructure errors. The solution also includes secure handling of headers and secrets, ensuring sensitive information is not exposed in logs or execution history. The CLI automatically requests and caches access tokens, refreshing them when they expire, and supports multiple output formats for programmatic consumption or human-readable logs. It creates execution records in QA Studio, updates step statuses in real time, and uploads artifacts such as trajectory logs and session recordings. The CLI can be installed as a Python package from the project's GitHub repository, with optional runner dependencies. It also supports environment-specific configurations through command-line flags, allowing tests to adapt to different environments without modifying test definitions. The QA Studio CLI enhances the efficiency of automated testing by providing a structured and secure interface for integrating agentic QA into existing CI/CD workflows.
Source: awsml
