Intel released AgentSysPerf on April 5, 2024, stating it provides a standardized benchmark for evaluating agentic systems. It is the company's first major update to its agentic stack since the introduction of the initial agentic framework in 2023.
Intel reported a benchmark score of 92.4 on the Agentic Performance Index, measured under standard workload conditions. That compares with a score of 85.2 from the previous benchmarking tool.
AgentSysPerf is built on the Intel Agentic Platform and targets developers and researchers working on AI agents. Availability begins in Q2 2024, initially for academic and enterprise users.
"AgentSysPerf is designed to provide consistent and reliable performance metrics for agentic systems," said Dr. Sarah Lin, Intel’s lead AI architect. "This tool will help developers better understand and optimize their agentic applications."
The announcement follows Intel’s participation in the AI Benchmarking Consortium. Intel framed the release as a step toward more transparent and comparable agentic system evaluations.
Intel did not specify the exact use cases for AgentSysPerf beyond general agentic development, and the company raised questions about how different workloads might affect benchmark results. The tool will be available for download in early June 2024.
Source: intel