Gemma-4 31B Model Serves 1.17k Tok/s on RTX 6000 Pro
Gemma-4 31B model achieves 1.17k tokens per second throughput on RTX 6000 Pro GPU during peak load, with median TTFT of 0.7 seconds.
Software
262 articles
The tools, frameworks, and platforms developers use to build with AI — coding assistants, agent frameworks, APIs, and developer tooling, with the updates that change how you ship.
LATEST NEWS
-
-
Open-source tool pxpipe cuts Claude Code and Fable 5 token costs up to 70%
The open-source tool pxpipe reduces token costs for Claude Code and Fable 5 by up to 70% by hiding text in PNGs, according to developer Steven Chong.
-
AMD Introduces AgentKernelArena for AI Coding Agent Benchmarking
AMD launches AgentKernelArena, an open-source benchmarking tool, to evaluate AI coding agents on AMD Instinct GPUs, with GEAKv3 leading performance in multiple categories.
-
Meta Launches Pocket, AI-Powered Gaming App
Meta quietly launched Pocket, an AI-powered gaming app, on June 29, 2026, with 635K lifetime installs for its predecessor Gizmo.
-
Amazon SageMaker AI Introduces Multi-Turn Reinforcement Learning
Amazon SageMaker AI now offers multi-turn reinforcement learning tools to train agents for complex tasks like content moderation and support ticket resolution, using the SOP-Bench dataset for evaluation.
-
Mistral Launches Vibe Agent for Work and Code
Mistral's Vibe agent, now available, streamlines workflows with Work and Code modes, offering free to enterprise plans starting May 28, 2026.
-
Amazon SageMaker AI Accelerates Protein Design with BoltzGen
Amazon SageMaker AI enables faster protein binder design with BoltzGen, reducing a 1,000-sample campaign from 375 hours to under 2 hours.
-
Amazon Launches Open Source Model Profiler for Amazon Bedrock
Amazon Bedrock introduces an open source tool to simplify model selection across its 100+ foundation models, with daily pricing and regional availability updates.
-
Amazon Introduces Metadata Filtering in AgentCore Memory
Amazon Bedrock AgentCore Memory now supports metadata filtering, boosting QA accuracy to 64% in tests, up from 40% without it.
-
AWS Introduces Serverless A2A Gateway for Agent Management
AWS announced a serverless A2A gateway that simplifies agent discovery, routing, and access control for enterprises deploying AI agents across multiple environments.
-
X AI Launches Grok Voice Agent Builder
X AI announced Grok Voice Agent Builder, a no-code platform for creating voice agents in under two minutes, with a free trial available.
-
Claude Code Flagged Chinese Users via Hidden Code
Anthropic is removing a covert feature in Claude Code that secretly flagged Chinese users, according to a Reddit post exposing the issue.