Artificial Analysis

Trends

• Agent benchmarks expose reliability gaps and lose trust

Items

1. May 27

   Frontier models score below 50% on ITBench-AA

   IBM and Artificial Analysis's benchmark of alert triage, incident response, configuration management, and compliance on real enterprise tooling finds every tested frontier model below 50%, quantifying the gap to reliable autonomous IT operations.