IBM

Models & products

Models

Granite

Trends

• Agent benchmarks expose reliability gaps and lose trust

Items

1. May 27

   Frontier models score below 50% on ITBench-AA

   IBM and Artificial Analysis's benchmark of alert triage, incident response, configuration management, and compliance on real enterprise tooling finds every tested frontier model below 50%, quantifying the gap to reliable autonomous IT operations.

2. May 14

   IBM's Granite Embedding Multilingual R2

   A sub-100M-parameter Apache-2.0 multilingual embedding model with a 32K context window that leads models under 100M parameters on standard multilingual retrieval benchmarks, aimed at cost-sensitive enterprise RAG.

3. Apr 29

   IBM's Granite 4.1

   New dense and MoE open models with 256K context and multilingual instruction tuning, released on Hugging Face under a commercially permissive license with a detailed breakdown of the post-training pipeline.

4. Mar 31

   IBM's Granite 4.0 3B Vision

   A compact Apache-2.0 document VLM shipped as a LoRA adapter on Granite 4.0 Micro, state of the art on chart extraction and on key-value extraction from US government forms (85.5% exact match zero-shot on VAREX).