Benchmarks

PlanBench-XL

Benchmark · From University of Illinois Urbana-Champaign · 1 item since Jun 2026

Long-horizon tool-use planning on retail tasks with missing, failing, or distracting tools.

Items

  1. Jun 21

    UIUC's PlanBench-XL

    An interactive benchmark of 327 retail tasks over 1,665 tools with optional missing, failing, or distracting tools; GPT-5.4 falls from 51.90% without blocking to 11.36% under severe blocking, exposing brittle long-horizon planning when failures lack explicit errors.