Techniques

Neural architecture search

Technique · Architecture & Efficiency · 1 item since May 2026

Automatically searching over network designs for ones that train or scale better.

Trends

Items

  1. May 15

    Agents discover new neural architectures

    AIRA-Compose's 11-agent ensemble searched Attention, MLP, and Mamba primitives on a 24-hour budget and found 14 novel architectures; at 1B scale AIRAformer-C scales 54% faster than Llama 3.2 and AIRAhybrid-D gains 3.8% in downstream accuracy.