Unified multimodal models
Technique · Voice & Multimodal · 3 items since Apr 2026
One model that both understands and generates text, images, and other modalities.
Related
- Organizations
- Techniques
Trends
Items
- Jul 10
SenseNova recasts vision as multimodal generation
One instruction-driven model reformulates detection, OCR, segmentation, depth, keypoints, and camera pose as text-and-image generation, matching task-specialized systems, released with an open model and a 50M-example corpus.
- Apr 27
Meta's Tuna-2 drops vision encoders
A unified multimodal model that understands and generates images directly from pixel embeddings, with no pretrained vision encoder, reaches state-of-the-art results on multimodal benchmarks, challenging the encoder-first design of vision-language models.
- Apr 22
Inclusion AI's LLaDA2.0-Uni
A single discrete-diffusion LLM with a MoE backbone matches specialized VLMs on multimodal understanding while generating and editing high-fidelity images, the first open architecture for natively interleaved generation and reasoning.