NewsBite analysis · AI, Robotics
MarkTechPost
A 4B-Parameter Open World Model That Reasons and Generates Robot Actions On-Device
NVIDIA has released Cosmos 3 Edge, a new AI model designed to enhance robotics systems’ performance in data-constrained environments. This model enables real-time reasoning and action generation, targeting applications in industries like manufacturing and healthcare. Using a Mixture-of-Transformers architecture, it integrates various data modalities to allow robots to better understand their surroundings and make informed decisions autonomously. The release aims to bridge the demand for high-performance processing at the edge, a critical need for modern robotic operations.
Act nowConfidence: HighShort term horizon
Published 21 Jul 2026, 08:41 UTC4 min read
Visit original article ↗Lead image — MarkTechPost
Summary
TL;DR
- Cosmos 3 Edge features 4 billion parameters designed for on-device operation.
- It utilizes a Mixture-of-Transformers architecture for processing and generation.
- Targets environments like factories, warehouses, and hospitals with memory constraints.
- Achieves real-time control resolution of 640x360 at 15 Hz.
- Allows connection of robot actions directly to visual change predictions.
Interesting facts
- The model uses an autoregressive tower for reasoning and a diffusion tower for action generation.
- Cosmos 3 Edge is positioned for use with NVIDIA's latest GPU technology.