NVIDIA Cosmos-H-Dreams brings real-time generative simulation to surgical robotics
Real-time, action-conditioned simulation enables faster evaluation and safer data generation for surgical robotics, reducing reliance on costly physical experiments and enabling closed-loop testing.
At a glance
- Cosmos-H-Dreams is a real-time, action-conditioned generative simulator for surgical robotics.
- Runs on a single NVIDIA RTX PRO 6000 GPU.
- Uses FlashDreams, NVIDIA's accelerated streaming-inference library.
- Collaborations include CMR Surgical and Cambridge Consultants to enable real-time operation on the Versius platform.
The story
Surgical robotics is moving from teleoperation toward more capable vision-language-action policies, and NVIDIA’s Cosmos-H-Dreams represents a next step in making those capabilities testable in real time. Hugging Face’s article frames Cosmos-H-Dreams as a real-time, action-conditioned generative simulator designed to support closed-loop control of surgical systems. The setup enables interactive control by a person or a learned policy, with the system running on a single RTX PRO 6000 GPU.