Sim/digital-twin & embodied: world models and sim-to-real advances
Key Questions
What NVIDIA advancements support world models and simulation?
NVIDIA has open-sourced GR00T 1.7 and Cosmos 3, along with a GPU-accelerated Medical Physics Simulation framework within Isaac for Healthcare. These lower barriers for sim-to-real applications in robotics and medical physics.
What world model capabilities does Xiaomi's 38B model offer?
Xiaomi's 38B world model achieves an 82.9x speedup, advancing embodied AI and digital twin technologies. It contributes to scalable simulation environments for real-world transfer.
How does RoboTTT enhance visuomotor learning?
RoboTTT scales visuomotor context to 8K timesteps, improving long-horizon task handling in robotic systems. This supports more robust sim-to-real policy transfer.
What tools help lower barriers for photorealistic simulation?
SPEAR provides a photorealistic simulator, while the Omniverse Agent Toolkit and related frameworks enable easier development. NVIDIA's open-source releases further facilitate embodied AI research.
How is NVIDIA involved in surgical and medical robotics simulations?
NVIDIA collaborates with CMR Surgical to showcase predictive capabilities of the Versius Plus robot in simulated environments. The open-sourced Medical Physics framework accelerates medical device innovation.
NVIDIA GR00T 1.7 and Cosmos 3 open-sourced, Xiaomi 38B world model with 82.9x speedup. RoboTTT scales visuomotor context to 8K timesteps. SPEAR photorealistic simulator and Omniverse Agent Toolkit lower barriers. Status: developing.