×
Nvidia’s ‘Cosmos’ model helps humanoid robots navigate physical environments
Written by
Published on
Join our daily newsletter for breaking news, product launches and deals, research breakdowns, and other industry-leading AI coverage
Join Now

Nvidia unveiled Cosmos, a new AI system designed to help robots better understand and navigate physical environments through advanced simulation and training capabilities.

Key announcement: Nvidia has launched Cosmos, a family of foundational AI models specifically created to enhance the capabilities of humanoid robots, industrial robots, and autonomous vehicles.

  • The system was trained using 20 million hours of human movement data, including walking patterns and hand manipulations
  • Unlike traditional language models, Cosmos focuses on generating images and 3D models of the physical world
  • The technology can create realistic simulations of warehouse activities and physical interactions

Technical capabilities and applications: Cosmos represents a significant advancement in robot training and simulation technology.

  • The system can generate realistic video simulations, such as boxes falling from warehouse shelves, to train robots in accident recognition
  • Users have the ability to fine-tune the models with their own specific data
  • The technology integrates with Nvidia’s existing Isaac robot simulation platform, enabling more efficient task learning from limited examples

Industry adoption: Several prominent companies in robotics and autonomous vehicle sectors have already implemented Cosmos.

  • Early adopters include humanoid robot companies Agility and Figure AI
  • Self-driving technology companies Uber, Waabi, and Wayve are also utilizing the system
  • The technology has garnered interest from various humanoid robot developers, including Tesla and Boston Dynamics

Additional developments: Nvidia announced several complementary technologies alongside Cosmos.

  • Project Digits, a $3,000 personal AI supercomputer capable of running large language models up to 200 billion parameters without cloud services
  • Next-generation RTX Blackwell GPUs
  • New software tools for AI agent development

Future implications: The development of Cosmos signals a shift toward more sophisticated robot training methods that could accelerate the deployment of capable humanoid robots in real-world applications, though significant challenges in physical robot development and implementation likely remain to be addressed.

Nvidia's 'Cosmos' AI Helps Humanoid Robots Navigate the World

Recent News

Cognitive offloading and the decline of critical thinking in the AI era

Research links AI-assisted "cognitive offloading" to declining IQ scores and critical thinking skills in developed countries.

US retreats from disinformation defense just as AI-powered deception grows

Federal research cuts come as AI makes deceptive content more sophisticated and tech companies reduce their content moderation efforts.

False legal citations expose the risks of generative AI in law

MyPillow CEO's legal team faces potential sanctions after AI-generated brief included numerous fictional court cases that were never verified.