NVIDIA offers ROS developers generative AI tools plus simulation, perception workflows [Video]

Today at ROSCon in Odense, Denmark, NVIDIA Corp. and its partners announced generative artificial intelligence tools, simulation, and perception AI workflows for developers using the Robot Operating System, or ROS.

Among the announcements were NVIDIA Isaac ROS and NVIDIA Isaac Sim technologies and developer guides, as well as NVIDIA AI-enabled generative AI ROS nodes for developers deploying to NVIDIA Jetson. Physically based simulation in Isaac Sim helps ROS developers create and validate AI models prior to deployment, according to the company.

Generative AI enables robots to perceive and understand the context of their surroundings, communicate naturally with humans, and make adaptive decisions autonomously, NVIDIA explained.

ROS community gets generative AI tools

Built on ROS 2, ReMEmbR uses generative AI to enhance robotic reasoning and action. It combines large language models (LLMs), vision language models (VLMs) and retrieval-augmented generation to allow robots to build and query long-term semantic memories and improve their ability to navigate and interact with their environments.

The speech-recognition …