Today's Date: October 3, 2023
Actress Kristen Bell Receives Inaugural "Vision for Peace" Award at Women's Peace and Humanitarian Fund Gala: Photos   •   UKG: Steady September for Workforce Activity   •   Clarity AI Introduces its First SFDR-aligned Sustainable Investment Index Methodology   •   Remedios Varo Exhibition at Art Institute of Chicago Celebrates Hispanic Heritage Through Art   •   Dunkin’® Launches First Ever Halloween Inflatable Décor, Inspired By Its Spider Donut   •   Global Energy and Chemical Leaders Partner to Develop a Large-Scale, Low-Carbon Ammonia Production Export Project on the Houston   •   AEM Elements™ Launches, Setting a New Standard in Natural Disaster Preparedness and Response   •   Enlightened Growth Leadership Awards, 2023: Driving Change in Sustainability   •   Euna Solutions Announces Winners of the 2023 Euna Procurement Awards   •   AtmosZero Expands Global Footprint, Launches European Operations   •   Simon® Earns GRESB Green Star   •   Cymbiotika Launches New Line, Cymbioitka Kids   •   DIANNE ANDREWS WINS NATIONAL DOCUMENTARY AWARD FOR "SILVER DOLLAR GROUP, KU KLUX KLAN" AT 11th ANNUAL WHISTLEBLOWERS SUMMIT &   •   Andreozzi + Foote File Lawsuits as the New Maryland Child Victims Law Takes Effect   •   U.S. Postal Service Commemorates Legacy of Ruth Bader Ginsburg   •   Global Gaming Women Announces Event Line-up at Global Gaming Expo 2023 including the 13th Annual Kick Up Your Heels Fundraiser   •   RepRisk data shows increase in greenwashing with one in three greenwashing public companies also linked to social washing   •   New Report From Dos Mundos Creative Illuminates the Untapped Economic and Cultural ROI of Intentional Inclusivity   •   SLB Launches Carbon Storage Screening and Ranking Solution   •   Banc of California and Rise Economy Announce $4.1 Billion Community Benefits Plan
Bookmark and Share

Toyota Research Institute Unveils Breakthrough in Teaching Robots New Behaviors

Toyota Research Institute Unveils Breakthrough in Teaching Robots New Behaviors

PR Newswire

New Generative AI Technique Brings Researchers One Step Closer to Building a "Large Behavior Model"

LOS ALTOS, Calif. and CAMBRIDGE, Mass., Sept. 19, 2023 /PRNewswire/ -- Today, Toyota Research Institute (TRI) announced a breakthrough generative AI approach based on Diffusion Policy to quickly and confidently teach robots new, dexterous skills. This advancement significantly improves robot utility and is a step towards building "Large Behavior Models (LBMs)" for robots, analogous to the Large Language Models (LLMs) that have recently revolutionized conversational AI.

"Our research in robotics is aimed at amplifying people rather than replacing them," said Gill Pratt, CEO of TRI and Chief Scientist for Toyota Motor Corporation. "This new teaching technique is both very efficient and produces very high performing behaviors, enabling robots to much more effectively amplify people in many ways."

Previous state-of-the-art techniques to teach robots new behaviors were slow, inconsistent, inefficient, and often limited to narrowly defined tasks performed in highly constrained environments. Roboticists needed to spend many hours writing sophisticated code and/or using numerous trial and error cycles to program behaviors.

TRI has already taught robots more than 60 difficult, dexterous skills using the new approach, including pouring liquids, using tools, and manipulating deformable objects. These achievements were realized without writing a single line of new code; the only change was supplying the robot with new data. Building on this success, TRI has set an ambitious target of teaching hundreds of new skills by the end of the year and 1,000 by the end of 2024.

Today's news also highlights that robots can be taught to function in new scenarios and perform a wide range of behaviors. These skills are not limited to just "'pick and place" or simply picking up objects and putting them down in new locations. TRI's robots can now interact with the world in varied and rich ways — which will one day allow robots to support people in everyday situations and unpredictable, ever-changing environments.

"The tasks that I'm watching these robots perform are simply amazing – even one year ago, I would not have predicted that we were close to this level of diverse dexterity," remarked Russ Tedrake, Vice President of Robotics Research at TRI. Dr. Tedrake, who is also the Toyota Professor of Electrical Engineering and Computer Science, Aeronautics and Astronautics, and Mechanical Engineering at MIT, explained, "What is so exciting about this new approach is the rate and reliability with which we can add new skills. Because these skills work directly from camera images and tactile sensing, using only learned representations, they are able to perform well even on tasks that involve deformable objects, cloth, and liquids — all of which have traditionally been extremely difficult for robots."

Technical details:

TRI's robot behavior model learns from haptic demonstrations from a teacher, combined with a language description of the goal. It then uses an AI-based Diffusion Policy to learn the demonstrated skill. This process allows a new behavior to be deployed autonomously from dozens of demonstrations. Not only does this approach produce consistent, repeatable, and performant results, but it does so with tremendous speed.

Key achievements of TRI's research for this novel development include:

  • Diffusion Policy: TRI and our collaborators in Professor Song's group at Columbia University developed a new, powerful generative-AI approach to behavior learning. This approach, called Diffusion Policy, enables easy and rapid behavior teaching from demonstration. 
  • Customized Robot Platform: TRI's robot platform is custom-built for dexterous dual-arm manipulation tasks with a special focus on enabling haptic feedback and tactile sensing. 
  • Pipeline: TRI robots have learned 60 dexterous skills already, with a target of hundreds by the end of the year and 1,000 by the end of 2024. 
  • Drake: Part of our (not so) secret sauce is Drake, a model-based design for robotics that provides us with a cutting-edge toolbox and simulation platform. Drake's high degree of realism allows us to develop in both simulation and in reality at a dramatically increased scale and velocity than would otherwise be possible. Our internal robot stack is built using Drake's optimization and systems frameworks, and we have made Drake open source to catalyze work across the entire robotics community.
  • Safety: Safety is core to our robotics efforts at TRI. We have designed our system with strong safeguards, powered by Drake and our custom robot control stack, to ensure our robots respect safety guarantees like not colliding with itself or its environment.

Diffusion Policy has been published at the 2023 Robotics Science and Systems conference. Additional technical information can be found on TRI's Medium blog

Please join our LinkedIn Live Q&A session on October 4th from 1 pm - 2 pm ET / 10 am - 11 am PT, for an opportunity to learn more and hear directly from the TRI robotics research team. Sign up for the event on TRI's LinkedIn page.

About Toyota Research Institute

Toyota Research Institute (TRI) conducts research to amplify human ability, focusing on making our lives safer and more sustainable. Led by Dr. Gill Pratt, TRI's team of researchers develops technologies to advance energy and materials, human-centered artificial intelligence, human interactive driving, machine learning, and robotics. Established in 2015, TRI has offices in Los Altos, California, and Cambridge, Massachusetts. For more information about TRI, please visit

TRI Media Contact:

Wendy Rosen

Senior Director of Communications


Cision View original content to download multimedia:

SOURCE Toyota Research Institute

Back to top
| Back to home page

White House Live Stream
alsharpton Rev. Al Sharpton
9 to 11 am EST
jjackson Rev. Jesse Jackson
10 to noon CST


Sounds Make the News ®
Atlanta - WAOK-Urban
Berkley / San Francisco - KPFA-Progressive
Chicago - WVON-Urban
KJLH - Urban
Los Angeles - KJLH - Urban
WKDM-Mandarin Chinese
New York - WKDM-Mandarin Chinese
New York - WADO-Spanish
WBAI - Progressive
New York - WBAI - Progressive
Washington - WOL-Urban

Listen to United Natiosns News