* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Friday, September 19, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Massive Attack Say They’ll Remove Music From Spotify – yahoo.com

    Massive Attack Announces Plans to Pull Their Music from Spotify

    REO to return for UI homecoming – The News-Gazette

    REO Gears Up to Ignite the Stage at UI Homecoming Celebration!

    Gen V Season 2: What is The Odessa Project? – yahoo.com

    Gen V Season 2: Unlocking the Secrets of The Odessa Project

    PENN Entertainment stock rating reiterated at Market Outperform by JMP – Investing.com

    PENN Entertainment Stock Rated a Market Outperformer by Experts

    Here’s how NJ’s once-vibrant nightclub scene was born and why it died – Bergen Record

    The Rise and Fall of New Jersey’s Once-Vibrant Nightclub Scene: What Happened?

    The Emmys are back: Viewership soars to highest numbers in 4 years – yahoo.com

    The Emmys Return with a Bang: Viewership Hits a 4-Year High

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Huawei Unveils New AI Chip Tech to Challenge Nvidia’s Lead – Bloomberg.com

    Huawei Unveils New AI Chip Tech to Challenge Nvidia’s Lead – Bloomberg.com

    China says US TikTok deal a ‘win-win’, will review app’s technology and IP transfers – Reuters

    China Hails US TikTok Deal as a ‘Win-Win’ While Launching Review of App’s Technology and IP Transfers

    Bucking the Odds: Why Technology Companies Should Embrace Software Patents Today – Crowell & Moring LLP

    Bucking the Odds: Why Technology Companies Should Embrace Software Patents Today – Crowell & Moring LLP

    City IT presented Best of North Carolina Technology Award – RaleighNC.gov

    City IT Honored with Best of North Carolina Technology Award

    LELO Releases 2025 Futurist Report: Intergenerational Views on Relationships, Sex, and Technology – PR Newswire

    Exploring the Future: How Different Generations View Relationships, Sex, and Technology in 2025

    Will New Big Technology Engagements Reshape Innodata’s Growth Path? – Yahoo Finance

    Could New Major Tech Partnerships Propel Innodata to Unprecedented Growth?

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Massive Attack Say They’ll Remove Music From Spotify – yahoo.com

    Massive Attack Announces Plans to Pull Their Music from Spotify

    REO to return for UI homecoming – The News-Gazette

    REO Gears Up to Ignite the Stage at UI Homecoming Celebration!

    Gen V Season 2: What is The Odessa Project? – yahoo.com

    Gen V Season 2: Unlocking the Secrets of The Odessa Project

    PENN Entertainment stock rating reiterated at Market Outperform by JMP – Investing.com

    PENN Entertainment Stock Rated a Market Outperformer by Experts

    Here’s how NJ’s once-vibrant nightclub scene was born and why it died – Bergen Record

    The Rise and Fall of New Jersey’s Once-Vibrant Nightclub Scene: What Happened?

    The Emmys are back: Viewership soars to highest numbers in 4 years – yahoo.com

    The Emmys Return with a Bang: Viewership Hits a 4-Year High

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Huawei Unveils New AI Chip Tech to Challenge Nvidia’s Lead – Bloomberg.com

    Huawei Unveils New AI Chip Tech to Challenge Nvidia’s Lead – Bloomberg.com

    China says US TikTok deal a ‘win-win’, will review app’s technology and IP transfers – Reuters

    China Hails US TikTok Deal as a ‘Win-Win’ While Launching Review of App’s Technology and IP Transfers

    Bucking the Odds: Why Technology Companies Should Embrace Software Patents Today – Crowell & Moring LLP

    Bucking the Odds: Why Technology Companies Should Embrace Software Patents Today – Crowell & Moring LLP

    City IT presented Best of North Carolina Technology Award – RaleighNC.gov

    City IT Honored with Best of North Carolina Technology Award

    LELO Releases 2025 Futurist Report: Intergenerational Views on Relationships, Sex, and Technology – PR Newswire

    Exploring the Future: How Different Generations View Relationships, Sex, and Technology in 2025

    Will New Big Technology Engagements Reshape Innodata’s Growth Path? – Yahoo Finance

    Could New Major Tech Partnerships Propel Innodata to Unprecedented Growth?

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Technology

Google’s RT-2 AI model brings us one step closer to WALL-E

July 30, 2023
in Technology
Google’s RT-2 AI model brings us one step closer to WALL-E
Share on FacebookShare on Twitter

these robotic eyes —

“First-of-its-kind” robot AI model can recognize trash and perform complex actions.

Benj Edwards
– Jul 28, 2023 9:32 pm UTC

A Google robot controlled by RT-2.

Enlarge / A Google robot controlled by RT-2.

Google

On Friday, Google DeepMind announced Robotic Transformer 2 (RT-2), a “first-of-its-kind” vision-language-action (VLA) model that uses data scraped from the Internet to enable better robotic control through plain language commands. The ultimate goal is to create general-purpose robots that can navigate human environments, similar to fictional robots like WALL-E or C-3PO.

When a human wants to learn a task, we often read and observe. In a similar way, RT-2 utilizes a large language model (the tech behind ChatGPT) that has been trained on text and images found online. RT-2 uses this information to recognize patterns and perform actions even if the robot hasn’t been specifically trained to do those tasks—a concept called generalization.

For example, Google says that RT-2 can allow a robot to recognize and throw away trash without having been specifically trained to do so. It uses its understanding of what trash is and how it is usually disposed to guide its actions. RT-2 even sees discarded food packaging or banana peels as trash, despite the potential ambiguity.

Examples of generalized robotic skills RT-2 can perform that were not in the robotics data. Instead, it learned about them from scrapes of the web.

Enlarge / Examples of generalized robotic skills RT-2 can perform that were not in the robotics data. Instead, it learned about them from scrapes of the web.

Google

In another example, The New York Times recounts a Google engineer giving the command, “Pick up the extinct animal,” and the RT-2 robot locates and picks out a dinosaur from a selection of three figurines on a table.

This capability is notable because robots have typically been trained from a vast number of manually acquired data points, making that process difficult due to the high time and cost of covering every possible scenario. Put simply, the real world is a dynamic mess, with changing situations and configurations of objects. A practical robot helper needs to be able to adapt on the fly in ways that are impossible to explicitly program, and that’s where RT-2 comes in.

More than meets the eye

With RT-2, Google DeepMind has adopted a strategy that plays on the strengths of transformer AI models, known for their capacity to generalize information. RT-2 draws on earlier AI work at Google, including the Pathways Language and Image model (PaLI-X) and the Pathways Language model Embodied (PaLM-E). Additionally, RT-2 was also co-trained on data from its predecessor model (RT-1), which was collected over a period of 17 months in an “office kitchen environment” by 13 robots.

The RT-2 architecture involves fine-tuning a pre-trained VLM model on robotics and web data. The resulting model processes robot camera images and predicts actions that the robot should execute.

Google fine-tuned a VLM model on robotics and web data. The resulting model takes in robot camera images and predicts actions for a robot to perform.

Enlarge / Google fine-tuned a VLM model on robotics and web data. The resulting model takes in robot camera images and predicts actions for a robot to perform.

Google

Since RT-2 uses a language model to process information, Google chose to represent actions as tokens, which are traditionally fragments of a word. “To control a robot, it must be trained to output actions,” Google writes. “We address this challenge by representing actions as tokens in the model’s output—similar to language tokens—and describe actions as strings that can be processed by standard natural language tokenizers.”

In developing RT-2, researchers used the same method of breaking down robot actions into smaller parts as they did with the first version of the robot, RT-1. They found out that by turning these actions into a series of symbols or codes (a “string” representation), they could teach the robot new skills using the same learning models they use for processing web data.

The model also utilizes chain-of-thought reasoning, enabling it to perform multi-stage reasoning like choosing an alternative tool (a rock as an improvised hammer) or picking the best drink for a tired person (an energy drink).

According to Google, chain-of-thought reasoning enables a robot control model that perform complex actions when instructed.

Enlarge / According to Google, chain-of-thought reasoning enables a robot control model that perform complex actions when instructed.

Google

Google says that in over 6,000 trials, RT-2 was found to perform as well as its predecessor, RT-1, on tasks that it was trained for, referred to as “seen” tasks. However, when tested with new, “unseen” scenarios, RT-2 almost doubled its performance to 62 percent compared to RT-1’s 32 percent.

Although RT-2 shows a great ability to adapt what it has learned to new situations, Google recognizes that it’s not perfect. In the “Limitations” section of the RT-2 technical paper, the researchers admit that while including web data in the training material “boosts generalization over semantic and visual concepts,” it does not magically give the robot new abilities to perform physical motions that it hasn’t already learned from its predecessor’s robot training data. In other words, it can’t perform actions it hasn’t physically practiced before, but it gets better at using the actions it already knows in new ways.

While Google DeepMind’s ultimate goal is to create general-purpose robots, the company knows that there is still plenty of research work ahead before it gets there. But technology like RT-2 seems like a strong step in that direction.

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : Ars Technica – https://arstechnica.com/?p=1957408

Tags: Google’sModeltechnology
Previous Post

Reddit calls for “a few new mods” after axing, polarizing some of its best

Next Post

Apple will require app devs to explain exactly why they use certain APIs

Simons Collaborations in Ecology and Evolution – Simons Foundation

Innovative Breakthroughs in Ecology and Evolution Through Collaborative Research

September 19, 2025
Michigan Science Center’s vertical wind tunnel demonstration – CBS News

Experience the Thrill of Michigan Science Center’s Vertical Wind Tunnel Demonstration!

September 19, 2025
Roane State and TCAT Knoxville celebrate ‘Countdown to Grand Opening’ for Knox Regional Health Science Education Center – WVLT

Roane State and TCAT Knoxville Kick Off Exciting Countdown to Grand Opening of Knox Regional Health Science Education Center

September 19, 2025
Huawei Unveils New AI Chip Tech to Challenge Nvidia’s Lead – Bloomberg.com

Huawei Unveils New AI Chip Tech to Challenge Nvidia’s Lead – Bloomberg.com

September 19, 2025
Klutch Sports Group Signs Maria Taylor – Variety

Klutch Sports Group Scores Big with Star Broadcaster Maria Taylor Joining the Team

September 18, 2025
Historic chills fit in nicely at Old World Wisconsin’s Halloween special program – Milwaukee Journal Sentinel

Historic chills fit in nicely at Old World Wisconsin’s Halloween special program – Milwaukee Journal Sentinel

September 18, 2025
The Economy Is Turning Into a Black Box – The Atlantic

The Economy Is Turning Into a Black Box – The Atlantic

September 18, 2025
Massive Attack Say They’ll Remove Music From Spotify – yahoo.com

Massive Attack Announces Plans to Pull Their Music from Spotify

September 18, 2025
Ex-UC Health doctor who performed genital ultrasounds in his apartment sentenced to jail – Cincinnati Enquirer

Former UC Health Doctor Sentenced to Jail for Performing Genital Ultrasounds in His Apartment

September 18, 2025
Readers respond: Politics should avoid zero-sum game – OregonLive.com

Readers Respond: Why Politics Must Move Beyond the Zero-Sum Game

September 18, 2025

Categories

Archives

September 2025
MTWTFSS
1234567
891011121314
15161718192021
22232425262728
2930 
« Aug    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (826)
  • Economy (845)
  • Entertainment (21,724)
  • General (17,113)
  • Health (9,890)
  • Lifestyle (859)
  • News (22,149)
  • People (850)
  • Politics (855)
  • Science (16,056)
  • Sports (21,345)
  • Technology (15,828)
  • World (829)

Recent News

Simons Collaborations in Ecology and Evolution – Simons Foundation

Innovative Breakthroughs in Ecology and Evolution Through Collaborative Research

September 19, 2025
Michigan Science Center’s vertical wind tunnel demonstration – CBS News

Experience the Thrill of Michigan Science Center’s Vertical Wind Tunnel Demonstration!

September 19, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version