* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Sunday, August 3, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Chicago Youth Symphony Orchestra takes the Lollapalooza stage – Yahoo Home

    Chicago Youth Symphony Orchestra takes the Lollapalooza stage – Yahoo Home

    Sens. Blackburn, Warnock introduce CREATE Act to provide tax relief to music creators – Yahoo Home

    Sens. Blackburn and Warnock Launch CREATE Act to Deliver Tax Relief for Music Creators

    That’s (Political) Entertainment: When Theatre Meets Politics

    Future Script: How Generative AI Is Changing Collective Bargaining in the Entertainment Industry – Jackson Lewis

    Future Script: How Generative AI Is Transforming Collective Bargaining in Entertainment

    The SBA’s live-entertainment bailout was supposed to end two years ago. We still don’t know how $1.5 billion was spent. – Yahoo Home

    $1.5 Billion Live-Entertainment Bailout: Two Years Later, Where Did the Money Go?

    Wall Street Bets: Caesars, Golden Entertainment, Churchill Downs, GLPI, Boyd – CDC Gaming

    Top Wall Street Bets: Caesars, Golden Entertainment, Churchill Downs, GLPI, and Boyd Take Center Stage

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Microsoft Seeks to Extend Access to OpenAI Technology – PYMNTS.com

    Microsoft Aims to Broaden Access to OpenAI Technology

    Livonia police use grappler technology to stop drunk driver – ClickOnDetroit | WDIV Local 4

    Livonia Police Deploy Grappler Technology to Safely Stop Drunk Driver

    Emory orthopaedic surgeons use robotic technology to transform knee replacement surgery – Emory News Center

    How Robotic Technology is Revolutionizing Knee Replacement Surgery

    Cognizant Technology Solutions Corp (CTSH) Q2 2025 Earnings Call Highlights: Strong Revenue … – Yahoo.co

    Cognizant Q2 2025 Earnings: Impressive Revenue Growth and Key Takeaways

    Revving Up The U.S. Technology Engine – Forbes

    Revving Up The U.S. Technology Engine – Forbes

    More than just a hockey player – Rochester Institute of Technology Athletics

    Beyond the Ice: The Inspiring Journey of a Remarkable Athlete from Rochester Institute of Technology

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Chicago Youth Symphony Orchestra takes the Lollapalooza stage – Yahoo Home

    Chicago Youth Symphony Orchestra takes the Lollapalooza stage – Yahoo Home

    Sens. Blackburn, Warnock introduce CREATE Act to provide tax relief to music creators – Yahoo Home

    Sens. Blackburn and Warnock Launch CREATE Act to Deliver Tax Relief for Music Creators

    That’s (Political) Entertainment: When Theatre Meets Politics

    Future Script: How Generative AI Is Changing Collective Bargaining in the Entertainment Industry – Jackson Lewis

    Future Script: How Generative AI Is Transforming Collective Bargaining in Entertainment

    The SBA’s live-entertainment bailout was supposed to end two years ago. We still don’t know how $1.5 billion was spent. – Yahoo Home

    $1.5 Billion Live-Entertainment Bailout: Two Years Later, Where Did the Money Go?

    Wall Street Bets: Caesars, Golden Entertainment, Churchill Downs, GLPI, Boyd – CDC Gaming

    Top Wall Street Bets: Caesars, Golden Entertainment, Churchill Downs, GLPI, and Boyd Take Center Stage

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Microsoft Seeks to Extend Access to OpenAI Technology – PYMNTS.com

    Microsoft Aims to Broaden Access to OpenAI Technology

    Livonia police use grappler technology to stop drunk driver – ClickOnDetroit | WDIV Local 4

    Livonia Police Deploy Grappler Technology to Safely Stop Drunk Driver

    Emory orthopaedic surgeons use robotic technology to transform knee replacement surgery – Emory News Center

    How Robotic Technology is Revolutionizing Knee Replacement Surgery

    Cognizant Technology Solutions Corp (CTSH) Q2 2025 Earnings Call Highlights: Strong Revenue … – Yahoo.co

    Cognizant Q2 2025 Earnings: Impressive Revenue Growth and Key Takeaways

    Revving Up The U.S. Technology Engine – Forbes

    Revving Up The U.S. Technology Engine – Forbes

    More than just a hockey player – Rochester Institute of Technology Athletics

    Beyond the Ice: The Inspiring Journey of a Remarkable Athlete from Rochester Institute of Technology

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Technology

Gemini, AI agents, and fulfilling the vision of Pixel 4’s new Google Assistant

February 10, 2024
in Technology
Gemini, AI agents, and fulfilling the vision of Pixel 4’s new Google Assistant
Share on FacebookShare on Twitter

As of late, there’s been increased chatter about AI agents that take a command and physically perform the task, including the needed taps and swipes, on your phone. This talk of building an AI agent reminds me a great deal of the “new Google Assistant” that was announced with the Pixel 4 in 2019.

At I/O 2019, Google first demoed this next-generation Assistant. The premise was that on-device voice processing would make it so that “tapping to operate your phone would almost seem slow.”

Google demoed simple commands that involve opening and controlling apps, while the more complex idea was “how the Assistant fused into the device could orchestrate tasks across apps.” The example was receiving an incoming text, replying via voice, and then getting the idea to search for and send an accompanying photo. Being able to “Operate” and “Multi-task” was rounded out by a natural language “Compose” capability in Gmail.

This next-generation Assistant will let you instantly operate your phone with your voice, multitask across apps, and complete complex actions, all with nearly zero latency.

The new Assistant launched on the Pixel 4 later that year and has been available on all subsequent Google devices.

“Take a selfie.” Then say “Share this with Ryan.”

In a chat thread, say “Reply, I’m on my way.”

“Search for yoga classes on YouTube.” Then say “Share this with mom.”

“Show me emails from Michelle on Gmail.”

With the Google Photos app open, say “Show me New York pictures.” Then say “The ones at Central Park.”

With a recipe site open on Chrome, say “Search for chocolate brownies with nuts.”

With a travel app open, say “Hotels in Paris.”

This is the fundamental idea behind AI agents. During an Alphabet earnings call last month, Sundar Pichai was asked about generative AI’s impact on Assistant. He said it would allow Google Assistant to “act more like an agent over time” and “go beyond answers and follow through for users.” 

According to The Information this week, OpenAI is working on such a ChatGPT agent:

“Those kinds of requests would trigger the agent to perform the clicks, cursor movements, text typing and other actions humans take as they work with different apps, according to a person with knowledge of the effort.”

Then there is Rabbit with its large action model (LAM) trained to interact with existing mobile and desktop interfaces to complete a set task.

The version Google Assistant had in 2019 felt very pre-programmed, requiring users stick to certain phrasing rather than letting people speak naturally and then automatically discern the action. At the time, Google said Assistant “works seamlessly with many apps” and that it would “continue to improve app integrations over time.” To our knowledge, that never really happened, while some of the capabilities that Google showed off no longer work as the app has changed. A true agent would be able to adapt instead of relying on set conditions.

It’s easy to see how LLMs could improve on this, with Google Research last year showing off work on “Enabling Conversational Interaction with Mobile UI using Large Language Models.”

Google Research demonstrated their approach being able to “quickly understand the purpose of a mobile UI”:

Interestingly, we observed LLMs using their prior knowledge to deduce information not presented in the UI when creating summaries. In the example below, the LLM inferred the subway stations belong to the London Tube system, while the input UI does not contain this information.

It can also answer questions about content that appeared in the UI, and control it after being given a natural language instruction.

A Gemini AI agent for your Android device would be the natural evolution of Google’s first attempt, which never really caught on as an all-encompassing Assistant that provided a new way to use your phone. However, features like transcribing a message response and then being able to say “send” live on in Gboard’s Assistant voice typing.

It does seem that the previous effort was a case of Google being too early to an idea, and not having the required technology. Now that it’s here, Google would be wise to prioritize this effort so that it can start leading the field instead of playing catch up.

FTC: We use income earning auto affiliate links. More.

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : 9to5google.com – https://9to5google.com/2024/02/09/google-ai-agents/

Tags: AgentsGeminitechnology
Previous Post

Google’s sign-in page teases a ‘new look’ coming soon

Next Post

The Gemini name: Good for consistency, but a bit pigeonholed

Microsoft Seeks to Extend Access to OpenAI Technology – PYMNTS.com

Microsoft Aims to Broaden Access to OpenAI Technology

August 3, 2025

Catamount Football ’25 – Fall Practice No. 4 – catamountsports.com

August 3, 2025
Endemism shapes viral ecology and evolution in globally distributed hydrothermal vent ecosystems – Nature

Endemism shapes viral ecology and evolution in globally distributed hydrothermal vent ecosystems – Nature

August 2, 2025
Scientists Finally Reveal the Hidden Trigger Behind Lightning Strikes

Scientists Finally Reveal the Hidden Trigger Behind Lightning Strikes

August 2, 2025
Young minds explore science at NDSU summer research program – InForum

Young Minds Ignite Curiosity at NDSU Summer Science Research Program

August 2, 2025
PlayStation Preparing to Release More Games on Xbox – Report – PlayStation LifeStyle

PlayStation Gears Up to Launch Exciting New Games on Xbox

August 2, 2025
Lexington County hits a home run hosting the Diamond Youth Baseball World Series – WLTX

Lexington County Hits a Home Run Hosting the Diamond Youth Baseball World Series

August 2, 2025
Some rural Texans see THC as a lifeline for their health and economy – The Texas Tribune

How THC Is Revolutionizing Health and Sparking Economic Growth in Rural Texas

August 2, 2025
Fox Corporation Acquires One-Third Interest in Penske Entertainment – INDYCAR.com

Fox Corporation Makes Bold Move with Major Investment in Penske Entertainment, Powering INDYCAR’s Future

August 2, 2025
Minnesotans face health impacts as wildfire smoke lingers – kare11.com

Minnesotans face health impacts as wildfire smoke lingers – kare11.com

August 2, 2025

Categories

Archives

August 2025
MTWTFSS
 123
45678910
11121314151617
18192021222324
25262728293031
« Jul    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (751)
  • Economy (776)
  • Entertainment (21,653)
  • General (16,254)
  • Health (9,813)
  • Lifestyle (784)
  • News (22,149)
  • People (776)
  • Politics (785)
  • Science (15,989)
  • Sports (21,272)
  • Technology (15,754)
  • World (758)

Recent News

Microsoft Seeks to Extend Access to OpenAI Technology – PYMNTS.com

Microsoft Aims to Broaden Access to OpenAI Technology

August 3, 2025

Catamount Football ’25 – Fall Practice No. 4 – catamountsports.com

August 3, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version