Gemini would ‘improve’ Google Assistant for speakers, displays
Google Assistant isn't what it used to be, and Gemini is something entirely different. Can these two coincide to fix the current state of the smart home? Google Home is gaining integration from Gemini to help with Assistant. Google Assistant is something many of us have grown to rely on over the years. From setting reminders and timers to controlling media and smart home devices, the digital butler has become a valuable part of many people's lives. If you've noticed a drop off in general reliability in the last couple of years, you aren't alone. We noticed this as other products, including Google Gemini (formerly Bard), began getting more of Google's focus. But coincidence or not, it certainly appears related. However, Google seems to be attempting to resolve these issues as Gemini seems to be making its way into the Google Home world.
Back in August with the Google TV Streamer and new Nest Learning Thermostat, Google revealed that Assistant is being upgraded with Gemini. Here we’ve decompiled the latest version of an application which Google uploaded to the Play Store. When we decompile these files (called APKs, in the case of Android apps), we’re able to see various lines of code within that hint at possible future features. Please remember that Google may or may not ever ship these features, and our interpretation of what they are may be imperfect. We’ll try to enable those that are closer to being finished, however, to show you how they’ll look in case that they do ship. Unfortunately, these updates don't appear to be targeted at getting Google Assistant back to where it was, a reliable digital assistant that seemed to know what you needed before asking.
With the Gemini large language models, Google wants to make Assistant more “natural and helpful.” Questions and follow-ups don’t have to be structured in a precise manner. Generative capabilities allow for more back-and-forth interactions about a wider variety of topics. Gemini is a powerful AI tool that Google is leveraging in different ways. However, most of the current use cases don't directly correlate to how smart home users interact with their smart homes through Google Assistant. Google is also using LLMs to improve core experiences like media playback and setting timers. We already have a test of this with the Google Home Gemini Extension on Android allowing for more natural queries that don’t have to explicitly reference devices. Perhaps the most significant integration, and honestly a really great use for it, is in Nest security cameras. A brief bit on it is that thanks to the multimodal functionality of Gemini, as it can work with text, images and video, Nest cameras will be able to do better and more thoroughly recognize what it sees. This will help generate better previews and more accurate notifications, among other things.
Google Home 3.26.1.3 contains an introduction prompt that users will see once this “improved Assistant” is live for speakers and smart displays:-
<string name=”gia_title_text”>Introducing an improved Assistant</string>
Richer responses: Hear complex topics summarized quickly and clearly
New voices: New, more natural voices make it easier to interact with your speakers and displays [Previous clip below]
Better understanding: Pause, ask multiple questions, change your mind, and you’ll still get the help you need
Gemini knows what your camera sees and can answer questions about it, which could change how home monitoring works. As for how Gemini will impact the other parts of Google Home and smart home devices, the initial integration is a bit thin but helpful. If you've ever tried creating an automation in Google Home, or Routines as Google sometimes calls it, while it isn't overly difficult. Although Google this week started testing Gemini-powered AI Camera Search and descriptions. A broader launcher is expected in 2025. When it comes to building more complex automation, Google introduced a script editor and a "Help me script" built on generative AI. This feature works relatively well, and the AI integration helps those a bit unsure about how to work with scripts. Unfortunately, script editing is too advanced for many, and even seasoned users would appreciate a simpler option. This is where the new Gemini integration will help.
The idea behind the inclusion of Gemini is going to work much like you'd ask Google Assistant to set a reminder, add something to your shopping list, or other helpful phrases. Now, you'll be able to ask for help to create an automation using your voice and regular speech. It's the last bit that is going to really make this new automation assistant feature work. Part of what makes Gemini easier to use is that it allows for normal, common speech. So, instead of being required to remember the exact words needed and the order they have to be in, you'll be able to just speak as you would to a person and it should be understood. The new Google Gemini integration for Google Home allows automation that will be much easier to get what you want.
It's clear that Google has plans to integrate Gemini into as many of its services as possible, and that could be a good thing. Seeing how the AI tool is already improving parts of Google Home and Nest is hopeful. However, with the basic functionality of using Google Assistant to control your smart home and Gemini still not able to directly control those devices, the map to resolution is about as clear as the maps used to explore the world, at least to users out in the wild. Google hasn't directly stated its plan for Gemini and Google Assistant, whether the two will remain separate or eventually merge.
No comments:
Post a Comment