When Google introduced the Gemini Live avatar of its AI, it was nothing short of a revelation. The ability to have freewheeling conversations with an AI, which can also see the world around you through the phone’s camera and make sense of it, is something that still astounds me. Now, it’s getting ready to work seamlessly with the Android apps installed on your phone.
What is changing?
At its Pixel 10 launch event, Google announced that Gemini Live can now work with Calendar, Keep, and Tasks. So, let’s say you are talking with the AI, and want to quickly save a note, you can do so by simply speaking the task. And while at it, you no longer have to open the Keep app.
Recommended Videos
(function(){let containerEl=document.getElementById(‘dt-cnx-container-68aed7b3a89d8’);const deletePlayer=()=>{if(containerEl){containerEl.remove();containerEl=null}};if(!window.DT_RELATED_PLAYER_PROVIDER){deletePlayer();return}
const iasAnId=decodeURIComponent(‘927851’);if(!window.dtCNXReady){const loadIAS=()=>{return new Promise((resolve)=>{const e=document.createElement(‘script’);e.src=’https://static.adsafeprotected.com/vans-adapter-google-ima.js’;e.onload=()=>{resolve()};document.head.appendChild(e)})};const loadCNX=()=>{return new Promise((resolve)=>{!function(n){if(!window.cnx){window.cnx={},window.cnx.cmd=[];var t=n.createElement(‘iframe’);t.src=’javascript:false’;t.style.display=’none’,t.onload=function(){var n=t.contentWindow.document,c=n.createElement(‘script’);c.onload=function(){window.dtCNXIframe=t;resolve()};c.src=’//cd.connatix.com/connatix.player.js?cid=2a2352ef-fe98-483c-8897-aef587823f13′,c.setAttribute(‘async’,’1′),c.setAttribute(‘type’,’text/javascript’),n.body.appendChild(c)};if(document.readyState!==’loading’){n.body.appendChild(t)}else{n.addEventListener(“DOMContentLoaded”,function(){n.body.appendChild(t)})}}}(document)})};window.dtCNXReady=()=>{if(!window.dtCNXReadyPromise){window.dtCNXReadyPromise=new Promise((resolve)=>{Promise.all([iasAnId?loadIAS():Promise.resolve(),]).then(()=>loadCNX()).then(()=>{resolve()})})}
return window.dtCNXReadyPromise}}
const disableFloating=()=>{let playerAPI=window.DTConnatixPlayers&&window.DTConnatixPlayers[‘dt-cnx-player-68aed7b3a89d7’];if(playerAPI){playerAPI.disableFloatingMode()}else{DTEvent.on(‘dt-connatix-player-ready’,()=>{playerAPI=window.DTConnatixPlayers[‘dt-cnx-player-68aed7b3a89d7’];if(playerAPI){playerAPI.disableFloatingMode()}})}};window.dtDampenPlayerCallbacks=window.dtDampenPlayerCallbacks||{};window.dtDampenPlayerCallbacks[‘dt-cnx-player-68aed7b3a89d7’]=deletePlayer;const lazyLoad=()=>{return new Promise((resolve)=>{if(containerEl&&window.IntersectionObserver){const observer=new IntersectionObserver((entries)=>{if(entries[0].isIntersecting){observer.disconnect();if(containerEl){window.dtDampenPlayerCallbacks[‘dt-cnx-player-68aed7b3a89d7′]=disableFloating;resolve()}}},{rootMargin:’300px’});observer.observe(containerEl)}})};Promise.resolve().then(()=>lazyLoad()).then(()=>window.dtCNXReady()).then(()=>{(new Image()).src=’https://capi.connatix.com/tr/si?token=65fece0c-941b-4d77-b455-b6d23b01b35b&cid=2a2352ef-fe98-483c-8897-aef587823f13′;cnx.cmd.push(()=>{cnx({playerId:’65fece0c-941b-4d77-b455-b6d23b01b35b’,mediaId:”,playlistId:”,settings:{playbackMode:cnx.configEnums.PlaybackModeEnum.AutoPlay,},}).render(‘dt-cnx-player-68aed7b3a89d7’,(renderError,playerAPI)=>{if(playerAPI){window.DTConnatixPlayers=window.DTConnatixPlayers||{};window.DTConnatixPlayers[‘dt-cnx-player-68aed7b3a89d7’]=playerAPI;DTEvent.trigger(‘dt-connatix-player-ready’);const videoTitleEl=containerEl.querySelector(‘.h-video-title’);if(videoTitleEl){playerAPI.getAllMetadata().then((metadata)=>{if(metadata&&metadata.length>0){videoTitleEl.innerText=metadata[0].title}})}
if(iasAnId){const videoElement=document.getElementById(‘dt-cnx-player-68aed7b3a89d7’).parentElement.querySelector(‘.cnx-video-container’);playerAPI.on(cnx.configEvents.ImaAdsManager,(adsManager)=>{const adUnit=adsManager.Oa.l.iu;try{const config={anId:iasAnId,campId:playerAPI.getSize().width+’x’+playerAPI.getSize().height,chanId:adUnit,};googleImaVansAdapter.init(window.dtCNXIframe.contentWindow.google,adsManager,videoElement,config)}catch(error){console.error(‘Could not init IAS for Connatix.’,error)}})}}})})})}())
While conversing with Gemini Live, you can directly tell it stuff like “save a note about picking up cabbage from the store,” or “add an entry for a meeting with John at 4pm this Saturday in Calendar.”
Nadeem Sarwar / Digital Trends
The idea is to connect Gemini Live seamlessly with apps, just the way Gemini has already been integrated deeply within Google tools such as Docs, Gmail, Search, and more. With Gemini Live, you don’t have to click or type, or even switch to another app.. All you need to do is utter the command and it will be seamlessly executed in the background.
The best is yet to come
Gemini already works with Google’s own apps as well as third-party software such as WhatsApp using a system of connectors. Google is now focused on bringing that convenience to its mobile apps via Gemini Live for added voice-first convenience.
Nadeem Sarwar / Digital Trends.
Aside from Calendar, Keep, and Tasks, Google is also bringing it to the core communication apps, as well. “We’re adding the Messages, Phone, and Clock apps and bringing additional capabilities into our Google Maps integration, so Gemini Live will be able to help you in even more ways,” the company said in a blog post.
(function(){if(document.currentScript){var e=document.currentScript.parentNode;if(e.classList.contains(‘dtads-location’)){if(!e.classList.contains(‘dtads-‘+window.DTScenario.getExperience())){e.parentNode.removeChild(e)}}}}());Google says it’s updating the underlying models to make sure that Gemini Live conversations sound even more natural. Users will also be able to instruct Gemini Live so that it can speak slowly and match their note-taking speed.
