AI-powered digital assistants are now (almost) ten a penny, and the rate at which they are gaining new capabilities is nausea-inducing. Google Gemini has long been able to make use of screen grabs as a prompt or part of a prompt, but now things are moving up a notch.
Some Gemini users are starting to notice a new “Share screen with Live” option on their devices. This goes far beyond the ability to analyze and use static screenshots, enabling Gemini to track what is on-screen in real time — including user activity and what is picked up by the camera.
See also:
- Google admits accidentally deleting Timeline data of Google Maps users due to a ‘technical issue’
- Hate Copilot? Microsoft just released a Windows update that erroneously deletes the AI assistant
- Google announces new healthcare tools and features, including advice from people with the same symptoms as you
The launch of the “Share screen with Live” button is yet to be officially announced, but having been spotted by users on Reddit it appears that Google is opting for a soft launch, or simply test driving the latest additions with a select few.
New capabilities mean that users can — or will be able to — share the activity of a single app with Gemini, or opt to let the AI tool use their device’s camera to give it eyes on the world in real time. On Reddit, user Kien_PS shared a video of the updated Gemini in action:
A short demo of Project Astra (Share screen with Live)
byu/Kien_PS inBard
The feature seems to be part of what has been known as Project Astra and it opens up a new world of possibilities for Google Gemini, as well as a barrel-load of new concerns for anyone with privacy worries about AI.
Image credit: Dimarik16 / Dreamstime.com
