Google’s AI assistant, Gemini Live, is gaining a significant upgrade, turning your smartphone into an all-seeing device. The tech giant has quietly started rolling out features that allow Gemini to analyze what’s in front of your camera lens or screen, making it a powerful tool for real-time visual assistance.
This latest feature rollout, tied to Google’s much-anticipated Project Astra, was initially uncovered by a Reddit user who shared a video demonstrating its capabilities. Gemini can now “look” through your smartphone’s screen and camera, processing what it sees in real time. Unlike the previous version, which could only analyze static screenshots, the update allows Gemini to continuously observe whatever is on your phone.
This new feature can be activated by the “Share screen with Live” button, which enables Gemini to keep its “eyes” on your activities for a more personalized, dynamic response. It could be useful for tasks like navigating through apps or websites, and offering real-time help based on visual context.
Camera Integration
In addition to screen analysis, Gemini’s vision now extends to your phone’s camera. The AI assistant can analyze objects and colors precisely, adding an extra layer of interaction. Whether the final user experience will align with the impressive demos shown by Google is still unclear, but the potential for using your phone’s camera as an eye for AI assistant tasks is promising.
Availability and Access
The Project Astra feature is currently available to Gemini Advanced subscribers who pay $20 a month for the Google One plan with enhanced AI features. While it seems to be rolling out gradually, a Reddit user demonstrated the feature on a Xiaomi phone, suggesting that this expansion is fairly wide-reaching. However, previous announcements hinted that Pixel and Samsung Galaxy S25 owners would get access sooner or have an enhanced experience with this update.
How Does Gemini Compare?
While other AI assistants, like Microsoft Copilot, ChatGPT, Grok, and Hugging Face’s HuggingSnap, have similar “seeing” tools, most of these features are locked within third-party apps. The integration of such capabilities directly into Android, as part of a built-in assistant, could give Google a significant edge.
The post Google’s Gemini Live Gets the Gift of Sight with Project Astra appeared first on ProPakistani.