The Pulse
Google Launches Guided Vision for Gemini Live on Android
Google has launched Guided Vision in Gemini Live for Android, giving users spoken descriptions and camera-framing prompts. The feature is designed for blind and low-vision users, but Google warns it is not for navigation or obstacle detecti
AI.info Team · Written with AI ·
Google is presenting Guided Vision as a way for Gemini Live to describe the world through an Android phone’s camera, while warning users not to rely on it for navigation or obstacle detection. The feature launched on October 1 for compatible Android devices, aimed especially at people who are blind or have low vision. Google says it can read labels, locate objects and give spoken instructions to adjust the camera; it also stresses that the AI can make mistakes.
Camera guidance, spoken aloud
Guided Vision works inside a Gemini Live session after the user shares the phone’s camera. People can ask follow-up questions about what the camera sees, from the text on a food package to the layout of an unfamiliar room. If the camera points too high, too close or off to one side, Gemini can ask the user to pan, tilt or step back to give it a clearer view.
Google names practical uses such as reading a dimly lit menu, checking washing-machine settings, finding a dropped earbud and locating black pepper in a crowded spice cabinet. The feature can also describe colors, shapes and patterns, and supports conversation in multiple languages. Google says its testing included feedback from blind and low-vision communities in India, Brazil, Singapore, Indonesia, Japan and other countries.
Aira helped test real-world use
Google says it worked with Aira, a visual interpreting service, to prepare Gemini Live for real-world context. The company describes the effort as involving tens of thousands of hours of visual interpretation and says more than 1,000 members of Aira’s Trusted Tester network tested and refined the model across daily routines. Aira specialists also worked with Google on safety guardrails.
Isha Sheth, senior product manager for Gemini Live, writes: “As with any generative AI technology, Guided Vision is an assistive utility and can make mistakes.” Google says the tool is not a medical device, mobility aid or replacement for a white cane, and is not intended to provide safe-travel guidance.
Availability comes with a safety boundary
Google says Guided Vision is available on Android 9 and newer in regions and languages where Gemini Live is supported, provided the Gemini app and Android system software are updated. Its Android Accessibility Help page cautions that the rollout is gradual, so the feature may not yet appear for every eligible user.
Users can switch on “Use Guided Vision in Live” in the Gemini app’s profile settings, then start Gemini Live and share the camera. Android also offers an accessibility shortcut through a floating button, a two-finger gesture or both volume keys; TalkBack users can open its menu with a three-finger tap and select Guided Vision. Those access options make the feature easier to start, but do not change Google’s stated limit: users should continue to rely on established mobility aids and safe-travel practices in physical environments.