Full Breakdown
Google Gemini's New Screen Automation Feature: A Deep Dive
2/5/2026, 11:21:43 AM
Overview of the Feature
Google is enhancing its Gemini AI with a new feature codenamed "bonobo," which will allow the AI to control certain installed applications on Android devices. This capability, spotted in the beta version 17.4 of the Google app, will enable users to instruct Gemini to perform tasks such as booking rides or ordering food without manually navigating through the respective apps. Initially, this feature will be available as an experimental option in Google Labs and is expected to roll out primarily to first-party Google applications before expanding to third-party apps.
How It Works
The screen automation feature is built on Android 16 QPR3, meaning users must have this version installed to utilize its capabilities. Users will be able to command Gemini to execute tasks like ordering from Uber Eats or booking a ride through Uber. However, the feature will initially support a limited number of applications due to the frequent changes in user interfaces across different apps.
Privacy Considerations
Google emphasizes user privacy with this new feature. Users will receive warnings about the potential for errors and are advised to supervise Gemini's actions closely. If users find that Gemini is not performing as intended, they can intervene at any time. Additionally, if the "Keep Activity" option is enabled, screenshots taken by Gemini during interactions will be reviewed by trained reviewers to improve the service. Google also cautions against sharing sensitive information, such as payment details, with Gemini.
User Perspectives
Reactions to the new feature are mixed. Some users express excitement about the potential for reduced manual tasks, while others remain cautious about how much control AI should have over their devices. A poll indicates that opinions vary widely, with some users preferring a more manual approach to smartphone tasks.
Official Statements & Responses
Google has not provided extensive public commentary on the rollout of this feature. However, the company has made it clear that users will retain control over the tasks performed by Gemini and can stop or take over any action at any time. The company also highlights the importance of privacy and user discretion when using AI capabilities.
Criticism & Opposition
Despite the enthusiasm surrounding the feature, there are concerns regarding the implications of AI controlling personal devices. Critics argue that while automation can enhance efficiency, it may also lead to over-reliance on technology, potentially compromising user autonomy and privacy.
What's Next
The feature is expected to be officially announced in beta alongside the release of Android 16 QPR3, anticipated in March. As Google continues to develop Gemini's capabilities, further enhancements and features may emerge, expanding the AI's role in daily smartphone tasks.
Verbatim Quotes
- “You will always remain in full control While you can ask Gemini to carry out tasks on your behalf, you’ll remain in full control and can manually stop or take over at any time.” — Google Representative
- “Now that you'll soon be able to book rides and order food just by instructing Gemini, the manual work we currently do to perform these actions will no longer be needed in the future.” — Tech Analyst
- “I want an AI-free smartphone experience.” — User Feedback
- “When Gemini interacts with an app, screenshots are reviewed by trained reviewers and used to improve Google services if Keep Activity is on.” — Google Privacy Statement
This new feature represents a significant step in the evolution of AI-assisted technology, with implications for user experience and privacy that will continue to be discussed as it rolls out.
