What changed

Google has announced that its Gemini model can now run Mac applications and finish desktop chores in the background while users keep working. The new 'Computer Use' feature in the Gemini Mac app completes multistep tasks across local files, desktop apps, and websites. Users simply describe a goal, and Gemini clicks, types, and navigates menus and forms. Everything runs in an isolated background window with a live chat preview, keeping the screen and cursor free for uninterrupted work.

What this means in practice

Users can choose which apps Gemini can access, watch every step live, pause anytime, and approve key actions beforehand. Google's examples include batch-editing photos and 3D scenes, filling out shipping forms from local PDFs, and building presentations. The feature is available in English in the US and the Gemini Mac app is available to download. The new functionality is part of Google's ongoing efforts to enhance the capabilities of its AI models.

Limitations and availability

The 'Computer Use' feature rolls out in English in the US today. The Gemini Mac app is available for download. The feature is limited to the specified tasks and requires users to approve key actions beforehand. The supplied announcement does not specify the exact hardware requirements or licensing conditions for the feature. OpenAI has also focused on Computer Use recently, pulling well ahead with its Astra model.

Source facts for Google's Gemini Now Handles Mac Tasks in the Background: Google says users simply describe a goal, and Gemini clicks, types, and navigates menus and forms. Everything runs in an isolated background window with a live chat preview, keeping the screen and cursor free for uninterrupted work. Users choose which apps Gemini can access, watch every step live, pause anytime, and approve key actions beforehand.
Original AINewsTrend explainer based on the cited source. This graphic summarizes source statements; it is not an independent benchmark.

Sources and further reading

  1. thedecoder: Google's Gemini can now run Mac apps and finish desktop chores in the background while you keep working