Gemini 2.5 Computer Use
Introducing the Gemini 2.5 Computer Use model, a specialized agent model built on top of Gemini 2.5 Pro’s visual reasoning capabilities, designed to interact directly with user interfaces (UIs). It is exposed via a new computer-use tool in the Gemini API, with inputs that include the user’s request, a screenshot of the UI environment, and a history of recent actions. The model generates function calls corresponding to UI actions like clicking, typing, or selecting, and may request user confirmation for higher-risk tasks. After each action is executed, a new screenshot and URL are fed back into the model to continue the loop until the task completes or is halted. It is optimized primarily for web browser control and shows promise for mobile UI interaction, though it is not yet suited for desktop OS-level control. In benchmarks across web and mobile control tasks, Gemini 2.5 Computer Use outperforms leading alternatives, delivering high accuracy at lower latency.
Learn more
Claude Computer Use
Claude Computer Use is a feature that allows Claude to interact directly with your computer to complete tasks. It enables the AI to click, type, open applications, and navigate files just like a human user. The system prioritizes using built-in connectors, but can fall back to browser navigation or full screen interaction when needed. It can perform tasks such as compiling reports, filling spreadsheets, and testing applications. Users must grant permission before Claude accesses any application, ensuring control over what it can do. The feature includes safeguards to reduce risky actions and protect sensitive data. Overall, Claude Computer Use extends AI capabilities beyond chat into real-world task execution on your device.
Learn more
OpenAI Agents SDK
The OpenAI Agents SDK enables you to build agentic AI apps in a lightweight, easy-to-use package with very few abstractions. It's a production-ready upgrade of our previous experimentation for agents, Swarm. The Agents SDK has a very small set of primitives, agents, which are LLMs equipped with instructions and tools; handoffs, which allow agents to delegate to other agents for specific tasks; and guardrails, which enable the inputs to agents to be validated. In combination with Python, these primitives are powerful enough to express complex relationships between tools and agents, and allow you to build real-world applications without a steep learning curve. In addition, the SDK comes with built-in tracing that lets you visualize and debug your agentic flows, evaluate them, and even fine-tune models for your application.
Learn more
GPT-5.4 Pro
GPT-5.4 Pro is an advanced AI model developed by OpenAI to deliver high-performance capabilities for professional and complex tasks. It combines improvements in reasoning, coding, and agent-based workflows into a single unified system. The model is designed to work efficiently across professional tools such as spreadsheets, presentations, documents, and development environments. GPT-5.4 Pro also includes native computer-use capabilities, enabling AI agents to interact with software, websites, and operating systems to complete tasks. With support for up to one million tokens of context, it can manage long workflows and large datasets more effectively than previous models. The model also improves tool usage, allowing it to search for and select the right tools during multi-step processes. By delivering more accurate outputs with fewer tokens, GPT-5.4 Pro helps professionals complete complex work faster and more efficiently.
Learn more