Magentic-UI

Magentic-UI

Microsoft Research (AI Frontiers) · Coding · Productivity

Magentic-UI is Microsoft's open-source research prototype for a web agent you steer in real time. It browses, runs code and handles files while you plan, approve and take over.

Interface preview of Magentic-UI

About Magentic-UI

What Is Magentic-UI

Magentic-UI is an experimental web agent from Microsoft Research. It opens a browser, works through multi-step tasks like form filling, data collection and dashboard navigation, and keeps you watching every move. Instead of hiding behind a black box, it shows its plan, its next click and the page it just read.

The project grew out of Magentic-One, Microsoft's multi-agent team, and runs on AutoGen, the company's agent framework. You get a small team of specialists that split the work: an orchestrator that plans, a WebSurfer that drives the browser, a coder that writes and runs Python or shell, and a file handler. It ships under the MIT license, so you can read the code, fork it and study how the agents coordinate.

The catch is what kind of product this is. Magentic-UI is a research prototype, not a finished workplace tool. There's no signup page and no vendor to call when a task fails. You install it yourself, point it at a model endpoint you pay for, and accept that some tasks fail. Microsoft positions it for people who want to study or build on human-agent interaction, and the docs are upfront about the tasks it handles poorly.

Getting Started

  1. Install Python 3.12 and a virtual environment, then install the package from PyPI
  2. Start the server on a local port and open it in your browser
  3. Connect a model endpoint during onboarding, using Azure AI Foundry, OpenAI or a local model you host yourself
  4. Create a task session, review the plan the agent proposes, edit it if needed and approve execution
  5. Watch each step, step in when you want, and save the plan to reuse it on similar tasks

Product Information

A quick look at Magentic-UI's pricing, supported platforms, and performance.

Free PlanYes
Paid Plans$0 (open source, MIT license); you pay your model provider separately
PlatformWeb (self-hosted app), macOS, Windows via WSL2, Linux, Docker
DeveloperMicrosoft Research (AI Frontiers)
CategoryCoding · Productivity
Release DateMay 2025
Latest UpdatedOct 2025
Website Visits1.1B
Website Global Rank32
API AvailabilityYes

Best for

The users, tasks, and scenarios where this tool fits best.

Users

  • AI researchers
  • Developers building web agents
  • Automation hobbyists
  • Product teams exploring computer-use agents

Tasks

  • Research across sites
  • Browser form filling
  • Price and availability checks
  • Local file organization
  • Code-assisted analysis

Scenarios

  • A task needs a judgment call halfway through
  • You want to watch before you trust
  • A research workflow repeats weekly
  • Testing an agent for a team

Key features

Co-Planning with a Plan Editor

Before it touches anything, Magentic-UI writes a step-by-step plan for the task and hands it to you. You can edit the steps in the plan editor, add or drop them, or send feedback in plain text to steer the approach. Execution only starts once you approve, which means you can correct a bad strategy before it burns time. A saved plan can also be pulled up on the next task so you're not starting from a blank slate.

Co-Tasking and Live Takeover

During a run, the agent narrates what it's about to do and what it just saw, like which button it's about to click or what it read on the page. At any point you can pause the task, type a correction or grab the browser and do the step yourself, then hand control back. This is the difference from a set-it-and-forget-it automation tool: you stay in the loop because you can see and steer each action as it happens.

Action Guards on Sensitive Steps

The agent action guards stop the run for your approval before it takes actions that are hard to undo, such as submitting a payment or sending an email. You decide how often those checkpoints fire, from every risky action down to a lighter setting for trusted tasks. Nothing irreversible runs without your say-so, which is the core safety idea behind the whole project.

Sandboxed Browser and Code Execution

The browser session and the code the agent writes run inside a Docker sandbox, kept apart from the rest of your machine. That separation matters because the agent can reach live websites, and a separate environment limits what it can touch on your system if something goes wrong. You can also restrict which sites it's allowed to visit, so it stays inside the boundaries you set.

Multi-Agent Architecture on AutoGen

Magentic-UI splits the work across specialized agents rather than asking one model to do everything. An orchestrator plans and delegates, a WebSurfer controls the browser, a coder writes and runs scripts, and a file agent handles documents and folders. Because it's built on AutoGen and speaks Model Context Protocol, you can add your own tools and agents to the team. The project is also integrated with Azure AI Foundry models and agents.

Plan Learning and Reuse

The agent learns from runs that went well. It can save a finished plan into a gallery and retrieve it later, either automatically for a similar task or manually from the list. Over repeated work, like a weekly data pull or a standard form, this cuts the setup time and nudges the agent toward a workflow you already approved. Reuse is the payoff for steering it through the first pass.

Parallel Task Execution

You can run several task sessions at once, and a session indicator tells you which one needs your attention and which has finished. Because the agent relies on your input at checkpoints, running tasks in parallel keeps you busy with approvals instead of waiting on a single agent to move. It turns the human-in-the-loop model into something closer to supervising a small team.

Pros and cons

Pros

  • Free and open source under the MIT license, so you can read and modify every part of it
  • Transparent by design: the plan, each action and the timeline are visible, so you always know what the agent is doing
  • Human checkpoints on risky actions let you keep control without babysitting every click
  • Sandboxed browser and code execution limit what a misstep can reach on your machine
  • Plan saving and reuse turn one good run into a repeatable workflow

Cons

  • It's a research prototype, so expect rough edges and tasks it simply can't finish
  • Setup assumes technical comfort: you install it yourself and connect a model endpoint you pay for
  • There's no commercial support or SLA, so problems get solved through docs and GitHub issues
  • Model quality drives the result, so a weak or cheap endpoint makes the agent noticeably less capable

Frequently asked questions

Magentic-UI is an open-source research prototype from Microsoft for a human-centered web agent. It browses the web, writes and runs code, and works with files, while showing its plan and actions so you can review, pause or take over. It's meant for studying and building human-in-the-loop agent systems, not as a finished work product.