Use software like a human. E2E testing in natural language.
A vision-based GUI Agent for web, mobile, and desktop apps.
Website · English / 简体中文
## See it in action
Midscene combines a vision-driven GUI Agent with a testing kit for writing, verifying, and debugging UI tests across web, mobile, and desktop apps through the same Agent APIs. The Playwright example below shows a web test; configure a model and open your app in an existing Playwright `page` to get started:
```typescript
import { PlaywrightAgent } from '@midscene/web/playwright';
const agent = new PlaywrightAgent(page);
// Let the Agent carry out a flow, then verify the result.
await agent.aiAct('Search for headphones, then filter the results to under $100');
await agent.aiWaitFor('The filtered search results are displayed');
await agent.aiAssert('Every product in the search results has a price below $100');
```
Open the generated HTML report to inspect screenshots, actions, and assertion results. Follow the [Playwright guide](https://midscenejs.com/integrate-with-playwright) for model setup, a complete example, and test runner integration.
## 👁️ GUI Agent
Midscene models both UI actions and assertions on how people use software: **look at the screen, act on what you see, and check the visible result**. Describe the task and expected outcome in natural language; Midscene uses screenshots to decide where to interact and whether the interface meets your expectations.
### Visual understanding and cross-platform actions
Like a person finding a control on screen, Midscene locates elements by their appearance and position, then clicks, types, or scrolls to carry out your instructions. You can target icon-only buttons, custom controls, `