# ZonUI-3B
ZonUI-3B — A lightweight GUI grounding model optimized for high-resolution screens, trained with just 24K examples on a single RTX 4090.

![Training Flow](assets/sota_perf_and_rader_compare_20251113.png)
<!-- ![Training Flow](assets/training_flow_solid.jpg) -->

- [😊 Model Weights](https://huggingface.co/zonghanHZH/ZonUI-3B)
- [📑 Paper](https://arxiv.org/abs/2506.23491)
- [🤗 Training Data](https://huggingface.co/zonghanHZH)


## 🔥 Updates
- [x] 2025/11/11: ZonUI-3B has been accepted to **WACV 2026** 🎉.
- [x] 2025/7/3: Inference, evaluation and reproduce code released.
- [x] 2025/7/2: Training datasets (24K examples) released: [UGround-V1-8k](https://huggingface.co/datasets/zonghanHZH/UGround-V1-8k), [AMEX-8k](https://huggingface.co/datasets/zonghanHZH/AMEX-8k), and [ShowUI-web-8k](https://huggingface.co/datasets/zonghanHZH/ShowUI-web-8k).
- [x] 2025/6/30: We release the [arXiv paper](https://arxiv.org/abs/2506.23491).
- [x] 2025/6/25: [`ZonUI-3B`](https://huggingface.co/zonghanHZH/ZonUI-3B) model weights are available on Hugging Face.


## 🖥️ Hardware
- GPU: 1 × RTX 4090 24GB
- Time: <= 48 hrs

## 🎉 Main Results

### ScreenSpot

| Grounding Model          | Avg Score  | Mobile-Text | Mobile-Icon | Desktop-Text | Desktop-Icon | Web-Text | Web-Icon |
|--------------------------|--------|-------------|-------------|---------------|----------------|-----------|-----------|
| **General Models**       |        |             |             |               |                |           |           |
| Qwen2.5-VL-3B            | 55.5   | -           | -           | -             | -              | -         | -         |
| InternVL3-8B             | 79.5   | -           | -           | -             | -              | -         | -         |
| Claude3.5 Sonnet         | 83.0   | -           | -           | -             | -              | -         | -         |
| Gemini-2 Flash           | 84.0   | -           | -           | -             | -              | -         | -         |
| Qwen2.5-VL-7B            | 84.7   | -           | -           | -             | -              | -         | -         |
| **GUI-specific Models**  |        |             |             |               |                |           |           |
| CogAgent-18B             | 47.4   | 67.0        | 24.0        | 74.2          | 20.0           | 70.4      | 28.6      |
| SeeClick-9.6B            | 53.4   | 78.0        | 52.0        | 72.2          | 30.0           | 55.7      | 32.5      |
| OmniParser               | 73.0   | 93.9        | 57.0        | 91.3          | 63.6           | 81.3      | 51.0      |
| UGround-7B               | 73.3   | 82.8        | 60.3        | 82.5          | 63.6           | 80.4      | 70.4      |
| ShowUI-2B                | 75.0   | 91.6        | 69.0        | 81.8          | 59.0           | 83.0      | 65.5      |
| UI-TARS-2B               | 82.3   | 93.0        | 75.5        | 90.7          | 68.6           | 84.3      | 74.8      |
| OS-Atlas-7B              | 82.5   | 93.0        | 72.9        | 91.8          | 62.9           | 90.9      | 74.3      |
| Aguvis-7B                | 84.4   | 95.6        | 77.7        | 93.8          | 67.1           | 88.3      | 75.2      |
| **ZonUI-3B**          | **84.9** | **96.3**    | **81.6**    | **93.8**      | **74.2**       | 89.5      | 74.2      |


### ScreenSpot-v2

| Grounding Model          | Avg Score  | Mobile-Text | Mobile-Icon | Desktop-Text | Desktop-Icon | Web-Text | Web-Icon |
|--------------------------|--------|-------------|-------------|---------------|----------------|-----------|-----------|
| **General Models**       |        |             |             |               |                |           |           |
| InternVL3-8B             | 81.4   | -           | -           | -             | -              | -         | -         |
| **GUI-specific Models**  |        |             |             |               |                |           |           |
| SeeClick-9.6B            | 55.1   | 78.4        | 50.7        | 70.1          | 29.3           | 55.2      | 32.5      |
| UGround-7B               | 76.3   | 84.5        | 61.6        | 85.1          | 61.4           | 84.6      | 71.9      |
| ShowUI-2B                | 77.3   | 92.1        | 75.4        | 78.9          | 59.3           | 84.2      | 61.1      |
| OS-Atlas-7B              | 84.1   | 95.1        | 75.8        | 90.7          | 63.5           | 90.6      | 77.3      |
| UI-TARS-2B               | 84.7   | 95.2        | 79.1        | 90.7          | 68.6           | 87.2      | 78.3      |
| **ZonUI-3B**        | **86.4** | **97.9**    | **84.8**    | **93.8**      | **75.0**       | **91.0**  | 75.8      |

## 🫶 Acknowledgement
We would like to acknowledge [ShowUI](https://github.com/showlab/ShowUI) for making their code and data publicly available, which was instrumental to our development.

## ✍️ BibTeX
If our work contributes to your research, we would appreciate it if you could cite our paper.

```
@misc{hsieh2025zonui3b,
  title        = {ZonUI-3B: A Lightweight Vision-Language Model for Cross-Resolution GUI Grounding},
  author       = {Hsieh, ZongHan and Wei, Tzer-Jen and Yang, ShengJing},
  year         = {2025},
  howpublished = {\url{https://arxiv.org/abs/2506.23491}},
  note         = {arXiv:2506.23491 [cs.CV], version 2, last revised 1 Jul 2025}
}
```