Computer-Use GUI Agent: Post-Training and Self-Evolving Evaluation
Post-training and evaluation for a computer-use agent that runs multi-step workflows on real web and desktop interfaces. On Qwen2.5-14B-Instruct, an SFT → offline step-RFT → online GiGPO pipeline lifts success on a 200-task expert-solution benchmark from 31.3% to 49.2%, and multi-teacher on-policy distillation (MOPD) then merges GiGPO specialists for macOS, Linux, Windows, and Web into a single cross-platform agent. A trace-based LLM-as-Judge evaluator agrees with human labels 94.3% of the time (83.2% on complex tasks) and drives a self-evolving benchmark.
- GUI Agent
- Qwen2.5
- SFT
- GRPO
- GiGPO
- DAPO
- MOPD
- LLM-as-Judge