MAI-Gym turns GUI-agent training into a scalable RL benchmark
MAI-Gym gives researchers one platform to evaluate GUI agents and train them with online reinforcement learning across mobile, computer, and web environments, scaling to 20,000 parallel instances. Its shared pipeline includes resettable mocked apps and execution-validated task verifiers, so agents can train on interactive tasks and be tested consistently. A 9B model reached 78.4% on MobileWorld and 76.2% on OSWorld-Verified; training on a mocked ticketing app raised real-phone success from 28.8% to 48.1%.