← Daily Brief for August 20, 2026
ComponentBench proves that the harness can change computer-agent performance by over 30 points
Focus: Earlier edition
Date: August 18, 2026
Topics: Computer-use agents, harness engineering, evaluation, user interfaces, tool design
Evidence: Unspecified
Availability: Unspecified
Summary: ComponentBench introduces 2,910 programmatically verified tasks covering 97 common web-interface components, with cleaned human reference trajectories. Seven models were tested across four observation and action configurations. Within the same harness, changing only the observation/action representation shifted success by more than 30 percentage points for the same model: GPT-5 mini scored 83.1% with accessibility-tree observations and 48.9% with coordinate-only pixel control. Even the fastest configuration took 3.7 times as long as the matched human reference.
Why it matters: A computer-use agent’s result is not simply a property of the model. What the harness lets the agent observe—and how it lets the agent act—can dominate performance. This is direct empirical support for evaluating complete systems rather than comparing models in isolation.
Source: arXiv