COMPUTER USE.
Compare
Search COMPUTER USE

Search the evidence-backed index by name, vendor, or use case.

QUICK EXPLOREComputer-use models Browser infrastructure Benchmark Atlas
K to openESCto close
COMPUTER USE / BENCHMARK

OSWorld V2: methodology & results

Understand OSWorld V2 osworld-v2.1 (2026-09-16): Task success rate (%), evaluation environment and comparability limits.

Release
osworld-v2.1 (2026-09-16)
Environment
desktop
Owner
XLang / OSWorld research team
Metric
Task success rate (%)
Original methodology ↗

What this evaluation measures

Versioned long-horizon desktop evaluation. The repository recommends the 2.1 release and matching code, task assets, websites and environment images.

No score is imported until its exact release and harness can be matched. Do not substitute main/latest for a versioned benchmark release.

OSWorld V2 evaluates desktop tasks. Its reported metric is task success rate (%). Read the release-specific task definitions before treating this as a proxy for your own workflows.

Results belong to the exact system and evaluation setup named in the source. A vendor’s current API is not automatically the system used in a historical run. Hosted browser reachability, task completion and full desktop interaction are different measurements.

Attributed results

Numeric results are withheld: a version-matched result has not passed our evidence checks. This methodology guide remains useful for understanding scope and reproducibility.

Can these results be compared?

No unified ranking is published. These records do not establish a controlled comparison across current tools.

  • Match benchmark code, tasks, assets and environment versions.
  • Check whether resets, retries, task exclusions and human interventions are counted.
  • Compare the same metric: task success is different from reachability or cost per attempt.
  • Re-run representative tasks using your own constraints before a purchase or deployment decision.

How to read computer-use benchmark evidence

Separate task success from your operating cost

Return to the Index

RESEARCH NOTES

Sources & verification

Reviewed Sep 27, 2026. Architecture recommendations are editorial analysis; linked vendor documentation supports the underlying capability and safety facts.

  1. github.com/xlang-ai/OSWorld-V2
How we verify evidence →