WeaveBench: A Long-Horizon, Real-World Benchmark for Computer-Use Agents with Hybrid Interfaces
From Daily Paper Cast by Jingwen Liang, Gengyu Wang
June 13, 2026 · 21 min · Episode 1960
About this episode
This episode discusses WeaveBench, a benchmark for evaluating computer-use agents in hybrid interface environments.
🤗 Upvotes: 60 | cs.AI Authors: Wanli Li, Bowen Zhou, Yunyao Yu, Zhou Xu, Yifan Yang, Dongsheng Li, Caihua Shan Title: WeaveBench: A Long-Horizon, Real-World Benchmark for Computer-Use Agents with Hybrid Interfaces Arxiv: http://arxiv.org/abs/2606.09426v2 Abstract: Computer-use agents (CUAs) increasingly operate in runtimes that combine visual desktop control, command-line execution, code editing, browsers, and external tools. Existing benchmarks, however, often evaluate these interfaces as separable capabilities, leaving long-horizon cross-interface orchestration under-tested. Thus, we introduce WeaveBench, a long-horizon hybrid-interface benchmark with 114 tasks across 8 real-world work domains, grounded in real user requests and publicly verifiable artifacts. Each task requires agents to combine GUI observations/actions with CLI/code operations within a single trajectory. We evaluate these tasks on a real Ubuntu desktop inside deployed CLI-agent runtimes, augmented with a minimal desktop-control plugin. We also propose a companion trajectory-aware judge that inspects deliverables, files, screenshots, logs, and action traces, while detecting shortcut behaviors such as…
People in this episode
Hosts: Jingwen Liang, Gengyu Wang
Topics covered
- computer-use agents
- hybrid interfaces
- benchmarking
- real-world tasks
- AI evaluation
Keywords
- WeaveBench
- computer-use agents
- benchmark
- hybrid interfaces
- AI
- Ubuntu
- task evaluation
Mentioned in this episode
Organizations: Ubuntu
Books & works: WeaveBench
More episodes of Daily Paper Cast
- EvoArena: Tracking Memory Evolution for Robust LLM Agents in Dynamic Environments · June 13, 2026 · 24 min
- MiniMax Sparse Attention · June 13, 2026 · 26 min
- SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoning · June 13, 2026 · 23 min
- InterleaveThinker: Reinforcing Agentic Interleaved Generation · June 13, 2026 · 21 min
- FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agents · June 13, 2026 · 23 min
- Robust-U1: Can MLLMs Self-Recover Corrupted Visual Content for Robust Understanding? · June 13, 2026 · 20 min
Explore listener stats, chart rankings, contacts and more on the Daily Paper Cast podcast page.