About this episode

This episode discusses WeaveBench, a benchmark for evaluating computer-use agents in hybrid interface environments.

🤗 Upvotes: 60 | cs.AI Authors: Wanli Li, Bowen Zhou, Yunyao Yu, Zhou Xu, Yifan Yang, Dongsheng Li, Caihua Shan Title: WeaveBench: A Long-Horizon, Real-World Benchmark for Computer-Use Agents with Hybrid Interfaces Arxiv: http://arxiv.org/abs/2606.09426v2 Abstract: Computer-use agents (CUAs) increasingly operate in runtimes that combine visual desktop control, command-line execution, code editing, browsers, and external tools. Existing benchmarks, however, often evaluate these interfaces as separable capabilities, leaving long-horizon cross-interface orchestration under-tested. Thus, we introduce WeaveBench, a long-horizon hybrid-interface benchmark with 114 tasks across 8 real-world work domains, grounded in real user requests and publicly verifiable artifacts. Each task requires agents to combine GUI observations/actions with CLI/code operations within a single trajectory. We evaluate these tasks on a real Ubuntu desktop inside deployed CLI-agent runtimes, augmented with a minimal desktop-control plugin. We also propose a companion trajectory-aware judge that inspects deliverables, files, screenshots, logs, and action traces, while detecting shortcut behaviors such as…

People in this episode

Hosts: Jingwen Liang, Gengyu Wang

Topics covered

• computer-use agents
• hybrid interfaces
• benchmarking
• real-world tasks
• AI evaluation

Keywords

• WeaveBench
• computer-use agents
• benchmark
• hybrid interfaces
• AI
• Ubuntu
• task evaluation

Mentioned in this episode

Organizations: Ubuntu

Books & works: WeaveBench

More episodes of Daily Paper Cast

• EvoArena: Tracking Memory Evolution for Robust LLM Agents in Dynamic Environments · June 13, 2026 · 24 min
• MiniMax Sparse Attention · June 13, 2026 · 26 min
• SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoning · June 13, 2026 · 23 min
• InterleaveThinker: Reinforcing Agentic Interleaved Generation · June 13, 2026 · 21 min
• FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agents · June 13, 2026 · 23 min
• Robust-U1: Can MLLMs Self-Recover Corrupted Visual Content for Robust Understanding? · June 13, 2026 · 20 min

Explore listener stats, chart rankings, contacts and more on the Daily Paper Cast podcast page.