PopupAttack: Code repo for the paper: Attacking Vision-Language Computer Agents via Pop-ups

by SALT-NLP · Agent Tool · ★ 53

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

Security audit verdict: SAFE · quality 64/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

attackclaude-3-5-sonnetcomputer-usellm-agentpop-upvision-language-model

Quick Facts

Stars53
Forks3
LanguagePython
CategoryAgent Tool
Quality Score64/100
Open Issues1
Last Updated2024-12-23
Created2024-11-04
Platformsclaude-code, python
Est. Tokens~13278k

About PopupAttack

Attacking Vision-Language Computer Agents via Pop-ups Yanzhe Zhang, Tao Yu, Diyi Yang Overview Autonomous agents powered by large vision and language models (VLM) have demonstrated significant potential in completing daily computer tasks, such as browsing the web to book travel and operating desktop software, which requires agents to understand these interfaces.

PopupAttack alternative? Top 6 similar tools

Looking for a PopupAttack alternative? If you're comparing PopupAttack with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • Auto-Use by auto-use · ⭐ 120

    Auto-Use Computer Use — drives your OS, browser, scours the web, writes your code. One agent, end to end.

  • EdgeBox by BIGPPWONG · ⭐ 212

    A fully-featured, GUI-powered local LLM Agent sandbox with complete MCP protocol support. Features both CLI

  • NEWTON by CUTEPKQ · ⭐ 143

    NEWTON: Agentic Planning for Physically Grounded Video Generation

  • wechat-mac-rpa by wq19901103wq · ⭐ 138

    基于多模态视觉感知与 LLM Agent 的 macOS 微信自动化框架 | Visual RPA for WeChat

  • VideoGLaMM by mbzuai-oryx · ⭐ 105

    [CVPR 2025 🔥]A Large Multimodal Model for Pixel-Level Visual Grounding in Videos

  • OmniAgent by HarryHsing · ⭐ 73

    OmniAgent (ICML 2026): the first native omni-modal agent for active video perception — a 7B agent that beats Q

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse Agent Tool tools