browser-use-vision: Vision-grounding plugin for browser-use agents with SoM, Florence-2, Vision–DOM alignment, adaptive visual

by Raidriar7170 · Agent Tool · ★ 57

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install browser-use-vision

git clone https://github.com/Raidriar7170/browser-use-vision.git

Taken from the project's README on GitHub. Check the security audit before running it.

Security audit verdict: SAFE · quality 64/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

ai-agentbrowser-agentbrowser-useflorence-2multimodal-agentplaywrightsomvisual-groundingweb-automation

Quick Facts

Stars57
Forks3
LanguagePython
CategoryAgent Tool
LicenseMIT
Quality Score64/100
Open Issues1
Last Updated2026-06-26
Created2026-05-20
Platformsbrowser, python
Est. Tokens~15k

About browser-use-vision

中文 | English 🔍 Browser-Use 视觉增强 为热门开源 browser-use 浏览器 Agent 框架提供视觉 Grounding 增强插件——让 Agent 不仅能读 DOM,还能"看见"页面。 ⚡ 一句话总结 在 DOM 完全无法解析的纯图标 UI 上,加入视觉管线后 gpt-4o 浏览器 Agent 从 ,整体客观成功率从 (+25%)。 ——所有数字来自客观校验(DOM 状态 / URL / 实时 API),绝非 Agent 自我评分。 左:纯图标音乐播放器——每个控件都是无文本/aria-label 的 ,DOM 无法解析。 右:Set-of-Mark 为 VLM 提供每个可点击元素的编号句柄。 同一套 SoM + Florence 管线,唯一变量是驱动 LLM。弱 VLM (gpt-4o-mini) 几乎无法利用 grounded...

browser-use-vision alternative? Top 6 similar tools

Looking for a browser-use-vision alternative? If you're comparing browser-use-vision with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • socai by socai-io · ⭐ 244

    Agent that actually understands social platforms. Fast. Precise. Deep.

  • pie-ai-agent by WiseriaAI · ⭐ 182

    Browser-automation agent for Chrome — natural-language tasks executed through native tool calling, scoped Skil

  • hanzi-browse by hanzili · ⭐ 178

    let any ai agent use the local browser

  • hanzi-in-chrome by hanzili · ⭐ 94

    any llm browsing for you in chrome

  • browser-mcp by Agent360dk · ⭐ 56

    The browser tool that can stop and ask you. A 2FA code, a CAPTCHA, a choice only you can make: it asks on your

  • AgentLimb by hooosberg · ⭐ 54

    Let any AI coding tool — Claude Code, Cursor, Codex — drive your real Chrome. One-prompt setup, muscle memory,

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse Agent Tool tools