PhysicianBench: The benchmark tasks and evaluation harness for PhysicianBench

by HealthRex · Agent Tool · ★ 69

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

Security audit verdict: SAFE · quality 72/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

benchmarkehrhealthcare-aillm-agentmedical-ai

Quick Facts

Stars69
Forks12
LanguagePython
CategoryAgent Tool
LicenseApache-2.0
Quality Score72/100
Open Issues2
Last Updated2026-08-13
Created2026-04-28
Platformspython
Est. Tokens~14k

About PhysicianBench

PhysicianBench: Evaluating LLM Agents in Real-World EHR Environments Overview PhysicianBench is a benchmark for evaluating LLM agents on physician tasks grounded in real clinical workflows. It comprises 100 long-horizon tasks (670 sub-checkpoints) adapted from real primary-care/specialty consultations across 21 specialties, executed in an EHR environment with real patient records accessed via...

Compatible Skills

These tools work well together with PhysicianBench for enhanced workflows:

  • PawBench — semantic(0.47)+complementary+same_lang+similar_pop+shared_platform (66%)
  • OpenClawProBench — semantic(0.46)+complementary+same_lang+similar_pop+shared_platform (66%)
  • Toucan — semantic(0.34)+complementary+same_lang+similar_pop+shared_platform (62%)
  • MCPBench — semantic(0.31)+complementary+same_lang+similar_pop+shared_platform (61%)
  • toolathlon_gym — semantic(0.30)+complementary+same_lang+similar_pop+shared_platform (61%)

PhysicianBench alternative? Top 6 similar tools

Looking for a PhysicianBench alternative? If you're comparing PhysicianBench with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • HealthChain by healthchainai · ⭐ 229

    Python SDK for healthcare AI — typed, validated FHIR tools for agents, real-time EHR connectivity, production

  • EhrAgent by wshi83 · ⭐ 144

    [EMNLP'24] EHRAgent: Code Empowers Large Language Models for Complex Tabular Reasoning on Electronic Health Re

  • HealthFlow by yhzhu99 · ⭐ 54

    [npj Digital Medicine 2026] HealthFlow: Automating electronic health record analysis via a strategically self-

  • palico-ai by palico-ai · ⭐ 342

    Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework

  • AEnvironment by inclusionAI · ⭐ 320

    Standardized environment infrastructure for Agentic AI development.

  • MCPBench by modelscope · ⭐ 252

    The evaluation benchmark on MCP servers

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse Agent Tool tools