Multimodal medical agent benchmark that simulates end-to-end clinical workflows. Presents AI agents with patient-facing dialogue, EHR records, lab results, and medical images, requiring differential diagnosis and treatment planning across multiple specialties. Evaluates both physician-agent and patient-agent roles. Published in npj Digital Medicine 2026.
Adopt — committed within 3 months; 381 stars; permissive licence (MIT).
Derived deterministically by the MACH scorer from the signals below — not written prose.
Active — last commit ~2 mo ago; no tests/CI/releases detected
★ 381 stars · 61 forks · 9 open issues
Python 100%
Every value records the source it was harvested from.
| Field | Value | Source |
|---|---|---|
| description | Agent benchmark for medical diagnosis | github_api |
| discovered_conda | not_found | discovery |
| discovered_cran | not_found | discovery |
| discovered_doi | not_found | discovery |
| discovered_hf | not_found | discovery |
| discovered_npm | not_found | discovery |
| discovered_pypi | not_found | discovery |
| has CI | False | github_api |
| has docs | True | github_api |
| has releases | False | github_api |
| has tests | False | github_api |
| HuggingFace downloads (monthly) | not_found | huggingface |
| judgement | Adopt | mach_scorer |
| judgement reason | Adopt — committed within 3 months; 381 stars; permissive licence (MIT). | mach_scorer |
| license | MIT | github_api |
| PyPI downloads (monthly) | 94 | pypi |
| archived | False | github_api |
| repository created | 2024-05-10T23:11:12Z | github_api |
| GitHub forks | 61 | github_api |
| repo health | Active | mach_health |
| repo health reason | last commit ~2 mo ago; no tests/CI/releases detected | mach_health |
| homepage | ok | github_api |
| languages | Python:100 | github_api |
| last commit | 2026-10-03T22:37:54Z | github_api |
| open issues | 9 | github_api |
| primary language | Python | github_api |
| repo_size_kb | 8033 | github_api |
| GitHub stars | 381 | github_api |
| topics | ok | github_api |
Recorded deviations — when a harvested value changed between runs.
| When | Field | Was | Now | Source |
|---|---|---|---|---|
| 2026-11-20T21:53:44.190479 | repo_health | — | Active | mach_health |
| 2026-11-20T21:53:44.190479 | repo_health_reason | — | last commit ~2 mo ago; no tests/CI/releases detected | mach_health |
| 2026-11-20T21:53:44.190377 | judgement | — | Adopt | mach_scorer |
| 2026-11-20T21:53:44.190377 | judgement_reason | — | Adopt — committed within 3 months; 381 stars; permissive licence (MIT). | mach_scorer |
| 2026-11-20T21:45:29.715340 | hf_downloads | — | — | huggingface |
| 2026-11-20T21:45:29.658758 | pypi_downloads | — | 94 | pypi |
| 2026-11-20T21:45:29.658705 | discovered_conda | — | — | discovery |
| 2026-11-20T21:45:29.658705 | discovered_cran | — | — | discovery |
| 2026-11-20T21:45:29.658705 | discovered_doi | — | — | discovery |
| 2026-11-20T21:45:29.658705 | discovered_hf | — | — | discovery |
| 2026-11-20T21:45:29.658705 | discovered_npm | — | — | discovery |
| 2026-11-20T21:45:29.658705 | discovered_pypi | — | — | discovery |
| 2026-11-20T21:45:28.036275 | has_ci | — | False | github_api |
| 2026-11-20T21:45:28.036275 | has_docs | — | True | github_api |
| 2026-11-20T21:45:28.036275 | has_releases | — | False | github_api |
| 2026-11-20T21:45:28.036275 | has_tests | — | False | github_api |
| 2026-11-20T21:45:28.036275 | repo_languages | — | Python:100 | github_api |
| 2026-11-20T21:45:28.036209 | description | — | Agent benchmark for medical diagnosis | github_api |
| 2026-11-20T21:45:28.036209 | license | — | MIT | github_api |
| 2026-11-20T21:45:28.036209 | repo_archived | — | False | github_api |
| 2026-11-20T21:45:28.036209 | repo_created | — | 2024-05-10T23:11:12Z | github_api |
| 2026-11-20T21:45:28.036209 | repo_forks | — | 61 | github_api |
| 2026-11-20T21:45:28.036209 | repo_homepage | — | — | github_api |
| 2026-11-20T21:45:28.036209 | repo_last_commit | — | 2026-10-03T22:37:54Z | github_api |
| 2026-11-20T21:45:28.036209 | repo_open_issues | — | 9 | github_api |
| 2026-11-20T21:45:28.036209 | repo_primary_language | — | Python | github_api |
| 2026-11-20T21:45:28.036209 | repo_size_kb | — | 8033 | github_api |
| 2026-11-20T21:45:28.036209 | repo_stars | — | 381 | github_api |
| 2026-11-20T21:45:28.036209 | repo_topics | — | — | github_api |