Few-shot evaluation benchmark for EHR foundation models from the Shah Lab at Stanford Medicine. Contains 6,739 de-identified longitudinal patient records from Stanford Health Care (41.7M structured coded events across 921K visits), 15 clinical prediction tasks spanning operational outcomes, lab value anticipation, new diagnosis assignment, and chest X-ray findings. Includes a pretrained 141M-parameter clinical foundation model (CLMBR-T-base) and reproducible evaluation code. Structured EHR only — no clinical notes or images. Dataset access requires a Stanford AIMI data use agreement; code is Apache 2.0. NeurIPS 2023 Datasets and Benchmarks Spotlight.
Assess — 236 stars; permissive licence (Apache-2.0).
Derived deterministically by the MACH scorer from the signals below — not written prose.
Dormant — last commit ~17 mo ago; no tests/CI/releases detected
★ 236 stars · 29 forks · 4 open issues
Jupyter Notebook 88% Python 10% Shell 1%
Every value records the source it was harvested from.
| Field | Value | Source |
|---|---|---|
| description | A benchmark for few-shot evaluation of foundation models for electronic health records (EHRs) | github_api |
| discovered_conda | not_found | discovery |
| discovered_cran | not_found | discovery |
| discovered_doi | not_found | discovery |
| discovered_hf | StanfordShahLab/clmbr-t-base | discovery |
| discovered_npm | not_found | discovery |
| discovered_pypi | ehrshot-benchmark | discovery |
| has CI | False | github_api |
| has docs | True | github_api |
| has releases | False | github_api |
| has tests | False | github_api |
| HuggingFace downloads (monthly) | not_found | huggingface |
| judgement | Assess | mach_scorer |
| judgement reason | Assess — 236 stars; permissive licence (Apache-2.0). | mach_scorer |
| license | Apache-2.0 | github_api |
| PyPI downloads (monthly) | not_found | pypi |
| archived | False | github_api |
| repository created | 2023-06-15T00:42:42Z | github_api |
| GitHub forks | 29 | github_api |
| repo health | Dormant | mach_health |
| repo health reason | last commit ~17 mo ago; no tests/CI/releases detected | mach_health |
| homepage | https://ehrshot.stanford.edu | github_api |
| languages | Jupyter Notebook:88,Python:10,Shell:1 | github_api |
| last commit | 2025-06-06T11:05:33Z | github_api |
| open issues | 4 | github_api |
| primary language | Jupyter Notebook | github_api |
| repo_size_kb | 2651 | github_api |
| GitHub stars | 236 | github_api |
| topics | ok | github_api |
Recorded deviations — when a harvested value changed between runs.
| When | Field | Was | Now | Source |
|---|---|---|---|---|
| 2026-11-20T21:53:45.082526 | repo_health | — | Dormant | mach_health |
| 2026-11-20T21:53:45.082526 | repo_health_reason | — | last commit ~17 mo ago; no tests/CI/releases detected | mach_health |
| 2026-11-20T21:53:45.082429 | judgement | — | Assess | mach_scorer |
| 2026-11-20T21:53:45.082429 | judgement_reason | — | Assess — 236 stars; permissive licence (Apache-2.0). | mach_scorer |
| 2026-11-20T21:45:37.041471 | hf_downloads | — | — | huggingface |
| 2026-11-20T21:45:36.984634 | pypi_downloads | — | — | pypi |
| 2026-11-20T21:45:36.984580 | discovered_conda | — | — | discovery |
| 2026-11-20T21:45:36.984580 | discovered_cran | — | — | discovery |
| 2026-11-20T21:45:36.984580 | discovered_doi | — | — | discovery |
| 2026-11-20T21:45:36.984580 | discovered_hf | — | StanfordShahLab/clmbr-t-base | discovery |
| 2026-11-20T21:45:36.984580 | discovered_npm | — | — | discovery |
| 2026-11-20T21:45:36.984580 | discovered_pypi | — | ehrshot-benchmark | discovery |
| 2026-11-20T21:45:35.311521 | has_ci | — | False | github_api |
| 2026-11-20T21:45:35.311521 | has_docs | — | True | github_api |
| 2026-11-20T21:45:35.311521 | has_releases | — | False | github_api |
| 2026-11-20T21:45:35.311521 | has_tests | — | False | github_api |
| 2026-11-20T21:45:35.311521 | repo_languages | — | Jupyter Notebook:88,Python:10,Shell:1 | github_api |
| 2026-11-20T21:45:35.311450 | description | — | A benchmark for few-shot evaluation of foundation models for electronic health records (EHRs) | github_api |
| 2026-11-20T21:45:35.311450 | license | — | Apache-2.0 | github_api |
| 2026-11-20T21:45:35.311450 | repo_archived | — | False | github_api |
| 2026-11-20T21:45:35.311450 | repo_created | — | 2023-06-15T00:42:42Z | github_api |
| 2026-11-20T21:45:35.311450 | repo_forks | — | 29 | github_api |
| 2026-11-20T21:45:35.311450 | repo_homepage | — | https://ehrshot.stanford.edu | github_api |
| 2026-11-20T21:45:35.311450 | repo_last_commit | — | 2025-06-06T11:05:33Z | github_api |
| 2026-11-20T21:45:35.311450 | repo_open_issues | — | 4 | github_api |
| 2026-11-20T21:45:35.311450 | repo_primary_language | — | Jupyter Notebook | github_api |
| 2026-11-20T21:45:35.311450 | repo_size_kb | — | 2651 | github_api |
| 2026-11-20T21:45:35.311450 | repo_stars | — | 236 | github_api |
| 2026-11-20T21:45:35.311450 | repo_topics | — | — | github_api |