← Back to catalog

EHRSHOT Assess

Few-shot evaluation benchmark for EHR foundation models from the Shah Lab at Stanford Medicine. Contains 6,739 de-identified longitudinal patient records from Stanford Health Care (41.7M structured coded events across 921K visits), 15 clinical prediction tasks spanning operational outcomes, lab value anticipation, new diagnosis assignment, and chest X-ray findings. Includes a pretrained 141M-parameter clinical foundation model (CLMBR-T-base) and reproducible evaluation code. Structured EHR only — no clinical notes or images. Dataset access requires a Stanford AIMI data use agreement; code is Apache 2.0. NeurIPS 2023 Datasets and Benchmarks Spotlight.

Judgement: Assess

Assess — 236 stars; permissive licence (Apache-2.0).

Derived deterministically by the MACH scorer from the signals below — not written prose.

Repository

Dormant — last commit ~17 mo ago; no tests/CI/releases detected

★ 236 stars · 29 forks · 4 open issues

Jupyter Notebook 88% Python 10% Shell 1%

Signals & lineage

Every value records the source it was harvested from.

FieldValueSource
descriptionA benchmark for few-shot evaluation of foundation models for electronic health records (EHRs)github_api
discovered_condanot_founddiscovery
discovered_crannot_founddiscovery
discovered_doinot_founddiscovery
discovered_hfStanfordShahLab/clmbr-t-basediscovery
discovered_npmnot_founddiscovery
discovered_pypiehrshot-benchmarkdiscovery
has CIFalsegithub_api
has docsTruegithub_api
has releasesFalsegithub_api
has testsFalsegithub_api
HuggingFace downloads (monthly)not_foundhuggingface
judgementAssessmach_scorer
judgement reasonAssess — 236 stars; permissive licence (Apache-2.0).mach_scorer
licenseApache-2.0github_api
PyPI downloads (monthly)not_foundpypi
archivedFalsegithub_api
repository created2023-06-15T00:42:42Zgithub_api
GitHub forks29github_api
repo healthDormantmach_health
repo health reasonlast commit ~17 mo ago; no tests/CI/releases detectedmach_health
homepagehttps://ehrshot.stanford.edugithub_api
languagesJupyter Notebook:88,Python:10,Shell:1github_api
last commit2025-06-06T11:05:33Zgithub_api
open issues4github_api
primary languageJupyter Notebookgithub_api
repo_size_kb2651github_api
GitHub stars236github_api
topicsokgithub_api

Change history

Recorded deviations — when a harvested value changed between runs.

WhenFieldWasNowSource
2026-11-20T21:53:45.082526repo_health—Dormantmach_health
2026-11-20T21:53:45.082526repo_health_reason—last commit ~17 mo ago; no tests/CI/releases detectedmach_health
2026-11-20T21:53:45.082429judgement—Assessmach_scorer
2026-11-20T21:53:45.082429judgement_reason—Assess — 236 stars; permissive licence (Apache-2.0).mach_scorer
2026-11-20T21:45:37.041471hf_downloads——huggingface
2026-11-20T21:45:36.984634pypi_downloads——pypi
2026-11-20T21:45:36.984580discovered_conda——discovery
2026-11-20T21:45:36.984580discovered_cran——discovery
2026-11-20T21:45:36.984580discovered_doi——discovery
2026-11-20T21:45:36.984580discovered_hf—StanfordShahLab/clmbr-t-basediscovery
2026-11-20T21:45:36.984580discovered_npm——discovery
2026-11-20T21:45:36.984580discovered_pypi—ehrshot-benchmarkdiscovery
2026-11-20T21:45:35.311521has_ci—Falsegithub_api
2026-11-20T21:45:35.311521has_docs—Truegithub_api
2026-11-20T21:45:35.311521has_releases—Falsegithub_api
2026-11-20T21:45:35.311521has_tests—Falsegithub_api
2026-11-20T21:45:35.311521repo_languages—Jupyter Notebook:88,Python:10,Shell:1github_api
2026-11-20T21:45:35.311450description—A benchmark for few-shot evaluation of foundation models for electronic health records (EHRs)github_api
2026-11-20T21:45:35.311450license—Apache-2.0github_api
2026-11-20T21:45:35.311450repo_archived—Falsegithub_api
2026-11-20T21:45:35.311450repo_created—2023-06-15T00:42:42Zgithub_api
2026-11-20T21:45:35.311450repo_forks—29github_api
2026-11-20T21:45:35.311450repo_homepage—https://ehrshot.stanford.edugithub_api
2026-11-20T21:45:35.311450repo_last_commit—2025-06-06T11:05:33Zgithub_api
2026-11-20T21:45:35.311450repo_open_issues—4github_api
2026-11-20T21:45:35.311450repo_primary_language—Jupyter Notebookgithub_api
2026-11-20T21:45:35.311450repo_size_kb—2651github_api
2026-11-20T21:45:35.311450repo_stars—236github_api
2026-11-20T21:45:35.311450repo_topics——github_api