← Back to catalog

eva Assess

Standardised evaluation framework for oncology foundation models, covering both pathology and radiology. Benchmarks patch-level, slide-level, and scan-level classification, 2D/3D semantic segmentation, and visual question answering (VQA) tasks across multiple foundation model encoders. Supports offline (pre-extracted embeddings) and online (end-to-end) evaluation modes, enabling reproducible comparison of FMs such as UNI, CONCH, Virchow, and others on standardised task suites. Fills the evaluation layer in the pathology AI stack that sits alongside TRIDENT (feature extraction) and the foundation models themselves. Apache-2.0, 156 stars, v0.4.5 (April 2026). Published at MIDL 2024. Developed by kaiko.ai.

Judgement: Assess

Assess — committed within 3 months; permissive licence (Apache-2.0).

Derived deterministically by the MACH scorer from the signals below — not written prose.

Repository

Active — last commit ~3 mo ago; has tests, CI, releases

★ 176 stars · 42 forks · 33 open issues

Python 100%

Signals & lineage

Every value records the source it was harvested from.

FieldValueSource
descriptionEvaluation framework for oncology foundation models (FMs)github_api
discovered_condanot_founddiscovery
discovered_crannot_founddiscovery
discovered_doinot_founddiscovery
discovered_hfnot_founddiscovery
discovered_npmnot_founddiscovery
discovered_pypikaiko-evadiscovery
has CITruegithub_api
has docsTruegithub_api
has releasesTruegithub_api
has testsTruegithub_api
HuggingFace downloads (monthly)not_foundhuggingface
judgementAssessmach_scorer
judgement reasonAssess — committed within 3 months; permissive licence (Apache-2.0).mach_scorer
licenseApache-2.0github_api
PyPI downloads (monthly)702pypi
archivedFalsegithub_api
repository created2024-01-16T12:05:03Zgithub_api
GitHub forks42github_api
repo healthActivemach_health
repo health reasonlast commit ~3 mo ago; has tests, CI, releasesmach_health
homepagehttps://kaiko-ai.github.io/eva/github_api
languagesPython:100github_api
last commit2026-09-02T04:34:16Zgithub_api
open issues33github_api
primary languagePythongithub_api
repo_size_kb18077github_api
GitHub stars176github_api
topicsevaluation-framework,foundation-models,machine-learning,oncology,pathology,radiologygithub_api

Change history

Recorded deviations — when a harvested value changed between runs.

WhenFieldWasNowSource
2026-11-20T21:53:45.156584repo_health—Activemach_health
2026-11-20T21:53:45.156584repo_health_reason—last commit ~3 mo ago; has tests, CI, releasesmach_health
2026-11-20T21:53:45.156481judgement—Assessmach_scorer
2026-11-20T21:53:45.156481judgement_reason—Assess — committed within 3 months; permissive licence (Apache-2.0).mach_scorer
2026-11-20T21:48:34.144089hf_downloads——huggingface
2026-11-20T21:48:34.087193pypi_downloads—702pypi
2026-11-20T21:48:34.087140discovered_conda——discovery
2026-11-20T21:48:34.087140discovered_cran——discovery
2026-11-20T21:48:34.087140discovered_doi——discovery
2026-11-20T21:48:34.087140discovered_hf——discovery
2026-11-20T21:48:34.087140discovered_npm——discovery
2026-11-20T21:48:34.087140discovered_pypi—kaiko-evadiscovery
2026-11-20T21:48:32.435600has_ci—Truegithub_api
2026-11-20T21:48:32.435600has_docs—Truegithub_api
2026-11-20T21:48:32.435600has_releases—Truegithub_api
2026-11-20T21:48:32.435600has_tests—Truegithub_api
2026-11-20T21:48:32.435600repo_languages—Python:100github_api
2026-11-20T21:48:32.435530description—Evaluation framework for oncology foundation models (FMs)github_api
2026-11-20T21:48:32.435530license—Apache-2.0github_api
2026-11-20T21:48:32.435530repo_archived—Falsegithub_api
2026-11-20T21:48:32.435530repo_created—2024-01-16T12:05:03Zgithub_api
2026-11-20T21:48:32.435530repo_forks—42github_api
2026-11-20T21:48:32.435530repo_homepage—https://kaiko-ai.github.io/eva/github_api
2026-11-20T21:48:32.435530repo_last_commit—2026-09-02T04:34:16Zgithub_api
2026-11-20T21:48:32.435530repo_open_issues—33github_api
2026-11-20T21:48:32.435530repo_primary_language—Pythongithub_api
2026-11-20T21:48:32.435530repo_size_kb—18077github_api
2026-11-20T21:48:32.435530repo_stars—176github_api
2026-11-20T21:48:32.435530repo_topics—evaluation-framework,foundation-models,machine-learning,oncology,pathology,radiologygithub_api