Overview
| Name | scGPT / Geneformer · aliases: scGPT, Geneformer, Geneformer V2 |
|---|---|
| Full name | No separate expanded name |
| Ambiguous names (not auto-linked) | None |
| Family | Two first-generation single-cell foundation models grouped as one baseline entry; teams, corpora and versions are separate
|
| Organization | University of Toronto, University Health Network, Vector Institute, Gladstone Institutes, UCSF |
| Organization type | Academic lab |
| Country | Canada, United States |
| Model class | Single-cell foundation model |
| Domain | Single-cell & perturbation |
| First release | † partly verified · code release Basis: Earliest public artifact: scGPT GitHub v0.1.2 (2023-05-09); preprint date not re-checked source |
| Other milestones | |
| Latest update | · new weights Basis: Geneformer V2 models added to the Hugging Face repository Geneformer V2 weights released; scGPT's last tag is v0.2.4 (2025-03-31); later commits are maintenance source The most recent sourced event, not a claim that nothing changed since. |
| Status | Maintained only · Only maintenance commits after 2025-06 |
| Openness | Code: Open Weights: Open Both open source; Geneformer weights on Hugging Face |
| Benchmarks reported | 2 counted (self 1, retrospective 1, unconfirmed 1) |
| Wet-lab validation | None recorded |
| Unverified fields | † first_release, family.members[1].first_release, benchmarks_reported[1] |
| As of | 2026-11-16 |
What it does
Two first-generation single-cell foundation models: Geneformer rank-encodes genes within each cell, scGPT uses generative pretraining; both are fine-tuned for annotation, perturbation prediction and batch integration. This site uses them mainly as baselines.
Benchmarks reported
Every row is one pairing from the survey's relation file; a score belongs to the benchmark page's ranking, where it is shown with metric, eval set, source type and date. 2 of 3 pairings are counted.
| Benchmark | Relation | Eval set / protocol | Source type | Note and evidence |
|---|---|---|---|---|
| 09 scIB (+Open Problems) | Developer report, official protocol | PBMC 10K | Self-reported | scGPT only (PBMC10K), self-reported; Geneformer not applicable; family entry †partly verified · evidence |
| 24 Virtual Cell Challenge and perturbation benchmarks | Retrospective dataset use | — | Third-party | Independent third-party evaluations on Norman and Adamson data. · evidence |
| 21 DREAM5 / BEELINE / CausalBench | Unconfirmed (not counted) | — | Unconfirmed source | A third-party attention-edge study, read in abstract only. †disputed · evidence |
Other evaluations (outside the 44)
None recorded.
Developers report: Source states no developer claim
Independent evidence: Several independent 2025 studies find they do not reliably beat simple baselines on perturbation and zero-shot tasks
Training data
Group in Figure 7: Public data + wet lab for validation only.
| Class | Value | Detail |
|---|---|---|
| a. Public databases | Yes | Geneformer: ~29.9M human cells (later ~95M); scGPT: ~33M CELLxGENE cells |
| b. Private or licensed data | No | |
| c. Own wet-lab data used for training | No | |
| d. Wet lab used only for validation | Yes | Geneformer had one cell-level validation; scGPT had none |
Wet-lab validation
None. The developers report no wet-lab validation.
Background
- Organization: Both academic: scGPT from Toronto/UHN/Vector Institute, Geneformer from Gladstone Institutes and UCSF
- Funding: Geneformer funding included NIH and American Heart Association grants
- Products and partnerships: Xaira Therapeutics describes scGPT as the starting point of its X-Cell model
- Related models: X-Cell, STATE, Tahoe-x1, TranscriptFormer, C2S-Scale, CellFM
Reading notes
- Appears far more often as a baseline than as a recommended method
- Independent evaluations show perturbation prediction no better than deliberately simple baselines
Caveats
- Family entry: the two models were released separately; read dates per model
- Exact preprint and journal dates not re-checked
Sources
- Hugging Face page ctheodoris/Geneformer (repository)
- GitHub repository repos/bowang-lab (repository)
- Journal article DOI 10.1038/s41586-023-06139-9 (journal)
- Journal article DOI 10.1038/s41592-024-02201-0 (journal)
- scGPT bioRxiv preprint (preprint)
- Nat Methods 2025 independent evaluation (third-party paper)
Corrections
None recorded.
Part of the AI for Bio benchmarks survey · all 112 models · open in the explorer. Record as of 2026-11-16.