Overview
| Name | CACHE · aliases: CACHE, CACHE challenge, CACHE #1, CACHE #5, CACHE #8 |
|---|---|
| Full name | Critical Assessment of Computational Hit-finding Experiments |
| Ambiguous names (not auto-linked) | DREAM x CACHE, Target 2035 |
| Family | Not a family entry. Successive rounds of one challenge rather than a family entry; per-round volumes are stored in the scale items. |
| Domain | Small molecules (also: Structure & co-folding) |
| Inclusion | Original 30 |
| Type | A · Periodic prospective blind test, one target per round |
| Evidence level | L5 · Prospective wet lab; no independent replication |
| Publisher | Structural Genomics Consortium, Conscience (Nonprofit institute) |
| First release | † partly verified Basis: Organizer page announcing challenge #1 targets and open participation; no same-day archive Note: The 2022-01-31 application deadline is kept as a note only and is never a first release. source |
| Other milestones | |
| Latest update | † partly verified · data Basis: Host organization's press release PDF on the challenge #5 results, uploaded in August 2026 The host organization issued a press release on the challenge #5 results (PDF uploaded August 2026); DREAM x CACHE Target 2035 launched in June 2026. Note: The exact press-release day was not seen; the site note says 2026-08-18. source The most recent sourced event, not a claim that nothing changed since. |
| Next expected | † partly verified · new round Basis: Host press release says challenge #9 is expected late 2026; DREAM x CACHE applications close 2026-11-30 source |
| Status | ● Active · Active: challenge #8 under way, challenge #5 results published 2026-08 |
| Scale | Rounds #1-#8, one target each and up to 100 compounds per team; round #5 totalled 2,031 compounds and round #6 1,344.
|
| Wet-lab refresh | Fresh experiments each round · Yes: about two rounds a year, 1,300-2,000 compounds plus 300-600 analogues measured in laboratories each round. |
| Own wet lab needed to evaluate a new model | No, run it as a download |
| Models reported | 0 counted |
| Unverified fields | † first_release, latest_update, next_expected, ranking.entries[0], ranking.entries[1], ranking.snapshot_date |
| As of | 2026-11-16 |
What it measures
- Task: One target per round: teams submit up to 100 purchasable compounds, the organizers screen and orthogonally confirm them, and a second stage takes analogues.
- Truth: Newly measured binding data from the organizers (SPR and similar) plus functional or orthogonal assays in stage 2.
- Primary metric: Experimentally confirmed hits and hit rate
- Secondary metrics: Confirmed analogues and series in stage 2; Affinity range of the hits
- Version traps: Targets, assays and hit criteria differ by round (round #1 counted KD below 150 uM as a hit), so hit rates are not comparable across rounds.
Current ranking
No ranking
| Metric | Experimentally confirmed hits and hit rate (SPR, dose-response, functional assays); no single score |
|---|---|
| Eval set | CACHE challenges #1-#8, one target per round, up to 100 purchasable compounds per team |
| Snapshot | † partly verified |
| Board | https://cache-challenge.org/ |
| Retrieved | 2026-11-16 |
Caveat. CACHE prospectively evaluates whole team workflows rather than single models and publishes hit counts only; per-round hit rates of 0.7-4% leave samples too small for significance testing.
No headline entry: The organizers publish no ranking and never name the models inside each workflow, so no number can serve as a headline.
| Rank | Model | Score (verbatim) | Metric · eval set / protocol | Source type · date | Source and note |
|---|---|---|---|---|---|
| — | CACHE #5 (MCHR1) round results, workflow level rather than model level | Withheld: The page has no date and the organizers publish no rank, so the honesty rule keeps this out of the ranking row. | Experimentally confirmed hits and hit rate (SPR, dose-response, functional assays); no single score CACHE challenges #1-#8, one target per round, up to 100 purchasable compounds per team | Board No sourced date† | source Not a site model. The official results page gives hit counts by workflow id, discloses no models and publishes no rank. |
| — | Boltz-2 | Withheld: No number and no date, so nothing is shown in the ranking row. | Experimentally confirmed hits and hit rate (SPR, dose-response, functional assays); no single score CACHE challenges #1-#8, one target per round, up to 100 purchasable compounds per team | Third-party No sourced date† | source The Boltz-2 paper reports no CACHE participation and CACHE result pages do not name the models inside each workflow, so its use is not disclosed. |
Models reported
Grouped by relation type; each line shows its source type. Counted relations add up to 0. A pairing whose evidence rests only on this survey's own page is shown as unverified.
None. No model among the 112 has a recorded pairing with this entry.
Mentioned, not a pairing
- · Its paper reports no CACHE result and the official pages do not list the models used by each workflow, so there is no pairing. no source link
Caveats
- It evaluates whole team workflows, not single models, and never discloses which models a workflow used.
- Each round yields only tens of hits at 0.7-4%, and without significance tests ML and physics methods cannot be compared statistically.
- Most hits are weak binders in the tens of micromolar, and binding is not functional activity or developability.
- Biases: compounds come from a single supplier, entry is voluntary, and assay sensitivity limits detection of weak binders.
- Rounds #7 and #8 have no published results yet, and peer-reviewed papers for rounds #4-#6 lag behind.
How to use it
A real blind test means entering the next round; compound-level data from released rounds can serve as a retrospective set but is no longer blind for models with later training cutoffs. Report the round, target, hit criterion and assay, and separate stage 1 from stage 2. A real generalization claim needs prospective measurement, whose cost the organizers carry in that round.
Pairs well with: PoseBusters · PLINDER / PINDER / Runs N' Poses · DUD-E / LIT-PCBA · Polaris / ASAP / OpenADMET
Sources
- CACHE official site (official site)
- Official results page for challenge #5 (official site)
- Host organization press release on the challenge #5 results (press) · †
- Rules page for challenge #7 (official site)
- Challenge #1 results preprint (preprint)
- Paper on a challenge #3 participant workflow (journal)
Corrections
5 corrections
| Field | Was | Now | Basis | Found |
|---|---|---|---|---|
| first_release | 2022-01-31 | 2021-12-01 | source | 2026-11-16 |
| first_release_basis | challenge #1 application deadline (launch date not stated on site) | official announcement of challenge #1 targets and open participation, 2021-12-01 (organiser page). This is the announced arrangement; no same-day archive of the live opening was obtained, so the day stays flagged. Application deadline 2022-01-31 is stored as a note only. | source | 2026-11-16 |
| members | [{"member": "CACHE #1 (deadline)", "date": "2022-01-31"}, {"member": "CACHE #8 (deadline)", "date": "2026-04-30"}] | [{"member": "CACHE #1 announced open (2021-12-01)", "date": "2021-12-01"}, {"member": "CACHE #1 application deadline", "date": "2022-01-31"}, {"member": "CACHE #8 application deadline", "date": "2026-04-30"}] | source | 2026-11-16 |
| scale | round #5: 2,031 compounds; round #6: 1,344 | unchanged, with provenance: round #5's 2,031 is the sum of stage 1 (1,455 compounds, 24 teams) and stage 2 (576); round #6 is 1,344 compounds from 18 participants | source | 2026-11-16 |
| ranking.status | round results shown as a ranking row | no-ranking: hit counts at workflow level, with the undated results page withheld from display | source | 2026-11-16 |
Part of the AI for Bio benchmarks survey · all 44 benchmarks · open in the explorer. Record as of 2026-11-16.