Overview
| Name | RNA-Puzzles · aliases: RNA-Puzzles, RNA-Puzzles Round V, Stanford RNA 3D Folding |
|---|---|
| Full name | RNA-Puzzles: community blind assessment of RNA 3D structure prediction |
| Ambiguous names (not auto-linked) | Ribonanza, bpRNA, ArchiveII |
| Family | Not a family entry. RNA-Puzzles rounds are editions of one blind test; the Kaggle and CASP RNA tracks are related evaluations recorded in scale and notes, not family members. |
| Domain | Structure & co-folding |
| Inclusion | Original 30 |
| Type | A B · Periodic blind test plus static secondary-structure sets |
| Evidence level | L2–L4 · 3D blind test L4; static 2D sets L2 |
| Publisher | RNA-Puzzles consortium (academic groups), Stanford University (Kaggle RNA 3D Folding) (Academic lab) |
| First release | Basis: RNA-Puzzles founding paper (RNA 2012, PubMed epub 2012-02-23); puzzles began around 2010-11 source |
| Other milestones | |
| Latest update | † unverified · new round Basis: Official-site item "PZ74-PZ79 update: DNA residue names", date derived from its URL only Official-site PZ74-PZ79 DNA residue-name update, date URL-derived and unverified; last formal round is Round V (paper online 2024-12-02). Note: Date not reproduced on re-check; the last round, Round V, went online 2024-12-02 source The most recent sourced event, not a claim that nothing changed since. |
| Next expected | No Round VI announced as of 2026-11-16. |
| Status | ◐ Low-frequency · Round V published 2025; CASP RNA and Kaggle rounds continue |
| Scale | Round V: 23 puzzles, 18 groups; CASP16: 42 targets; Kaggle: 20 private targets.
|
| Wet-lab refresh | Fresh experiments each round · Round-based, 12-42 targets per round from pre-publication experimental structures; new truth only by entering the next round. |
| Own wet lab needed to evaluate a new model | No, run it as a download |
| Models reported | 3 counted (modified protocol 2, retrospective 1, cited only 1) |
| Unverified fields | † latest_update, release_milestones.challenge_open, models_reported[1], models_reported[2], models_reported[3] |
| As of | 2026-11-16 |
What it measures
- Task: RNA 3D structure prediction from sequence, with related static sets for secondary structure and chemical reactivity.
- Truth: X-ray, cryo-EM or NMR structures unpublished before assessment.
- Primary metric: RMSD, INF and DI (RNA-Puzzles)
- Secondary metrics: TM-score (US-align, C1'); GDT_TS, lDDT (CASP and Kaggle)
- Version traps: RNA-Puzzles, CASP RNA and Kaggle differ in targets, metrics and rules; human groups may use literature and constraints, unlike servers.
Current ranking
Board
| Metric | Mean TM-align (US-align, C1') |
|---|---|
| Eval set | Kaggle Stanford RNA 3D Folding Part 1 private board: 20 targets incl. 10 RNA-Puzzles |
| Snapshot | |
| Board | https://www.kaggle.com/competitions/stanford-rna-3d-folding |
| Retrieved | 2026-11-16 |
Caveat. Numbers from Table 2 of the competition preprint, reproducing the Kaggle Part 1 private board; Part 2 standings unknown; RNA-Puzzles itself has no standing board.
Shown in the overview table: Board
| Rank | Model | Score (verbatim) | Metric · eval set / protocol | Source type · date | Source and note |
|---|---|---|---|---|---|
| 1 | Kaggle private-board rank 1 team | 0.578 (all, n=20); 0.491 (RNA-Puzzles, n=10) | Mean TM-align (US-align, C1') Kaggle Stanford RNA 3D Folding Part 1 private board: 20 targets incl. 10 RNA-Puzzles | Board | source Not a site model; overall first; a template-discovery pipeline without deep learning. |
| 2 | Kaggle private-board rank 2 team | 0.562 (all, n=20); 0.418 (RNA-Puzzles, n=10) | Mean TM-align (US-align, C1') Kaggle Stanford RNA 3D Folding Part 1 private board: 20 targets incl. 10 RNA-Puzzles | Board | source Not a site model. |
| — | AlphaFold 3 | 0.464 (all, n=20); 0.396 (RNA-Puzzles, n=10) | Mean TM-align (US-align, C1') Kaggle Stanford RNA 3D Folding Part 1 private board: 20 targets incl. 10 RNA-Puzzles | Third-party | source Reference comparison row in Table 2, not a ranked competition entry. |
| — | trRosettaRNA server | 0.438 (all, n=20); 0.340 (RNA-Puzzles, n=10) | Mean TM-align (US-align, C1') Kaggle Stanford RNA 3D Folding Part 1 private board: 20 targets incl. 10 RNA-Puzzles | Third-party | source Reference comparison row in Table 2, not a ranked competition entry. |
| — | RNAPro | 0.648 (all, n=20); 0.541 (RNA-Puzzles, n=10) | Mean TM-align (US-align, C1') Kaggle Stanford RNA 3D Folding Part 1 private board: 20 targets incl. 10 RNA-Puzzles | Self-reported | source Post-competition retrospective model, not a board entry; needs prospective validation. |
| — | NeuralPLexer3 | mean RNA lDDT 46.5 (AF3 47.3, AIchemy_RNA2 54.8) | Mean RNA lDDT CASP15 RNA, 8-target subset used in the AlphaFold 3 paper | Self-reported | source CASP15 RNA 8-target subset with a different protocol and metric; not comparable with the Kaggle TM-align column. |
Models reported
Grouped by relation type; each line shows its source type. Counted relations add up to 3. A pairing whose evidence rests only on this survey's own page is shown as unverified.
Developer report, modified protocol (2)
- NeuralPLexer3 Self-reported · CASP15 RNA 8-target subset; AF3 baseline copied from its paper, not rerun · evidence: link
- RNAPro Self-reported RNA-Puzzles subset within a competition private leaderboard · 10-target RNA-Puzzles subset inside Kaggle private leaderboard †partly verified · evidence: link
Retrospective dataset use (1)
- RhoFold+/DRfold2/trRosettaRNA Third-party single-chain RNA-Puzzles targets, retrospective (RhoFold+) · RhoFold+ retrospective on 24 RNA-Puzzles; DRfold2/trRosettaRNA2 unconfirmed; family cell †partly verified · evidence: link
Cited as comparison only (1, not counted)
- AlphaFold 3 Third-party CASP15 RNA, quoted in another paper · CASP15 RNA value from its own paper, quoted by NeuralPLexer3; not RNA-Puzzles proper †partly verified · evidence: link
Caveats
- Accuracy depends on available templates rather than model type; the 2025 Kaggle winner was a non-deep-learning template pipeline; secondary-structure sets leak same-family sequences.
- Very few targets (at most 23 per round, 20 on the Kaggle private board), with no confidence intervals.
- The CASP16 assessment reports no significant progress once templates are controlled, almost no success on template-free targets; RNA-protein complexes still fail.
- TM-score uses C1' atoms only and ignores non-canonical interactions.
- The latest-update date is URL-derived and unverified; Kaggle Part 2 results were not retrieved.
How to use it
Run released targets statically with the RNA_assessment scripts and US-align; true blind tests require the next CASP or Kaggle round. Stratify by template availability, add a nearest-PDB-template baseline, state target set and models per target; do not claim 2D generalization from random splits.
Pairs well with: CASP · RNAGym · FoldBench
Sources
- RNA-Puzzles founding paper (RNA 2012) (journal)
- RNA-Puzzles Round V (Nat Methods 2025) (journal)
- RNA-Puzzles official site (official site)
- Kaggle Stanford RNA 3D Folding competition paper (preprint) (preprint)
- Kaggle RNA 3D Folding Part 1 (leaderboard)
- Kaggle RNA 3D Folding Part 2 (leaderboard)
- CASP15 RNA assessment (third-party paper)
- CASP16 nucleic-acid assessment (third-party paper)
- RNA_assessment scripts (repository)
Corrections
2 corrections
| Field | Was | Now | Basis | Found |
|---|---|---|---|---|
| latest_update_desc | Kaggle Stanford RNA 3D Folding Part 2 final submission deadline; RNA-Puzzles proper last round V paper (online 2024-12-02). No Round VI announced. | Site item 'PZ74-PZ79 update: DNA residue names' dated 2026-04-02 from its URL only; the official site did not return this date or a dated news entry on re-check, so the date must display as unverified. Last RNA-Puzzles round proper: Round V paper online 2024-12-02. The 2026-03-25 Kaggle deadline belongs to the Kaggle component, not RNA-Puzzles. | source | 2026-11-16 |
| latest_update | 2026-03-25 | 2026-04-02 | source | 2026-11-16 |
Part of the AI for Bio benchmarks survey · all 44 benchmarks · open in the explorer. Record as of 2026-11-16.