AI Data · AI4S

AI for Science Data

A nine-layer chain from public databases to validation loops: why free data is not the moat, and ground truth is.

Spark Science ResearchUpdated Oct 15, 20269 min read
9
layers, from public databases to price tables
~75%
of AlphaFold2 training samples were self-distilled
$149
per protein: one of only two public ground-truth price lists
243
entity cards across 9 chapters

Why AI-for-Science data needs its own breakdown

The problem with robot data is that there is no ready-made source: every example has to be produced by someone. Scientific data has the opposite problem. Public databases are free, vast and built up over decades, but they record shapes (structures, sequences, expression profiles), not the outcomes a model actually needs to learn: does this molecule bind or not, what did this perturbation change, is this compound toxic in an animal.

So the AI4S data pyramid is held open by two core layers. One is wet-lab ground truth: the most expensive, the slowest and the closest to reality, but tied to its readout method and its lab. The other is model simulation and synthetic data: cheap and unlimited, but its fidelity drops the further it gets from reality. Upstream sit the databases and the instruments that collect data. Downstream are how models mix their data and how validation results flow back. This column follows that chain through nine chapters. Biology is the main focus, with chemistry and materials covered along the way.

Nine layers, from upstream to downstream

PositionLayerDataHow it is producedTypical scaleRole in the model
Upstream 1Public databases and literaturePDB, UniProt, ChEMBL, CELLxGENE, AlphaFold DBGlobal submissions, institutional curation, government fundingProtein Data Bank (wwPDB) 261,000 entries; UniProt TrEMBL 149 million entries; CZ CELLxGENE Discover / Census about 218 million cellsThe pretraining base for every foundation model; free, so not a moat
Upstream 2Instruments, reagents and capacitySequencers, single-cell platforms, gene synthesis, mass spectrometry, cryo-EMVendors sell instruments and consumablesSequencing about $1/Gb; single-cell sequencing about 0.5 cents per cell; gene-synthesis fragments from 7 cents/bpSets the unit-cost curve and bottlenecks of ground-truth data
Core AWet-lab ground-truth dataBinder binding assays, perturbation atlases, phenotypic imaging, ADME, organoids and animalsLabs, automation and peopleAdaptyv Bio from $149 per protein; Tahoe-100M 100 million cells; JUMP-Cell Painting 1.6 billion cell imagesA tiny share of entries, but the highest weight in fine-tuning and evaluation
Core BModel simulation and synthetic dataMD/DFT trajectories, distilled structures, generated sequences, virtual cellsGPU/CPU computeOMol25: 100 million+ DFT calculations, about 6 billion CPU hours (secondary source); about 75% of AlphaFold2 samples come from self-distillationAn amplifier; fidelity decays step by step along "structure > pose > affinity > cell > efficacy"
Downstream 1Model training recipes27 models, including AF3, Boltz-2, ESM3, Evo 2 and scGPT, plus 1 user case studyPublic databases as the base, self-distillation to amplify, a sliver of ground truth to finishBoltz-2's roughly 1.2 million affinity binders all come from public databasesNone of the open-source or academic models found publicly discloses buying commercial data
Downstream 2Validation loops and self-driving labsCompetitions, frontier-lab slow loops, cloud labs, self-driving labsDesign → synthesise → assay → feed backAnthropic protein-binder experiment: 1,320 designs / 354 binders; about 3 weeks per roundWho owns the returning data decides who owns the flywheel: public, customer-private or platform-exclusive
Cross-cutting ABenchmarks and formatsCASP, PoseBusters, ProteinGym, TDC, Virtual Cell ChallengeProspective blind tests, in-house ground truth, retrospective curation, expert-set questionsAn audit of 51 benchmark configurations found widespread leakageWhoever judges what works defines what data is worth
Cross-cutting BVendor landscape and policyData-product vendors, CROs turning into data businesses, open operators, cloud data marketplacesSubscription, per-record, revenue share, data for equityTempus AI data business about $316 million; only two public precedents for buying training data with cashPolicy is tightening cross-border flows and opening up non-animal data
Cross-cutting CPrices, costs and mixPrice per data point, ground truth vs compute, funding—From 1 cent per cell to $28,000 per lab monkey; the bases vary enormouslyThe numerical base table for the whole column

Price per data point and model data mix

Price per data point: from 1 cent to $28,000 (log scale, USD)

Wet-lab ground truth and compute costs on one log axis. Estimates multiply disclosed GPU/CPU hours by an assumed unit price. Company figures are self-reported, not third-party price lists. RMB converted at 7.1.

1¢ 10¢ $1 $10 $100 $1k $10k Adaptyv binder validation / protein $149 Ginkgo ADME-One / 5-assay panel $199 Western CRO ADME (per Ginkgo) $2,000–$5,000 China CRO ADME (per Ginkgo) $1,000–$2,500 scRNA-seq · Parse / cell $0.01 scRNA-seq · independent benchmark / cell $0.05–$0.21 OMol25 DFT / calc (compute, est.) $1.2–$3 Boltz-2 affinity inference / molecule $0.02 FEP / compound (~4 GPU-h, est.) $16 FEP / molecule (media figure) $100 Cryo-EM cloud compute / structure $50–$1,500 Cryo-EM Krios instrument time / day $1,000–$4,800 Cynomolgus monkey · Mauritius export $6,425 Cynomolgus monkey · China $10,600–$28,200
Assays and sequencingComputeInstrument timeAnimals
Data pointLow ($)High ($)Basis
Adaptyv binder validation (per protein, 2 replicates)149149Company website
Ginkgo ADME-One (per five-assay panel)199199Company figure
Western CRO ADME (as cited by Ginkgo)2,0005,000Spoken by Ginkgo management, not a third-party price list
Chinese CRO ADME (as cited by Ginkgo)1,0002,500Spoken by Ginkgo management, not a third-party price list
Single-cell transcriptomics · Parse (per cell)0.010.01Company figure
Single-cell transcriptomics · independent benchmark (per cell)0.050.21Genentech-led benchmark
OMol25 DFT (per calculation, compute)1.23Estimate: 60 core-hours × $0.02–0.05
Boltz-2 affinity inference (per molecule)0.020.02Estimate: 18 seconds × $4 per GPU hour
FEP (per compound, about 4 GPU hours)1616Estimate: 4 GPU hours × $4
FEP (per molecule, media figure)100100Secondary source
Cryo-EM cloud compute (per structure)501,500Paper
Cryo-EM Krios instrument time (per day)1,0004,800Facility price lists
Cynomolgus monkey · Mauritius average export price (each)6,4256,425Media report
Cynomolgus monkey · China (each)10,60028,200RMB 75,000–200,000+ at 7.1; government procurement cases plus media

Training data composition per model: public · distilled/synthetic · private ground truth (share)

Shares are derived from entry counts or sampling ratios disclosed in each model's paper or model card. Units differ (sequences, cells, sampling weights), so use the chart for structure only; absolute amounts are not comparable across models. The public portion of Tahoe-x1 is unverified, so it is not shown.

AlphaFold 2 AlphaFold 2 · Public databases: 25.0% 25% AlphaFold 2 · Distilled / synthetic: 75.0% 75% 2021 Boltz-2 affinity Boltz-2 affinity · Public databases: 50.0% 50% Boltz-2 affinity · Distilled / synthetic: 50.0% 50% Jun 2025 ESM3 ESM3 · Public databases: 88.0% 88% ESM3 · Distilled / synthetic: 12.0% 12% 2024 scGPT scGPT · Public databases: 100.0% 100% 2023 Geneformer Geneformer · Public databases: 100.0% 100% 2023
Public databasesDistilled / syntheticPrivate ground truth
ModelReleasedPublicDistilled / syntheticPrivate truthBasis
AlphaFold 2202125%75%0%Sampling ratio: clustered PDB 25 / self-distillation (355,993 sequences) 75; as restated in NVIDIA's model card (secondary)
Boltz-2 affinityJun 202550%50%0%Entry counts: ChEMBL + BindingDB optimised set of about 1.2 million binders, plus 1.2 million synthetic decoys; all from public sources
ESM3202488%12%0%Sequence counts: 2.78B natural; 3.15B after synthetic augmentation, the 370 million difference being an estimate; model-card figures
scGPT2023100%0%0%Cell count: >33 million normal human cells from CELLxGENE (secondary)
Geneformer2023100%0%0%Cell count: Genecorpus-30M, about 30 million (later expanded version about 104 million)

Key findings

  1. The base is free; the moat is not in owning data but in owning ground truth. About 75% of AlphaFold2's training samples come from self-distillation and 25% from the Protein Data Bank (wwPDB). Evo 2's OpenGenome2, with 8.84 trillion nucleotides, is open source under Apache 2.0. CZ CELLxGENE Discover / Census offers hundreds of millions of cells for free. Public databases and distilled data have solved "scale"; what remains scarce is paired ground truth with outcome labels.
  2. Ground-truth data now has public prices, but only in a narrow band. Adaptyv Bio at $149 per protein and Ginkgo ADME-One at $199 per panel are the only two public price lists that charge per design or per assay. Perturbation atlases, phenotypic imaging and structure determination are still project-based or donation-based. The comparison point is the RMB 500–1,000 per hour quoted for real-robot teleoperation in the robotics column; biology has no such "hourly rate" yet.
  3. Simulation versus ground truth is not "cheap versus expensive" but a fidelity ladder. A single DFT point costs about $1–3 (estimate), a Boltz-2 affinity inference takes about 18 seconds on a consumer GPU (media figure), and one FEP run costs about $16 (estimate). But Boltz-2's Pearson of 0.62 on the FEP+ benchmark is self-reported by its developers, and foundation models at the cell-perturbation level have not beaten simple baselines. Computation is an enrichment filter, not a substitute for experiments (see the sim-to-real fidelity ladder).
  4. Recipes are more open than in robotics, but the ground-truth part is the most opaque. Across 27 models and 1 user case, the entry counts of public and distilled sets are mostly findable. Private wet-lab data appears in only three forms: "used for evaluation" (Boltz-2 × Recursion), "federated fine-tuning" (OpenFold3 × pharma companies) and "competition data released as open source" (Anthropic × Adaptyv/Twist). Not one has publicly said it bought commercial training data.
  5. The bottleneck in validation loops is latency and ownership, not equipment. One round of a binder loop takes about 3 weeks. Most cloud labs selling "machine time" have not scaled: Strateos moved to on-premises deployment, and about 80% of Emerald Cloud Lab's capacity is tied to a single university. The "platform-exclusive data" story of Lila Sciences and Periodic Labs has not yet produced a peer-reviewed closed-loop result. Whoever owns the returning data owns the flywheel.
  6. Benchmarks leak widely, and "question-setter = grader = service provider" is a structural problem. An audit of 51 benchmark configurations found train–test leakage in most. The ground truth for BenchBB, Proteinbase and the Arc Virtual Cell Challenge all comes from a single lab. A neutral, multi-lab, pre-registered validation benchmark still has no operator, which is the clearest gap outside the pricing chapter.
  7. Capital and policy point the same way: money goes to "model plus in-house wet-lab loop", while policy tightens cross-border data. The largest private rounds of the past 24 months include Chai Discovery's $400 million Series C (a single secondary source, unverified) and about $550 million raised in total by Lila Sciences. Xaira Therapeutics' $1 billion in Apr 2024 falls outside the window and serves only as a baseline. Since Apr 2025 the NIH has barred countries of concern from accessing its controlled-access databases. The BIOSECURE Act became law through the FY2026 NDAA, and human genetic resources leaving China require review. China's role looks more like a "validation factory" than a "data exporter".

Compared with the robot-data column

DimensionRobotics / embodied AIAI for Science (bio)
Most expensive layerReal-robot teleoperation (RMB 500–1,000/hour)Wet-lab ground truth (from $149 per protein; animal studies over $10,000 per animal)
Cheapest layerHuman video (on the order of 100,000 hours already free and open source)Public databases (free, hundreds of millions of entries)
Failure mode of synthetic dataSim-to-real gap, world-model hallucinationFidelity ladder: structures are usable, affinity and cell-level data are not trustworthy
Recipe transparencyLow (only two models give per-source hours and weights)Medium (public and distilled data findable; ground truth opaque)
Precedents for buying with cashYes (Motus2 credits five commercial data vendors)Almost none (only two deals, both clinical real-world data)
Returning dataDeployment rollouts plus human corrections, tied to the embodimentValidation results, tied to the readout method and the lab
PolicyTraining-ground subsidies, dataset standardsCross-border data restrictions, opening of non-animal data

Both fields point to the same thing: the cheap layers are being flattened by open source, and value is migrating to the two ends, producing ground truth and judging validation.

The robotics column is at AI Data: Robotics.

Chapters and entity cards

#ChapterWhat it covers
01Public databases and literatureThe free, vast but biased top of the AI4S data chain: the training base for structure, sequence and single-cell models.
02Instruments, reagents and sequencing/synthesis capacitySequencing, single-cell, gene synthesis, mass spectrometry and automation: the collection equipment and the cost-per-data-point curve.
03Wet-lab ground-truth data productionThe most expensive layer, the closest to truth, the most tied to its readout: who makes it, who pays, who owns the data.
04Model simulation and synthetic dataTraining data produced by computation rather than experiment: physics simulation, distillation and self-labelling, generative synthesis, and their fidelity and cost.
05Model training data recipesWhich public databases, distilled data and private ground truth more than 30 biology and chemistry foundation models used, and in what shares.
06Validation loops and self-driving lab feedbackPrediction, wet-lab validation, and results flowing back as training and reward data: who runs them, how fast, who owns the data.
07Benchmarks, evaluation and data formatsWhere benchmark ground truth comes from, who sets and who grades, evidence from leakage audits, and data-format standards.
08Data vendor landscape and policyWho sells biological data, capital flows over the past 24 months, and how policy is rewriting data supply.
09Prices, costs and mixUnit prices for wet-lab ground truth, simulation compute, equipment and data licences, plus model data-mix ratios and funding proxies.

The column also includes 243 entity cards, browsable by type:

77
companies and institutions
76
datasets
21
tools and formats
36
concepts and methods
33
papers and benchmarks

This section is personal research. Every number is labelled in the original with its source and basis; self-reported company numbers are marked as company figures, and independently unverified ones are flagged. Judgements hold as of the date written and are not investment or R&D advice.

Adapted from the Spark Science research notes (originally published in Chinese at jimmyresearch.com). Last updated Oct 15, 2026.