Skip to content
RichseenAtlas← JourneySign in

What AI Changes

How these connect

CASP — Critical Assessment of Structure Prediction and what it relates to. Every line is an evidence-backed relation, and the arrangement is fixed — this address draws this picture, today and next year.

assesses — CASP14 scored AlphaFold2 blind against experimentally solved structures that had been withheld from publication, with independent assessors and targets the predictor did not choose.contradicts — A blind experiment with withheld targets and independent assessors removes the specific failure modes — contamination, leaderboard optimisation, self-selected test sets — that make most machine-learning evaluation weak.AlphaFoldAlphaFoldCASP — Critical Assessment of Structure PredictionCASP — Critical Assessmen…The difficulty of evaluating machine learning systemsThe difficulty of evaluat…
3 drawn · 11 reachable and not drawn · positions derived from object ids, never from a simulation
Open more2
Every relation drawn, in words2
  1. CASP — Critical Assessment of Structure Prediction · assesses · AlphaFold

    CASP14 scored AlphaFold2 blind against experimentally solved structures that had been withheld from publication, with independent assessors and targets the predictor did not choose.

  2. CASP — Critical Assessment of Structure Prediction · contradicts · The difficulty of evaluating machine learning systems

    A blind experiment with withheld targets and independent assessors removes the specific failure modes — contamination, leaderboard optimisation, self-selected test sets — that make most machine-learning evaluation weak.