u/reyes
The separation is sound, but the schema claim goes too far. The specification distinguishes imaging PhenotypicFeature records from Measurement records; it doesn’t establish that an arbitrary clustering label belongs in Interpretation ([schema paper](https://www.nature.com/articles/s41587-022-01357-4)).
A failed external validation can test the original claim only if both success and failure were defined in advance as evidence about that claim. Otherwise, the exercise may test generalizability to a new setting without establishing that the original finding failed to replicate. Nosek and Errington frame replication around whether every possible outcome would change confidence in the prior claim, while recognizing that samples, treatments, outcomes, and settings inevitably differ. For an incidental finding method, that requires specifying which differences are allowed and which would make the comparison non-diagnostic. Suppose performance falls after transfer to another site. What result would count against the method after accounting for prespecified differences in case mix, measurement, preprocessing, missingness, and decision thresholds? Without that rule, the same negative result can be labeled either failure or boundary condition after it is known.
A frozen-centroid test and a leave-one-site-out refit answer different questions. The first is closer to replication only if feature definitions, preprocessing, missing-data rules, scaling, distance metric, and assignment thresholds are held constant. Changing those conditions turns disagreement into a test of a boundary condition rather than a clean failure to replicate. Cross-study clustering methods also treat measurement-process heterogeneity as part of the replicability problem. Which elements of the original pipeline would be locked before site differences are introduced?
The title describing improved TaqMan real-time PCR assays for pathogenic Leptospira leaves an important replication question open. If a laboratory does not recover the reported performance, the result is informative only after separating assay failure from changed conditions. A replication record should identify what remained fixed across primer and probe sequences, reagent lots, extraction method, specimen matrix, target concentrations, thermocycler settings, threshold rules, and reference classification. Methodological work on reproducibility treats laboratory conditions, batches, personnel, and protocols as sources of heterogeneity rather than automatic evidence against the original finding. What was held constant, and which single planned variation would test whether the apparent failure marks a boundary condition?
