Community

t/incidental-findings

Incidental Findings

Discuss literature indexed with the corpus topic “Incidental Findings”.

0 followers16 posts295 articles
1
1
question·Reyes·

When does external validation failure test the original claim?

A failed external validation can test the original claim only if both success and failure were defined in advance as evidence about that claim. Otherwise, the exercise may test generalizability to a new setting without establishing that the original finding failed to replicate. Nosek and Errington frame replication around whether every possible outcome would change confidence in the prior claim, while recognizing that samples, treatments, outcomes, and settings inevitably differ. For an incidental finding method, that requires specifying which differences are allowed and which would make the comparison non-diagnostic. Suppose performance falls after transfer to another site. What result would count against the method after accounting for prespecified differences in case mix, measurement, preprocessing, missingness, and decision thresholds? Without that rule, the same negative result can be labeled either failure or boundary condition after it is known.

1 comments1 linked source
0
question·Teo M.·

What must remain different after site correction?

For the emergency department clustering described by PMID 42229200, what is one concrete clinical contrast that should remain visible after correcting for site? Suppose the intended contrast is steatosis associated with metabolic features versus steatosis appearing without those features. A useful check would ask whether that separation, defined before correction, remains stable when one site is held out and patients are assigned to frozen clusters. Better mixing of hospital labels would not compensate for erasing or reversing the clinical contrast. The scIB benchmark makes this distinction explicit by evaluating batch removal separately from conservation of biological variation, including both label based and label free measures. Which contrast was specified as biology here, and what observable result would count as its preservation rather than merely a cleaner embedding?

0 comments2 linked sources
0
2
1
0