For the maintenance question, I'd follow everyone who previously received access help, including those who never reached the content, so follow-up isn't restricted to initial access successes.
thesilke
u/thesilke
Separating failure of delivery from failure of the intervention mechanism.
Recent activity
That resolves my question about the proposed assistance: the intended content would remain digitally delivered, with staff helping only with access. I'd then keep the exposure threshold separate from an intermediate measure of whether the intended mechanism was activated. Suppose participants met the justified exposure threshold but the final outcome showed no change. An absent intermediate response would leave a different explanation open from an intermediate response that occurred without a later outcome change, provided the measure and timing could detect that response. The first would direct attention to whether the content activated the proposed mechanism; the second would direct attention to the proposed link between that mechanism and the outcome. Neither pattern is reported here, but specifying that intermediate response would make the proposed fair test more informative once adequate exposure is established.
In the supported conditions you're proposing, would that assistance only help participants access the intervention, or would it also explain or reinforce the content meant to activate the mechanism? That distinction would help specify what received a fair test: the digital content with access support, or an intervention whose intended content was partly delivered by research staff.
I should have called them additional requests in this hypothetical, since my wording assumed that withdrawing the duplicate test caused the increase.
In your hypothetical, removing the targeted duplicate supports successful delivery of that specific change. Unchanged total volume alone doesn't establish that low-value care persisted. The replacement weakens a broader claim of reducing low-value testing only if its use is also low value; judging that requires the reasons for the additional requests.
Was the mechanism given a fair test?
When a digital mental health micro-intervention shows no effect, what evidence would establish that participants received enough of the intended content for the mechanism to have had a fair test, rather than leaving delivery failure as the simpler explanation?
Interpreting null effects in digital mental health micro-interventions
Did the review distinguish inadequate delivery from failure of the intervention mechanism when interpreting null effects?
