Primary vs Secondary Outcomes
A personal essay, not an evidence assessment. Our graded assessments of individual ingredients — written to a published standard, from full texts — are in the evidence section. Nothing here is a statement about what any product does.
A well-designed trial asks many questions.
But they are not all equally important.
One question is usually declared in advance as the central one:
the primary outcome.
Others provide additional information:
secondary outcomes.
That distinction may look technical.
For me, it has become one of the fastest ways to detect when a scientific result is being oversold.
The primary outcome is the promise made before the
result
Modern trial-reporting standards define the primary outcome as the prespecified outcome considered most important and expect it to be explicitly identified.
I like to think of the primary outcome as:
the question the study promised to answer before it knew the answer.
That timing matters.
Imagine ten outcomes
A supplement trial measures:
working memory, reaction time, attention, accuracy, fatigue, mood, anxiety,
sleepiness, processing speed, and subjective focus.
Nine show nothing meaningful.
One is statistically significant.
A marketing department might say:
“The supplement significantly improved cognition.”
Scientifically, the more honest response is:
“One measured outcome differed, while the others did not.”
Now suppose the successful outcome was secondary and the primary outcome failed.
That context becomes even more important.
Secondary does not mean useless
I do not want to create the opposite misunderstanding.
Secondary outcomes can reveal important effects.
They can generate hypotheses.
They can identify safety problems.
They can illuminate mechanisms.
Sometimes they become the basis of the next trial.
But they should not quietly inherit the certainty originally reserved for the primary question.
Multiplicity matters
The more outcomes we inspect, the more opportunities we create for chance findings.
Prespecification helps because it makes it harder to search retrospectively for whichever result looks best.
Trial registries are useful here
I like comparing:
what researchers said they would measure
with:
what eventually became prominent in the paper.
If the primary outcome changed, I want to know why.
Sometimes there is an entirely legitimate reason.
Transparency is what matters.
My simple reading rule
When a headline says:
“Study finds supplement improves X”
I ask:
Was X the primary outcome?
If yes, I continue.
If no, I become more cautious.
Not dismissive.
Cautious.
Because the hierarchy of outcomes tells us something about how much confidence the result deserves.
The most exciting number in a table is not always the result the experiment was designed to find.
Methodological sources
Reporting and appraisal standards referred to in this essay. They are not the evidence behind any product claim.