Source reliability is a measurement, not a label

Ask a room of analysts which sources they trust and you will hear names, not reasons. Reputation travels faster than evidence, and a label such as “reliable” or “state-aligned” gets applied once and then reused for years. Labels are convenient. They are also the reason a good source gets dismissed on a bad day and a poor one gets waved through on a good one.

What a label hides

A single outlet produces many kinds of material: wire copy, original reporting, opinion, translated statements and syndicated pieces. Its record on each differs. Treating the outlet as one thing averages those differences away. The reader learns the outlet’s brand but not how likely this particular claim is to survive checking.

What can be measured

Reliability can be approached as a track record. Over a defined period, how often did claims from this source hold up when independent reporting or primary documents arrived? How often were claims later corrected, and how quickly? How often did the source break a story that others then confirmed? These are countable, and the counts can be shown.

• Corroboration rate: the share of claims later supported by an independent origin.
• Correction behaviour: how often and how visibly the source amends its own reporting.
• Primary-document use: how often claims point to a document a reader can open.
• Ownership and funding: who stands behind the outlet, stated plainly and dated.

Why the number must stay provisional

A measured reliability score is an estimate from a finite sample. A source with ten checked claims and a source with a thousand should not share a level of certainty even if both score 80. Showing the sample size beside the score is part of the measurement, not a footnote to it. So is the date of the last update, because a record from two years ago says little about a newsroom that has since changed ownership.

A score without its sample size and its date is a label wearing a number.

Using it without leaning on it

Source reliability is one input to confidence in a claim, not a substitute for the claim’s own evidence. A strong source can be wrong and a weak one can be right. The sound use of the measure is as a starting weight that the evidence for the specific claim can raise or lower, and that the reader can see and adjust.

That is how the source ledger in 7Analytica is built: each source carries its record, its sample and its last review date, and every score that depends on it links back to that entry.