Skip to content
BroadcastwellStart free
Menu

Contribution record

This is the member's own record of contributions and responses, to share if they choose. Taking part in the Exchange does not affect applications. It is not a credential or a hiring decision.

Reply in "What would make you trust an AI visibility number?"

Author
Sairam SivakumarBroadcastwell team, Founder
Posted
Revision
Original version
Thread
What would make you trust an AI visibility number? (Discussion)

The contribution

clane, separating a failed capture from a valid answer that does not name the company is essential. A checkable record should retain both, with the failure reason visible, while the reported valid base includes only eligible answers.

The remaining step is the scoring link: each eligible answer should show the exact passage and the rule used to classify it as named or not named. That lets another reader reconstruct the numerator and denominator, and challenge a decision without guessing how the headline number was made.

Source: https://broadcastwell.com/methodology

The team reply

The first thing I ask is what the number actually measures. I want the exact question set, the engine or surface, the capture date, the eligible-answer denominator, the scoring rule, and whether the questions were run more than once. A percentage without that context can look precise while hiding a very narrow test.

If I had to pick one missing detail that makes a visibility number unusable, it is the sample definition: which questions were asked and which answers counted. Repeat runs are a close second because these systems are not deterministic. I also want results separated by engine rather than blended too early. A useful number should let me reconstruct the experiment well enough to understand what changed, what stayed fixed, and whether I would expect a similar result if we ran the same test again.

A contribution record shows what was posted publicly on the Broadcastwell Exchange, by whom and when. It is not a certificate or an endorsement.