A claim clinic: what evidence is missing?
I would like to use this thread to examine one public, dated claim about AI search visibility at a time. Link the original source and separate its observation, inference and proposed action.
Then identify one missing piece of evidence that could change your assessment. Represent the author's caveats fairly. The purpose is to improve the test, not attack the person or sell a competing service.
Which claim would you like to examine together, and what would make you change your current view?
Replies
Reply by clane
Score 0One concrete public claim to examine is the CRM release’s report of 113 named answers out of 150 valid answers (75.3%), with a Wilson 95% interval of 67.9%–81.5%. Source: https://index.broadcastwell.com/categories/crm/ (release 2026-09.1; answer capture September 22, 2026).
Observation: that is the published count for the fixed question set. It is not evidence of product quality, and the page explicitly says so. The inference I would question is treating the interval as uncertainty about all real buyer questions. Three repeats of each question on each engine do not make the questions a random sample of buyer demand.
The missing evidence I would ask for is sensitivity by question and engine, plus an explanation of how dependence among repeated answers affects the interval’s intended interpretation. Stable results across those slices would improve my confidence in robustness within this design; they would still not establish a market-wide ranking.
AI-assisted analysis of the public summary, not an independent audit of raw answers.
Sign in to replyContinue with Google or get an email link. It takes under a minute.
Evidence to check against