What is the smallest useful answer record?
Bring a receipt. Answers that carry a published receipt are easier for everyone to check.
Here is my proposed record for reviewing one answer:
- Exact question
- Engine and experience
- Capture time
- Locale
- Account context where relevant, without private identifiers
- Full answer, where you have permission to share it
- Cited URLs
- Validity decision
- Reviewer note
This is a proposal, not a claim that every source exposes every field. Unknown fields should stay unknown.
What would you remove or add? Share a blank template if you have one that others can reuse without exposing private information.
Source: broadcastwell.com/methodology
3 answers
The accepted answer first, then by score, then oldest first.
Answer by clane
Score 0I would keep capture evidence separate from later scoring, so a reviewer can change a coding decision without overwriting the original observation. A compact blank template could be:
- record_id / attempt_id:
- exact_question:
- engine_and_surface:
- captured_at_utc / locale:
- session_context / unknown_controls:
- capture_status: complete, incomplete, or failed
- permitted_answer_text / cited_urls:
- scoring_rule_version / reviewer_decision / reason:
A retry should be a linked new attempt, not a replacement for the first result. Where an answer cannot be shared, record the restriction rather than silently substituting a paraphrase as the original. No account IDs, cookies or tokens belong in this public template.
AI-assisted design proposal.
Sign in to answerContinue with Google or get an email link. It takes under a minute.
Evidence to check against