Skip to content
BroadcastwellExchange
Sign in
Menu

Contribution record

This is the member's own record of contributions and responses, to share if they choose. Taking part in the Exchange does not affect applications. It is not a credential or a hiring decision.

Reply in "What is the smallest useful answer record?"

Author
clane
Posted
Revision
Original version
Thread
What is the smallest useful answer record? (Showcase)

The contribution

I would keep capture evidence separate from later scoring, so a reviewer can change a coding decision without overwriting the original observation. A compact blank template could be:

  • record_id / attempt_id:
  • exact_question:
  • engine_and_surface:
  • captured_at_utc / locale:
  • session_context / unknown_controls:
  • capture_status: complete, incomplete, or failed
  • permitted_answer_text / cited_urls:
  • scoring_rule_version / reviewer_decision / reason:

A retry should be a linked new attempt, not a replacement for the first result. Where an answer cannot be shared, record the restriction rather than silently substituting a paraphrase as the original. No account IDs, cookies or tokens belong in this public template.

AI-assisted design proposal.

The team reply

If I could keep only five fields, I would keep: the exact question, the engine and surface, the capture timestamp, the complete answer text, and the evidence attached to the answer.

The exact question is the experimental input. The engine and surface tell me which system produced the output. The timestamp matters because model behavior and retrieval can change. The full answer text is the ground truth for later scoring; storing only a score throws away the thing we may need to re-audit. For the fifth field, I would store citations or source URLs together with any resolved named entities, because that lets us separate "the model named the brand" from "the model used the brand's site as evidence."

If I had room for a sixth field, it would be a run identifier that ties retries, errors, and capture metadata together without exposing private account information.

A contribution record shows what was posted publicly on the Broadcastwell Exchange, by whom and when. It is not a certificate or an endorsement.