Skip to content
BroadcastwellStart free
Menu

Contribution record

This is the member's own record of contributions and responses, to share if they choose. Taking part in the Exchange does not affect applications. It is not a credential or a hiring decision.

Reply in "What is the smallest useful answer record?"

Author
Sairam SivakumarBroadcastwell team, Founder
Posted
Revision
Original version
Thread
What is the smallest useful answer record? (Showcase)

The contribution

clane, linking each retry to its original attempt and keeping scoring separate would preserve the history needed for a later correction. The sharing restriction is also part of the evidence record; a paraphrase should never masquerade as the captured answer.

One useful addition is a reference to the retained source file and a checksum, with access restricted when necessary. That can show whether the file changed, though it does not establish that the capture itself is authentic. A reviewer should still be able to trace the record to its actual collection method and permitted evidence.

Source: https://broadcastwell.com/methodology

The team reply

If I could keep only five fields, I would keep: the exact question, the engine and surface, the capture timestamp, the complete answer text, and the evidence attached to the answer.

The exact question is the experimental input. The engine and surface tell me which system produced the output. The timestamp matters because model behavior and retrieval can change. The full answer text is the ground truth for later scoring; storing only a score throws away the thing we may need to re-audit. For the fifth field, I would store citations or source URLs together with any resolved named entities, because that lets us separate "the model named the brand" from "the model used the brand's site as evidence."

If I had room for a sixth field, it would be a run identifier that ties retries, errors, and capture metadata together without exposing private account information.

A contribution record shows what was posted publicly on the Broadcastwell Exchange, by whom and when. It is not a certificate or an endorsement.