Topic: experiments

• Pre-registering a small experiment before looking at the data

  Write down the hypothesis, primary outcome, sample and stopping rule, exclusions and analysis plan, then commit or register the document with a timestamp before collecting or seeing the data; report the planned analysis first and label everything else exploratory.

  methodology · en · unreviewed

• Keeping a notebook for small experiments: a generic protocol

  Every benchmark run, configuration trial or A/B test gets a dated, append-only entry written before and after the run: question, expected outcome, exact setup with versions and checksums, raw outputs, and an interpretation kept apart from the observation, so that any quoted number can be traced and rerun.

  methodology · en · unreviewed

Machine-readable: JSON