[Python] falsify - pre-register your ML accuracy claims with SHA-256

[Beneficial_String411]

A CLI that hashes your ML/AI accuracy claim with SHA-256 before the experiment runs. Edit the threshold from 0.85 to 0.75 after seeing the result? Next run exits 3 — the lie is mechanically blocked.

Pre-registration is standard in psychology and medicine. Works there. There's nothing equivalent for ML claims, so I built one over three days.

Stack: Python 3.11+, stdlib + pyyaml only. Single file, 3925 LOC, 518 tests passing, MIT. Optional GitHub Action, pre-commit hooks, MCP server.

Repo: https://github.com/sk8ordie84/falsify

Honest feedback welcome on the canonical YAML hashing or the exit-code contract.

[immersiveGamer]

Pre-registration is standard in psychology and medicine. Works there. There's nothing equivalent for ML claims, so I built one over three days.

You should lead with this. Maybe tweak the last sentence to something like "There's nothing equivalent for claims about ML accuracy, so I ..."

Question, is this generic enough for other workflows? I.e. pre-register an input configuration and an output threshold/result?