Reproducibility

Every simulated result on this site already carries a “Simulation” tag — that's a disclosure. This page is the next step: the statistics below are re-derived by CI, in the public repo, on a schedule stated for each one. Not a promise that a number can't change — a standing invitation to check whether it still does.

The number shown here is whatever each source repo's CI most recently published as of this site's last build/deploy — not a live, between-deploys feed. Site build last pulled fresh CI data at Sep 2, 2026, 3:47 AM UTC.

The Punishment Paradox

View on project page →

Published, full-scale: r = -0.972, p < 0.001 — increasing consequences decreases cooperation

CI-reproducedsmall-scale — refreshed on every push + weekly

r = -0.818 (n=5 seeds)

Verified Sep 1, 2026 against commit 2a61e5f of the real simulation code, not a copy of this page's numbers. CI run · source · reproduce full scale in Colab

Hart-Moore Hold-up Reduction

View on project page →

Published, full-scale: 40.4% hold-up reduction — GCL's failure-first specification vs. incomplete contracts

CI-reproducedsmall-scale — refreshed on every push + weekly

28.5% hold-up reduction (n=5 seeds)

Verified Sep 1, 2026 against commit 2a61e5f of the real simulation code, not a copy of this page's numbers. CI run · source · reproduce full scale in Colab

CNL Bridge Ablation

View on project page →

Published, full-scale: +89% accuracy at high regularization — bidirectional knowledge bridges vs. CMS alone

CI-reproducedfull-scale — refreshed weekly

+88.5% at reg=5 (bridges helped 5/5 settings)

Verified Sep 1, 2026 against a local test run of the real simulation code, not a copy of this page's numbers. source · reproduce full scale in Colab

How this works

  • Each source repo (jstiltner/gcl, jstiltner/collaborative-nested-learning) runs its own GitHub Actions workflow that re-derives the number from the real simulation code and commits the result back to ci_results/latest.json.
  • This site fetches that file at build time (scripts/fetch-ci-results.ts) — a build never fails because a fetch didn't succeed; it falls back to the last-known-good copy.
  • A CI-derived number is deliberately not the same run as the published claim — see each repo's CHANGELOG for why (in short: GCL's reduced-scale run preserves the right direction with wider intervals; CNL's bridge effect needs closer to full scale, so its badge only refreshes weekly, at full scale, not on every push).
  • Every “Open in Colab” link runs the exact same code at the original published scale, interactively, for anyone who wants to check it themselves.