Source party
Share the original work
Submit author and contact details, documentation, code, data descriptions, data links where available, data sharing possibilities, and links to the related abstract, preprint, or paper.
OHBM Open Science SIG
The OHBM Reproducibility Challenge
A collaborative challenge connecting source and reproducing teams to strengthen transparent neuroimaging science.
Overview
A structured path for testing scientific results
The OHBM-OSSIG Reproducibility Challenge is a networking experience facilitated by the Open Science SIG, aiming at improving the reproducibility of scientific results.
Participants join forces in teams of two parties: a source party and a reproducing party. The source party provides a submitted OHBM abstract, procedures, code, and data when possible. The reproducing party independently re-runs or extends the analysis.
Team model
Two roles, one transparent workflow
Reproducing party
Run the independent attempt
Register expertise and interests so OSSIG can support team formation. Teams do not need to arrive pre-formed.
Challenge scope
Types of reproduction
The specific type of reproduction is determined by the availability of the original data.
Reproducibility
Running the same analysis on the same data.
Replicability
Running the same analysis on independent data.
Adapted from The Turing Way Community. Original illustration created by Scriberia with The Turing Way community, used under a CC-BY 4.0 licence. DOI: 10.5281/zenodo.3332807
How to participate
Register through the OSSIG GitHub template
Both source and reproducing parties register by opening an issue on the OSSIG GitHub page and selecting their role in the template.
1
Submit an OHBM 2026 abstract or register your reproduction expertise.
2
OSSIG supports team formation based on expertise and interests.
3
Teams may hold one brief introduction meeting to clarify scope and logistics.
Timeline
From OHBM 2026 submissions to OHBM 2027 outcomes
-
OHBM 2026
Teams are formed and confirmed during or shortly after the meeting.
-
Reproduction period
Established teams reproduce or replicate the source work using available procedures, code, and data.
-
OHBM 2027
Teams are invited to collaboratively submit an abstract describing results to both the OHBM abstract portal and OSSIG.
-
Showcase
OSSIG hosts a dedicated session to present teams and reflect on what was learned.
Outcomes are evaluated based on how closely replication matches the original work, the transparency and openness of the source work, and additional outputs such as software or publications. Unsuccessful attempts do not reflect negatively; learning through the process is the main outcome.
Background
Inspired by prior reproducible research efforts
This challenge is inspired by the Reproducible Research Study Group of ISMRM.