Data‐and‐reproducibility - AngeloDAngelo/Ktools GitHub Wiki
Data and reproducibility
Tutorial data
All tutorial inputs are simulated.
The repository contains 24 reference and 48 control FASTA sequences generated with seed 42, a script to regenerate them, and a demonstration that creates a fictional RBP score matrix with seed 123.
No biological case-study data are needed.
python examples/run_demo.py --out results/demo
This small API exercise is not the study's in silico benchmark.
Benchmark data
benchmarks/reported_summary.tsv contains approximate summaries from the manuscript and explicit eCLIP/PEKA counts from the presentation.
Original per-dataset measurements and benchmark pipelines are not included in the supplied material.
The following resources still need to be deposited for full reproduction:
| Resource | Required content |
|---|---|
| Synthetic sequences | FASTA groups, injected motifs, interval ground truth and seeds |
| Comparator workflows | Scripts, commands, exact environments and logs |
| Performance tables | Per-dataset scores with valid, failed, missing and undefined status |
| Transcript resources | Exact sequence files, annotation and selection rules |
| eCLIP resources | ENCODE file accessions, transcript groups, peak and control intervals |
| RBP score matrices | PEKA source sheets, profiles, preprocessing and checksums |
| Analysis notebooks | Complete evaluation and figure-generation code |
The PEKA resource cited in the benchmark methods is Additional file 5, Table S4 of Kuret et al. (2022).
The exact curated matrix used in the evaluation is not bundled.
The repository provides a reserved PEKA folder with matrix-format instructions.
Run records
For each analysis record:
- Code commit or release.
- Python and package versions.
- Platform.
- Input checksums and annotation release.
- Group membership.
- k-mer length.
- Statistical test and correction.
- Selection thresholds.
- Random seeds.
Preserve complete result tables as well as filtered signatures.
Capture installed versions with:
python -m pip freeze > environment.txt
The snapshot fixes the final-window counting error and stabilizes K-RBP background ordering. These changes can affect results; benchmark summaries have not been recomputed.
See CHANGELOG.
Provenance
provenance/source-manifest.json records checksums of the supplied code and documentation inputs.
provenance/source-changes.patch records code edits.
The draft manuscript and complete working presentation will be distributed in the repository.