cdskit localize peroxisome head - kfuku52/cdskit GitHub Wiki
cdskit localize peroxisome head
The CDSKIT-trained weights are MIT-licensed; the model release includes LICENSE and SHA256SUMS. The license update leaves the checkpoint bytes and legacy runtime requirements unchanged. Source datasets retain their original terms.
p_peroxisome is available in the experimental prerelease model
cdskit-localize-targeting5-perox-deeploc21-et-v1.pt, registered under the
alias targeting5-perox-deeploc21-et-v1. When that alias is used with
cdskit localize --model, CDSKIT downloads the model from GitHub Releases into
the local model cache if it is not already present and verifies its SHA-256
checksum.
cdskit localize \
--seq_file proteins.faa \
--seq_type protein \
--model targeting5-perox-deeploc21-et-v1 \
--organism_group non_plant \
--report localize.tsv
The peroxisome head is a CPU-runtime scikit-learn ExtraTrees classifier trained
on DeepLoc21 Swiss-Prot train/validation rows with sequence-level features,
including C-terminal PTS-like features. Its p_peroxisome output is a learned
sequence-label score, not an independently calibrated biological probability.
The historical evaluation below does not establish broad peroxisome-associated
localization accuracy, and a PTS motif match alone does not prove targeting.
Release asset
Use the pretrained runtime setup. This artifact contains legacy scikit-learn 1.5.2 estimators. Current CDSKIT supports their known loss layout on scikit-learn 1.9.0 and has been compared against the 1.5.2 reference on a retained synthetic fixture.
- GitHub model release
- Asset:
cdskit-localize-targeting5-perox-deeploc21-et-v1.pt - SHA-256:
d0998df8819d975b4392342ab78dccc0dd95cf301e4d2df8f38c73d0b5aab445
Fairness checks
- External accession and exact-sequence overlap are excluded or reported.
- A constant-zero baseline and a regex PTS baseline are reported.
- MMseqs homology subsets and cluster out-of-fold evaluation are used to expose similarity-driven optimism.
- HPA is kept as a difficult broad-localization stress test.
Candidate comparison
The current candidate uses ExtraTrees because it improved the independent external and cluster-OOF checks compared with the earlier HGB candidate, while keeping inference CPU-only.
| Candidate | UniProt external AUPRC | UniProt external F1 | Cluster OOF AUPRC | Cluster OOF F1 | HPA stress AUPRC | HPA stress F1 |
|---|---|---|---|---|---|---|
HGB, perox_sequence_v1 |
0.239 | 0.293 | 0.191 | 0.212 | 0.007 | 0.000 |
HGB, broad_localize_v1 |
0.209 | 0.302 | 0.125 | 0.142 | - | - |
ExtraTrees, perox_sequence_v1 |
0.256 | 0.370 | 0.246 | 0.277 | 0.149 | 0.250 |
Evaluation snapshot
These are historical development results, not metrics rerun for the current CDSKIT version. The validation threshold was selected on that validation set; use the independent external and cluster evaluations to assess generalization.
| Model / evaluation | Rows | Positives | AUPRC | AUROC | F1 | Notes |
|---|---|---|---|---|---|---|
| DeepLoc21 validation, perox head | 5,462 | 53 | 0.482 | 0.895 | 0.583 | threshold tuned on DeepLoc21 fold_id=4 |
| DeepLoc21 validation, regex PTS | 5,462 | 53 | 0.080 | 0.765 | 0.217 | simple PTS1/PTS2 signal baseline |
| UniProt experimental CC external, perox head | 11,395 | 138 | 0.256 | 0.847 | 0.370 | no accession/exact-sequence overlap with DeepLoc21 training |
| UniProt experimental CC external, regex PTS | 11,395 | 138 | 0.041 | 0.642 | 0.156 | same external rows |
| UniProt experimental CC cluster OOF, perox head | 11,395 | 138 | 0.246 | 0.854 | 0.277 | MMseqs clusters at 30% identity / 80% coverage |
| HPA external stress test, DeepLoc21-trained perox head | 1,717 | 7 | 0.149 | 0.665 | 0.250 | broad peroxisome-associated task; no positive homology hits |
These results support replacing the previous constant-zero p_peroxisome
placeholder for signal-like use cases, but they do not yet support advertising
the head as a broad peroxisome-localization model.
Reproduce
These are research commands that need prepared inputs, optional ML dependencies,
and an mmseqs executable on PATH. Data files below are not included in the
package. Download/prepare the DeepLoc tables with
python -m cdskit.deeploc_benchmark --download yes --prepare yes --benchmark no
and supply the indicated UniProt snapshot separately. A new live UniProt query
does not reproduce a frozen historical dataset exactly.
Main candidate model and UniProt experimental CC external benchmark:
python -m cdskit.perox_benchmark \
--training_tsv data/localize_bench/deeploc21/deeploc21_localization_train_validation.tsv \
--external_test_tsv data/localize_bench/eukaryota_full_with_lineage.tsv \
--external_format uniprot_exp_cc \
--feature_profile perox_sequence_v1 \
--model_kind extra_trees \
--base_model targeting5 \
--model_out data/localize_bench/perox_deeploc21_et_v1/cdskit-localize-targeting5-perox-deeploc21-et-v1.pt \
--out_json data/localize_bench/perox_deeploc21_et_v1/perox_benchmark_uniprot_exp_external.json \
--out_md data/localize_bench/perox_deeploc21_et_v1/perox_benchmark_uniprot_exp_external.md \
--predictions_prefix data/localize_bench/perox_deeploc21_et_v1/perox_predictions_uniprot_exp \
--homology_check yes \
--homology_threads 4 \
--cluster_oof yes \
--cluster_oof_source external \
--cluster_oof_folds 5 \
--cluster_oof_method mmseqs
HPA stress test for the same DeepLoc21-trained candidate:
python -m cdskit.perox_benchmark \
--training_tsv data/localize_bench/deeploc21/deeploc21_localization_train_validation.tsv \
--external_test_tsv data/localize_bench/deeploc21/deeploc21_hpa_test.tsv \
--external_format prepared \
--feature_profile perox_sequence_v1 \
--model_kind extra_trees \
--homology_check yes \
--homology_threads 4 \
--out_json data/localize_bench/perox_deeploc21_et_v1/perox_benchmark_hpa_external.json \
--out_md data/localize_bench/perox_deeploc21_et_v1/perox_benchmark_hpa_external.md \
--predictions_prefix data/localize_bench/perox_deeploc21_et_v1/perox_predictions_hpa
Feature and decision versions
See the localization feature and decision contract
for the corrected nine-residue PTS2 definition, legacy model compatibility,
--decision_policy safe-v1, v2 output and explicit taxonomy constraints.
Published artifacts retain their historical defaults; new staged pipeline models
default to safe inference with ensure_one_label=False. Scores remain unverified
as calibrated biological probabilities.
References
Cite the method or resource actually used, in addition to the CDSKIT version and command. Papers below do not validate newly trained CDSKIT models or new options.
- Thumuluri V et al. (2022). DeepLoc 2.0: multi-label subcellular localization prediction using protein language models. Nucleic Acids Research 50:W228βW234. Paper β Localization labels, sorting-signal data and protein-language-model methodology where used.
- Γdum M et al. (2024). DeepLoc 2.1: multi-label membrane protein type prediction using protein language models. Nucleic Acids Research 52:W215βW220. Paper β DeepLoc 2.1 data/partition provenance; citing the dataset does not mean CDSKIT executes the DeepLoc predictor.
- Geurts P, Ernst D, Wehenkel L (2006). Extremely randomized trees. Machine Learning 63:3β42. Paper β ExtraTrees method used for the peroxisome/specialist head.
- The UniProt Consortium (2025). UniProt: the Universal Protein Knowledgebase in 2025. Nucleic Acids Research 53:D609βD617. Paper β Protein sequences and annotations; also report the downloaded snapshot/query and evidence filters.
- Thul PJ et al. (2017). A subcellular map of the human proteome. Science 356:eaal3321. Paper β Human Protein Atlas Cell Atlas annotation resource for the HPA evaluations; report the actual snapshot and label mapping.
- Steinegger M, SΓΆding J (2017). MMseqs2 enables sensitive protein sequence searching for the analysis of massive data sets. Nature Biotechnology 35:1026β1028. Paper β Cite when MMseqs2 is used for homology filtering or clustering in the research workflow.
- Flynn CR, Mullen RT, Trelease RN (1998). Mutational analyses of a type 2 peroxisomal targeting signal that is capable of directing oligomeric protein import into tobacco BY-2 glyoxysomes. The Plant Journal 16:709β720. Paper β Experimental PTS2 nonapeptide evidence; the CDSKIT motif/window detector is a heuristic.
- Gonzalez NH et al. (2011). A Single Peroxisomal Targeting Signal Mediates Matrix Protein Import in Diatoms. PLOS ONE 6:e25316. Paper β Evidence that PTS2-mediated import is not universal across taxa; motif matches alone do not prove localization.