Logbook - input-output-hk/mithril GitHub Wiki

This page records a log of the team’s work, thinking, discussions, pains, joys, events, and experiences that happen on a daily basis. It’s supposed to be a kind of Stream of consciousness that can later be searched, analyzed, reviewed in more formal retrospectives.

Rules:

Log days in reverse chronological order, recent first
When the stream is getting too big, such that github refuses to render do the following:
- extract biggest logical section (half-year or quarter) out of this into a correspondingly named Logbook-Year-Hn.md or Logbook-Year-Qn.md page
- update links on top of this page to make it easier to navigate try to fix all links in the wiki at least
- notify the team
Move (and link) recurring sections to relevant dedicated pages.

History

January 26

2025-H2

2025-H1

2024-H2

2024-H1

2023-H2

2023-H1

2022-H2

2022-H1

2021

2021

January 2026

2026-01-23

Update protocol parameters to SNARK friendly values #2813: we are waiting for all the networks of phase 1 to switch to the new protocol parameters
Implement SNARK-friendly changes in STM library #2795: the PR SNARK-friendly STM: New Key Registration #2880 has been reviewed and merged. The fix PR for AVKs refactor: SNARK-friendly version of Aggregate Verification Key #2951 has been been reviewed and merged. The issue is closed
Follower aggregator panics in e2e tests in run-only mode #2770: we have kept investigating the problem and working on a fix
Release 2603 distribution #2830: we have created a new 2603.1-pre and deployed it to the pre-release-network. We expect to release the distribution mid next week
Import Blocks and Transactions in new store for Cardano Blocks and Transactions #2907: we have kept working on the issue and the developments have been pushed to the djo/2907/add_blocks_to_chain_data_import branch
Implement Digest for Poseidon hash from Midnight ZK #2942: the PR feat(stm): Implementation of the digest trait for the Poseidon hash from Midnight #2936 has been merged. The issue is closed
Create SNARK circuit new module in STM #2911: the PR core(stm/snark): integrate certificate circuit prototype as it is (future_snark) #2938 has been merged. The issue is closed
Proposals for Mithril/DMQ as optout feature of Cardano #2831: we have resumed working on the proposal
We have also verified that none of our test SPOs needed to have their KES keys rotated

2026-01-22

Update protocol parameters to SNARK friendly values #2813: we are waiting for all the networks of phase 1 to switch to the new protocol parameters
Implement SNARK-friendly changes in STM library #2795: the PR SNARK-friendly STM: New Key Registration #2880 has been updated. The fix PR for AVKs refactor: SNARK-friendly version of Aggregate Verification Key #2951 has been created and is being reviewed
Follower aggregator panics in e2e tests in run-only mode #2770: we have kept investigating the problem and working on a fix
Release 2603 distribution #2830: we have identified a problem and created a fix. We will release a new pre-release tomorrow
Import Blocks and Transactions in new store for Cardano Blocks and Transactions #2907: we have kept working on the issue and the developments have been pushed to the djo/2907/add_blocks_to_chain_data_import branch
Implement Digest for Poseidon hash from Midnight ZK #2942: the PR feat(stm): Implementation of the digest trait for the Poseidon hash from Midnight #2936 is being reviewed and will be merged shortly
Create SNARK circuit new module in STM #2911: the PR core(stm/snark): integrate certificate circuit prototype as it is (future_snark) #2938 has been reviewed and will be merged shortly
Signer node version header is not sent by signer #2948: the bug issue has been created, reviewed and merged. The issue is closed

2026-01-21

Update protocol parameters to SNARK friendly values #2813: the PR chore(ci): update protocol parameters of testing-preview #2937 has been reviewed and merged
Implement SNARK-friendly changes in STM library #2795: the PR SNARK-friendly STM: New Key Registration #2880 has been updated and will be merged once we fix the problem we have discovered with the AVK codecs
Follower aggregator panics in e2e tests in run-only mode #2770: we have kept investigating the problem and working on a fix
Release 2603 distribution #2830: we have created the new 2603.0-pre which has been deployed on the pre-release-preview network. We expect to deploy the distribution early next week
Import Blocks and Transactions in new store for Cardano Blocks and Transactions #2907: we have kept working on the issue and the developments have been pushed to the djo/2907/add_blocks_to_chain_data_import branch
Implement Digest for Poseidon hash from Midnight ZK #2942: the draft PR feat(stm): Implementation of the digest trait for the Poseidon hash from Midnight #2936 has been reviewed and updated
Implement SNARK pre-aggregation primitives in STM library - Phase 1 #2792: the draft PR feat(stm): Add key registration support for pre-aggregation primitives #2932 is being reviewed and updated
Create SNARK circuit new module in STM #2911: the PR core(stm/snark): integrate certificate circuit prototype as it is (future_snark) #2938 has been created and is being reviewed

2026-01-20

Update protocol parameters to SNARK friendly values #2813: the PR feat: update protocol parameters for dev networks #2926 has been merged. The draft PR chore(ci): update protocol parameters of testing-preview #2937 has been created and reviewed. It will be merged shortly
Implement SNARK-friendly changes in STM library #2795: the PR SNARK-friendly STM: New Key Registration #2880 has been updated and will be merged once we fix the problem we have discovered with the AVK codecs
Follower aggregator panics in e2e tests in run-only mode #2770: we have kept investigating the problem and working on a fix
Release 2603 distribution #2830: we have created and merged some enhancement PRs and we expect the pre-release to be created on Wednesday
Import Blocks and Transactions in new store for Cardano Blocks and Transactions #2907: the PR refactor: Shared transaction importer for signer and aggregator #2930 has been reviewed and merged. We have kept working on the issue
Implement SNARK pre-aggregation primitives in STM library #2792: the draft PR feat(stm): Add key registration support for pre-aggregation primitives #2932 has been updated and the draft PRfeat(stm): Implementation of the digest trait for the Poseidon hash from Midnight #2936 has been created
Create SNARK circuit new module in STM #2911: we have started to work on the issue and the developments have been pushed to the hjeljeli32/msnark/create-snark-module branch

2026-01-19

Update protocol parameters to SNARK friendly values #2813: we have updated the protocol parameters of the dev-mainnet network and will keep rolling out the new protocol parameters to the other networks. The PR feat: update protocol parameters for dev networks #2926 has been created and is pending review
Implement SNARK-friendly changes in STM library #2795: the PR SNARK-friendly STM: New Key Registration #2880 has been updated and is ready to be merged
Follower aggregator panics in e2e tests in run-only mode #2770: we have kept investigating the problem and working on a fix
DMQ testing with SPOs on preview #2833: the issue is closed
Release 2603 distribution #2830: we have created some enhancement PRs and we expect the pre-release to be created on Wednesday
Use Midnight ZK backends for Jubjub and Poseidon in STM #2888: the PR Change jubjub and poseidon backend from Dusk to MidnightZK #2898 merged. The issue is closed
Import Blocks and Transactions in new store for Cardano Blocks and Transactions #2907: the PR refactor(signer): add test module #2929 has been created, reviewed and merged. The PR refactor: Shared transaction importer for signer and aggregator #2930 has been created and is being reviewed
Implement SNARK pre-aggregation primitives in STM library #2792: the draft PR feat(stm): Add key registration support for pre-aggregation primitives #2932 has been created
We have also created issues and milestones in the DMQ node repository

2026-01-16

Update protocol parameters to SNARK friendly values #2813: we have updated the protocol parameters of the dev-preview network and will keep rolling out the new protocol parameters to the other networks
Implement SNARK-friendly changes in STM library #2795: the PR SNARK-friendly STM: New Key Registration #2880 is being updated and it will be merged shortly
Follower aggregator panics in e2e tests in run-only mode #2770: we have kept investigating the problem and working on a fix
DMQ testing with SPOs on preview #2833: the PR feat: DMQ node infrastructure #2870 has been merged. The PRs fix: activation of P2P DMQ protocol in infra #2927 and chore: enhance DMQ messages and Single Signature logs in aggregator #2928 have been created, reviewed and merged
Release 2603 distribution #2830: the draft PRs docs: rotate documentation for 2603 distribution #2924 and docs: update CHANGELOG with '2603.0' distribution #2925 have been reviewed and will be merged when the pre-release is created
Use Midnight ZK backends for Jubjub and Poseidon in STM #2888: the PR Change jubjub and poseidon backend from Dusk to MidnightZK #2898 is being reviewed and will be merged shortly
Import Blocks and Transactions in new store for Cardano Blocks and Transactions #2907: we have kept working on the issue and the developments have been pushed to the djo/2907/shared_transaction_importer_for_signer_aggregator branch
Update the Midnight library dependency in circuit prototype #2910: the issue is completed and closed
Implement SNARK pre-aggregation primitives in STM library #2792: we have started to work on the issue
We have also checked if some test SPOs needed their KES keys rotated

2026-01-15

Update protocol parameters to SNARK friendly values #2813: we have started preparing the rolling out the new protocol parameters to dev-* networks
Implement SNARK-friendly changes in STM library #2795: the PR SNARK-friendly STM: New Key Registration #2880 is being updated and it will be merged shortly
Follower aggregator panics in e2e tests in run-only mode #2770: we have kept investigating the problem and working on a fix
DMQ testing with SPOs on preview #2833: the PR feat: DMQ node infrastructure #2870 is ready to be merged. It will be merged once Inconsistent diffusion of messages #10 and N2c local notification MsgReplyMessagesBlocking does not follow CDDL specification #15 are closed
Release 2603 distribution #2830: the draft PRs docs: rotate documentation for 2603 distribution #2924 and docs: update CHANGELOG with '2603.0' distribution #2925 have been created and reviewed
Use Midnight ZK backends for Jubjub and Poseidon in STM #2888: the PR Change jubjub and poseidon backend from Dusk to MidnightZK #2898 is being reviewed and will be merged shortly
Create new signed entity type for Cardano Blocks and Transactions #2905: the PR feat: add new CardanoBlocksTransactions to SignedEntityTypes #2922 has been merged. The issue is closed
Import Blocks and Transactions in new store for Cardano Blocks and Transactions #2907: we have kept working on the issue

2026-01-14

Update protocol parameters to SNARK friendly values #2813: we have started preparing the rolling out the new protocol parameters to dev-* networks
Implement SNARK-friendly changes in STM library #2795: the PR SNARK-friendly STM: New Key Registration #2880 has been reviewed and is being updated
Follower aggregator panics in e2e tests in run-only mode #2770: we have kept investigating the problem and working on a fix
DMQ testing with SPOs on preview #2833: the PR feat: DMQ node infrastructure #2870 is ready to be merged. It will be merged once Inconsistent diffusion of messages #10 is closed
Release 2603 distribution #2830: the PR chore: update dependencies for distribution 2603 #2920 has been merged
Use Midnight ZK backends for Jubjub and Poseidon in STM #2888: the PR Rename mithril-stm schnorr module #2903 has been reviewed and merged. The PR Change jubjub and poseidon backend from Dusk to MidnightZK #2898 is being reviewed and updated
Create new signed entity type for Cardano Blocks and Transactions #2905: the PR feat: add new CardanoBlocksTransactions to SignedEntityTypes #2922 has been created, reviewed and will be merged shortly
Import Blocks and Transactions in new store for Cardano Blocks and Transactions #2907: we have started to work on the issue

2026-01-13

Update protocol parameters to SNARK friendly values #2813: we will start rolling out the new protocol parameters shortly
Implement SNARK-friendly changes in STM library #2795: the PR SNARK-friendly STM: New Key Registration #2880 is being updated. The PR Golden test for Closed Key Registration #2901 has been merged
Follower aggregator panics in e2e tests in run-only mode #2770: we have kept investigating the problem and working on a fix
Replace SPO ticker API in aggregator #2878: the PR feat(aggregator): replace cexplorer pools ticker retriever with a blockfrost based implementation #2896 has been updated and merged. The PR feat: add ConfigSecret type and use it for aggregator blockfrost configuration #2919 has been created, reviewed and merged. The issue is closed
DMQ testing with SPOs on preview #2833: the PR feat: DMQ node infrastructure #2870 has been updated and reviewed. It will be merged once Inconsistent diffusion of messages #10 is closed
Release 2603 distribution #2830: the PR chore: update dependencies for distribution 2603 #2920 has been created, reviewed and is ready to be merged
Use Midnight ZK backends for Jubjub and Poseidon in STM #2888: the PR Rename mithril-stm schnorr module #2903 is pending review. The PR Change jubjub and poseidon backend from Dusk to MidnightZK #2898 is pending review

2026-01-12

Update protocol parameters to SNARK friendly values #2813: the protocol parameters have been validated, we will start rolling out the new protocol parameters
Implement SNARK-friendly changes in STM library #2795: the PR SNARK-friendly STM: New Key Registration #2880 is being updated. The PR Golden test for Closed Key Registration #2901 is ready to be merged
Follower aggregator panics in e2e tests in run-only mode #2770: we have kept investigating the problem and working on a fix
Proposals for Mithril/DMQ as optout feature of Cardano #2831: we have kept working on the issue
Replace SPO ticker API in aggregator #2878: the PR feat(aggregator): replace cexplorer pools ticker retriever with a blockfrost based implementation #2896 is being updated and will be merged shortly
DMQ testing with SPOs on preview #2833: the draft PR feat: DMQ node infrastructure #2870 has been updated
Release 2603 distribution #2830: we have kept working on the issue
Use Midnight ZK backends for Jubjub and Poseidon in STM #2888: the PR Rename mithril-stm schnorr module #2903 is pending review. The PR Change jubjub and poseidon backend from Dusk to MidnightZK #2898 is pending review
No more available disk space on GitHub runners #2906: the bug issue has been created. The PR ci: optimize rust test disk space usage #2916 has been created, reviewed and merged. The issue is closed
Create new signed entity type for Cardano Blocks and Transactions #2905: the issue has been created and groomed
Import Blocks and Transactions in new store for Cardano Blocks and Transactions #2907: the issue has been created and groomed
Implement signable builder for Cardano Blocks and Transactions #2908: the issue has been created and groomed
Add throttling to Blocks and Transactions preloader #2909: the issue has been created and groomed
Update the Midnight library dependency in circuit prototype #2910: the issue has been created and groomed
Create SNARK circuit new module in STM #2911: the issue has been created and groomed
Add golden tests for Halo2 circuit prototype #2912: the issue has been created and groomed
Keep track of signers involved in the SNARK proof with committed instance #2913: the issue has been created and groomed
Test wrapper circuit proof in Risc Zero #2914: the issue has been created and groomed
Support for authenticated signer registration for SNARK #2915: the issue has been created and groomed

2026-01-09

Update protocol parameters to SNARK friendly values #2813: the protocol parameters have been validated, we will start rolling out the new protocol parameters
Implement SNARK-friendly changes in STM library #2795: the PR SNARK-friendly STM: New Key Registration #2880 is being updated. The PR Golden test for Closed Key Registration #2901 has been created and reviewed, it is ready to be merged
Follower aggregator panics in e2e tests in run-only mode #2770: we have kept investigating the problem and working on a fix
Proposals for Mithril/DMQ as optout feature of Cardano #2831: we have kept working on the issue
Replace SPO ticker API in aggregator #2878: the PR feat(aggregator): replace cexplorer pools ticker retriever with a blockfrost based implementation #2896 has been reviewed and is being updated
DMQ testing with SPOs on preview #2833: the draft PR feat: DMQ node infrastructure #2870 has been updated. The PRs docs: add dev blog post for DMQ testing program with SPOs #2883 has been reviewed and merged
Nightly tests does not fetch latest main artifacts #2879: the PR ci: fix aggregator stress test parameters handling #2900 has been created, reviewed and merged. The issue is closed
Release 2603 distribution #2830: we have started to work on the issue
Use Midnight ZK backends for Jubjub and Poseidon in STM #2888: the PR Rename mithril-stm schnorr module #2903 has been created and is pending review. The PR Change jubjub and poseidon backend from Dusk to MidnightZK #2898 has been created and is pending review
We have also made sure that none of our test SPOs needed their KES keys rotated

2026-01-08

Upgrade to Cardano 10.6 #2790: the issue is closed as 10.6 will likely never be released
Update protocol parameters to SNARK friendly values #2813: the protocol parameters have been validated, we will start rolling out the new protocol parameters
Implement SNARK-friendly changes in STM library #2795: the PR SNARK-friendly STM: New Key Registration #2880 is being updated
Follower aggregator panics in e2e tests in run-only mode #2770: we have kept investigating the problem and working on a fix
Proposals for Mithril/DMQ as optout feature of Cardano #2831: we have kept working on the issue
Replace SPO ticker API in aggregator #2878: the PR feat(aggregator): replace cexplorer pools ticker retriever with a blockfrost based implementation #2896 has been created and is pending review
DMQ testing with SPOs on preview #2833: the draft PR feat: DMQ node infrastructure #2870 has been updated. The PRs docs: add dev blog post for DMQ testing program with SPOs #2883 is being reviewed. The PR docs: add dev blog post for multiple aggregators testing program #2884 is being reviewed
Prepare recursive Halo2 circuit implementation MVP #2886: the issue has been created
Implement SNARK aggregation primitives in STM library #2887: the issue has been created
Use Midnight ZK backends for Jubjub and Poseidon in STM #2888: the issue has been created
Implement SNARK primitives in STM #2889: the issue has been created
SNARK-friendly STM MVP - Phase 2 #2890: the issue has been created
Feasibility of Bitcoin Defi usecase - Phase 2 #2891: the issue has been created
SNARK-friendly Mithril nodes #2892: the issue has been created
Prepare Mithril nodes for recursive SNARK #2893: the issue has been created
Upgrade to Cardano 10.7 #2894: the issue has been created
Implement Halo2 circuit in STM library #2895: the issue has been created
Extract Merkle forest modules in new crate #2897: the issue has been created
We have also prepared the sprint planning for the next iteration

2026-01-07

Upgrade to Cardano 10.6 #2790: we are waiting for Cardano 10.6.2 to be released before moving forward
Update protocol parameters to SNARK friendly values #2813: the protocol parameters have been validated, we will start rolling out the new protocol parameters
Assess constraints on Halo2 circuit verification #2799: the proposals have been reviewed, the issue is closed
Support test mode for the Halo2 circuit #2798: the proposals have been reviewed, the issue is closed
Detect an under constrained Halo2 circuit #2801: the proposals have been reviewed, the issue is closed
Implement SNARK-friendly changes in STM library #2795: the PRs SNARK-friendly STM: Single signature of concatenation proof #2875 and SNARK-friendly STM: Remove Deprecated Items #2881 have been reviewed and merged. The PR SNARK-friendly STM: New Key Registration #2880 is being updated
Follower aggregator panics in e2e tests in run-only mode #2770: we have kept investigating the problem and working on a fix
Proposals for Mithril/DMQ as optout feature of Cardano #2831: we have kept working on the issue
Replace SPO ticker API in aggregator #2878: we have kept working on the issue and the developments have been pushed to the djo/2878/aggregator-replace-spo-ticker branch
DMQ testing with SPOs on preview #2833: the draft PR feat: DMQ node infrastructure #2870 has been updated. The PRs docs: add dev blog post for DMQ testing program with SPOs #2883 and docs: add dev blog post for multiple aggregators testing program #2884 are being reviewed. The PR feat: use final DMQ magic numbers #2885 has been created, reviewed and merged

2026-01-06

Upgrade to Cardano 10.6 #2790: we are waiting for Cardano 10.6.2 to be released before moving forward
Update protocol parameters to SNARK friendly values #2813: we are pending final validation of protocol parameters before moving forward
Assess constraints on Halo2 circuit verification #2799: the proposals are being reviewed
Support test mode for the Halo2 circuit #2798: the proposals are being reviewed
Detect an under constrained Halo2 circuit #2801: the proposals are being reviewed
Implement SNARK-friendly changes in STM library #2795: the PRs SNARK-friendly STM: Single signature of concatenation proof #2875, SNARK-friendly STM: New Key Registration #2880 and SNARK-friendly STM: Remove Deprecated Items #2881 have been reviewed and are pending update
Follower aggregator panics in e2e tests in run-only mode #2770: we have kept investigating the problem and working on a fix
Proposals for Mithril/DMQ as optout feature of Cardano #2831: we have kept working on the issue
Replace SPO ticker API in aggregator #2878: we have kept working on the issue and the developments have been pushed to the djo/2878/aggregator-replace-spo-ticker branch
DMQ testing with SPOs on preview #2833: the draft PR feat: DMQ node infrastructure #2870 has been updated. The PR refactor: introduce KesEvolutions type #2869 has been updated and merged. the PR docs: add dev blog post for DMQ testing program with SPOs #2883 has been created and is pending review. The PR docs: add dev blog post for multiple aggregators testing program #2884 has been created and is pending review
Design strategy for enhanced support of Cardano versions #2856: the issue has been updated with the strategy which is being reviewed

2026-01-05

Upgrade to Cardano 10.6 #2790: we are waiting for Cardano 10.6.2 to be released before moving forward
Update protocol parameters to SNARK friendly values #2813: we are pending final validation of protocol parameters before moving forward
Assess constraints on Halo2 circuit verification #2799: the proposals are being reviewed
Support test mode for the Halo2 circuit #2798: the proposals are being reviewed
Detect an under constrained Halo2 circuit #2801: the proposals are being reviewed
Implement SNARK-friendly changes in STM library #2795: the PRs SNARK-friendly STM: Single signature of concatenation proof #2875, SNARK-friendly STM: New Key Registration #2880 and SNARK-friendly STM: Remove Deprecated Items #2881 have been created and are being reviewed
Follower aggregator panics in e2e tests in run-only mode #2770: we have kept investigating the problem and working on a fix
Proposals for Mithril/DMQ as optout feature of Cardano #2831: we have kept working on the issue
Replace SPO ticker API in aggregator #2878: the issue has been created and groomed. We have started to work on it
DMQ testing with SPOs on preview #2833: the draft PR feat: DMQ node infrastructure #2870 has been updated. The PR refactor: introduce KesEvolutions type #2869 has been reviewed and will be merged shortly. The PR doc: add DMQ node setup in Mithril signer guide #2872 has been reviewed and merged. The PR fix: better support for signature registration errors in aggregator signature processor #2873 has been reviewed and merged
Add a new guide on how to setup a follower aggregator #2815: the PR doc: add aggregator setup guide #2876 has been created, reviewed and merged. The issue is closed
Design strategy for enhanced support of Cardano versions #2856: the issue has been updated with the strategy which is being reviewed