PHYSICAL_HELIACAL_VISIBILITY_PHASE4_JONES_MYSTIC_PILOT_CHECKPOINT_2026 07 31 - TheDaniel166/moira GitHub Wiki
Physical Heliacal Visibility Phase 4 Jones MYSTIC Pilot Checkpoint
Date: 2026-07-31
Status: corrected v2 550 nm pilot and pre-holdout threshold gate closed; replacement sealed holdouts passed separately; spectral and runtime models not admitted
Candidate identifier: jones_paranal_scattered_moonlight_2013_v1
Pilot identifier: jones_paranal_mystic_550nm_pilot_v2
Outcome
The corrected, independently assembled libRadtran 2.0.6 MYSTIC pilot completed all 15 declared cases. Every threshold frozen after those measurements and before execution of the three new reserved holdouts passed. The result does not admit a spectral grid, runtime model, production data pack, public API, or network dependency.
The generated numerical artifact remains outside the repository. The repository contains the generator and validator contracts, exact source and tool receipts, compact measured checkpoints, and the frozen threshold declaration. No libRadtran or ESO source bytes are redistributed.
V1 Invalidation and V2 Correction
The original v1 pilot, threshold, and holdout evidence is invalid for
scientific admission. libRadtran applies each aerosol_file explicit property
file from its listed altitude upward to the next boundary; the uppermost line
is only a top marker. V1 listed each physical file at its layer's upper
boundary. That shifted every layer upward and placed the last physical layer
above the intended 20 km profile top.
The v1 builder and validator shared the same incorrect serialization, so
receipt, repeatability, convergence, and holdout checks could not detect the
source-semantics error. No engine, public API, runtime model, or production
data pack used the invalidated evidence. The exact old receipts and source
rule are preserved in
phase4_jones_mystic_v1_invalidation_checkpoint_2026-07-31.json.
V2 writes a null top marker, an explicit null gap down to the 20 km profile top, and each physical file at its inclusive lower boundary. The pilot builder and independent validator reconstruct and check that ownership separately.
Pilot Boundary
The pilot remains one-wavelength evidence at 550 nm. Its 15 executed cases cover target and Moon altitude, relative azimuth and separation, lunar phase over the admitted 1.55-97 degree ROLO domain, waxing and waning sides, Moon-Earth distance, three photon counts, three independent 300,000-photon seeds, and an exact fixed-seed repeat.
Three fresh geometry combinations were reserved before corrected-v2 execution
and were not used to select thresholds. The sealed protocol assigns each
holdout 1,000,000 photons and seed 271828183, with an exact repeat of
holdout_v2_interior_cross_axis.
The pilot uses checksum-locked ESO solar, ROLO, and mie_m15s1.dat inputs.
The aerosol phase function remains source-owned rather than independently
reconstructable. The radiative-transfer assembly is independent; the aerosol
microphysics is not claimed to be independent.
Explicit Design Limitation
The pilot places the atmosphere and ground at the 2,640 m observer altitude. Jones uses a 2,000 m lower model boundary beneath the observer. This difference must be resolved or explicitly versioned before spectral or production admission.
Generated Artifact Receipt
The corrected-v2 external artifact manifest is locked at:
- bytes:
41237; - SHA-256:
f3a139617abe43ffc1098a6b2df5e90dc10a48a32b1219316a772e6d60245aa7; - executed cases:
15; - reserved holdouts:
3; - directional radiance range:
3.74437e-09to8.66392e-08 W m-2 nm-1 sr-1; and - runtime or network dependency: none.
The source archive, uvspec binary, and 1,300-file data tree remain bound by
SHA-256 values 64930cc40b6e4a37aa220520974d330fc1563796f466a649b2238131f2d69840,
d4e94259296a65f7700a0911f0dc7fc14aacde89985befac0266fe0a18531b7a,
and 191e39b7d1d6554517227a21dfa0feea11ffc308889ffccbe938408ed0fbf207.
Frozen Threshold Results
| Check | Observed | Maximum |
|---|---|---|
| Relative standard error, all pilot cases | 0.0110471732 |
0.0125 |
| Relative standard error, base 1M case | 0.0034758176 |
0.004 |
| Standard-error times square-root-photons max/min | 1.009499576 |
1.05 |
| Three-seed 300K sample relative standard deviation | 0.0039599941 |
0.01 |
| Sample spread / mean reported relative error | 0.623234396 |
1.0 |
| Aerosol absolute angle reconstruction error | 0.2069652263 |
0.25 |
| Aerosol relative angle reconstruction error | 0.0075170261 |
0.01 |
Absolute raw k0 - 1 |
0.0006827257 |
0.001 |
| Unrepresented AOD fraction above profile top | 5.21443e-07 |
1e-06 |
| Radiance/source-ratio max/min | 1.0000041606 |
1.00001 |
| Absolute MYSTIC-SkyCalc difference | 0.0174360371 mag |
0.15 mag |
All directional outputs were finite and positive. The fixed-seed repeat was
byte-identical for mc.rad.spc, mc.rad.std.spc, mc0.rad, mc0.rad.std,
and randomseed.
The SkyCalc 2.0.9 comparison is source-owned operational evidence, not an
independent oracle. Its 550 nm flux_sml value converts to
1.5224540982e-08 W m-2 nm-1 sr-1; the matching corrected MYSTIC case produced
1.4982e-08 W m-2 nm-1 sr-1.
Independent Validation
The validator independently reconstructs the atmosphere, O4 companion, lunar source, corrected aerosol column and 512 Legendre moments, explicit layer ownership, geometry, case set, repeat files, and convergence diagnostics. It also verifies the exact generator and external-source receipts.
The threshold evaluator binds that artifact to the frozen v2 threshold
specification and exact SkyCalc capture. Its checkpoint status is
corrected_v2_pilot_passes_threshold_gate_holdouts_not_executed.
Machine-Checkable Files
scripts/visibility_reference_lab/phase4_jones_mystic_pilot_spec.jsonscripts/build_visibility_phase4_jones_mystic_pilot.pyscripts/validate_visibility_phase4_jones_mystic_pilot.pytests/artifacts/visibility_reference_lab/phase4_jones_mystic_pilot_checkpoint_2026-07-31.jsonscripts/visibility_reference_lab/phase4_jones_mystic_admission_thresholds.jsonscripts/audit_visibility_phase4_jones_mystic_thresholds.pytests/artifacts/visibility_reference_lab/phase4_jones_mystic_threshold_checkpoint_2026-07-31.jsontests/artifacts/visibility_reference_lab/phase4_jones_mystic_v1_invalidation_checkpoint_2026-07-31.jsontests/unit/test_visibility_phase4_jones_mystic_pilot.pytests/unit/test_visibility_phase4_jones_mystic_thresholds.py
Reproduction
python3 scripts/build_visibility_phase4_jones_mystic_pilot.py \
--uvspec /home/nilad/.cache/moira/visibility-reference-lab/work/libRadtran-2.0.6/bin/uvspec \
--lib-radtran-archive /home/nilad/.cache/moira/visibility-reference-lab/source/libRadtran-2.0.6.tar.gz \
--data-root /home/nilad/.cache/moira/visibility-reference-lab/work/libRadtran-2.0.6/data \
--eso-archive /mnt/c/Users/nilad/AppData/Local/Temp/moira-jones-20260731/SM-01.tar.gz \
--output-root /home/nilad/.cache/moira/visibility-reference-lab/work/jones-mystic-pilot-v2-20260731-2
python3 scripts/validate_visibility_phase4_jones_mystic_pilot.py \
--artifact-root /home/nilad/.cache/moira/visibility-reference-lab/work/jones-mystic-pilot-v2-20260731-2 \
--uvspec /home/nilad/.cache/moira/visibility-reference-lab/work/libRadtran-2.0.6/bin/uvspec \
--lib-radtran-archive /home/nilad/.cache/moira/visibility-reference-lab/source/libRadtran-2.0.6.tar.gz \
--data-root /home/nilad/.cache/moira/visibility-reference-lab/work/libRadtran-2.0.6/data \
--eso-archive /mnt/c/Users/nilad/AppData/Local/Temp/moira-jones-20260731/SM-01.tar.gz
Gate State
Closed:
- corrected, checksum-bound 550 nm pilot matrix and generator;
- independent artifact validation and explicit aerosol-layer ownership;
- repeatability, convergence, aerosol representation, and lunar-source checks;
- corrected-v2 pre-holdout numerical threshold freeze; and
- fresh sealed holdouts in the companion holdout checkpoint.
Still open:
- an independently generated spectral grid and interpolation thresholds;
- untouched spectral holdouts and response-integrated products;
- release/distribution disposition for any derived data artifact;
- engine implementation and typed component receipt;
- public-surface parity; and
- Phase 4 closure.
The lower-boundary disposition listed by the original checkpoint was closed on 2026-08-02 by the Jones MYSTIC lower-boundary checkpoint. This pilot remains the exact corrected-v2 observer-bottom control.