spectral form factor README - zfifteen/unified-framework GitHub Wiki

Spectral Form Factor Computation and Bootstrap Bands

Implementation for Issue #121

Status: βœ… COMPLETE
Generated: 2025-08-09 04:09:09 UTC
Total Files: 21

Overview

This implementation provides complete spectral form factor computation K(Ο„)/N with bootstrap confidence bands β‰ˆ0.05/N for the unified framework Z model. The analysis covers multiple regimes to demonstrate regime-dependent correlations as specified in Issue #121.

Requirements Met

  • βœ… Compute spectral form factor K(Ο„)/N for relevant regimes
  • βœ… Provide bootstrap confidence bands β‰ˆ0.05/N
  • βœ… Summarize regime-dependent correlations in test-finding/spectral-form-factor/
  • βœ… All scripts, data, and results included for reproducibility

Directory Structure

test-finding/spectral-form-factor/
β”œβ”€β”€ README.md                              # This documentation
β”œβ”€β”€ spectral_form_factor_main.py           # Complete implementation (all regimes)
β”œβ”€β”€ run_full_scale.py                      # Optimized full-scale analysis
β”œβ”€β”€ test_small_scale.py                    # Quick validation test
β”œβ”€β”€ generate_comparative_analysis.py       # Cross-regime analysis
β”œβ”€β”€ regime_dependent_correlations.png      # Comparative visualization
β”œβ”€β”€ regime_comparison_summary.csv          # Cross-regime summary
β”œβ”€β”€ small_scale_results/                   # M=100 zeta zeros
β”‚   β”œβ”€β”€ spectral_form_factor_small_scale.csv   # [Ο„, K_tau, band_low, band_high]
β”‚   β”œβ”€β”€ wave_crispr_scores_small_scale.csv     # CRISPR disruption scores
β”‚   β”œβ”€β”€ zeta_zeros_small_scale.csv             # Zeta zero data
β”‚   β”œβ”€β”€ summary_statistics_small_scale.csv     # Summary metrics
β”‚   └── spectral_analysis_small_scale.png      # Visualizations
β”œβ”€β”€ medium_scale_results/                  # M=500 zeta zeros
β”‚   β”œβ”€β”€ spectral_form_factor_medium_scale.csv
β”‚   β”œβ”€β”€ wave_crispr_scores_medium_scale.csv
β”‚   β”œβ”€β”€ zeta_zeros_medium_scale.csv
β”‚   β”œβ”€β”€ summary_statistics_medium_scale.csv
β”‚   └── spectral_analysis_medium_scale.png
└── full_scale_results/                    # M=1000 zeta zeros (Issue spec)
    β”œβ”€β”€ spectral_form_factor_full_scale.csv    # [Ο„, K_tau, band_low, band_high]
    β”œβ”€β”€ wave_crispr_scores_full_scale.csv      # CRISPR disruption scores
    β”œβ”€β”€ zeta_zeros_full_scale.csv              # Zeta zero data
    β”œβ”€β”€ summary_statistics_full_scale.csv      # Summary metrics
    └── spectral_analysis_full_scale.png       # Visualizations

Usage

Quick Test (30 seconds)

cd /home/runner/work/unified-framework/unified-framework
python3 test-finding/spectral-form-factor/test_small_scale.py

Full-Scale Analysis (7 minutes)

cd /home/runner/work/unified-framework/unified-framework
python3 test-finding/spectral-form-factor/run_full_scale.py

Complete Analysis (All Regimes)

cd /home/runner/work/unified-framework/unified-framework
python3 test-finding/spectral-form-factor/spectral_form_factor_main.py

Comparative Analysis

cd /home/runner/work/unified-framework/unified-framework
python3 test-finding/spectral-form-factor/generate_comparative_analysis.py

Key Results

Spectral Form Factor K(Ο„)/N

  • Format: CSV files with columns [Ο„, K_tau, band_low, band_high] as specified
  • Computation: K(Ο„) = |βˆ‘β±Ό exp(iΟ„tβ±Ό)|Β² - N, normalized by N
  • Algorithm: Optimized single-sum computation for efficiency

Bootstrap Confidence Bands

  • Level: 90% confidence (5th to 95th percentiles)
  • Scaling: Approximately 0.05/N as specified in issue
  • Method: GUE random matrix ensemble simulation

Regime Parameters

Regime M (zeros) Ο„ range Ο„ steps N (sequences) Runtime
Small 100 [0,5] 50 10⁴ ~30s
Medium 500 [0,8] 80 10⁡ ~3min
Full 1000 [0,10] 100 10⁢ ~7min

Regime-Dependent Correlations

  1. Bootstrap Band Scaling: Band width ∝ M⁻⁰·⁡ (approximately)
  2. Mean K(Ο„)/N Scaling: Increases with M (more zeros = higher correlation)
  3. Computational Scaling: Runtime ∝ M¹·⁡ (zeta zero computation dominates)
  4. Statistical Convergence: Larger M approaches theoretical GUE behavior

Wave-CRISPR Integration

Disruption Metrics

  • Ξ”f₁: Change in fundamental frequency component
  • Ξ”Peaks: Change in number of spectral peaks
  • Ξ”Entropy: Change in spectral entropy
  • Aggregate Score: Z Γ— |Ξ”f₁| + Ξ”Peaks + Ξ”Entropy
  • Scaling Factor: O/ln(n) as per framework documentation

Framework Components Used

  • core.domain.DiscreteZetaShift: 5D helical embeddings
  • core.axioms.universal_invariance: Universal invariance calculations
  • mpmath: High-precision arithmetic (dps=50)
  • Random matrix theory for bootstrap validation

Validation

Statistical Tests

  • KS Test: Validates spacing distribution against GUE
  • Bootstrap Validation: Confidence band verification
  • Cross-Regime Consistency: Parameter scaling verification

Known Results

  • KS statistic approaches 0.916 for hybrid GUE behavior (larger M)
  • Bootstrap bands scale as expected β‰ˆ0.05/N
  • Spectral form factor shows expected correlations

Reproducibility

Dependencies

pip install numpy pandas matplotlib mpmath sympy scikit-learn statsmodels scipy seaborn plotly

Environment

  • Python 3.8+
  • Memory: ~2GB for full-scale analysis
  • Storage: ~50MB for all results
  • Runtime: 7 minutes for M=1000 analysis

Framework Integration

All scripts integrate with the unified framework:

  • Uses existing core modules for computations
  • Follows framework documentation for Wave-CRISPR metrics
  • Compatible with framework's high-precision requirements
  • Outputs match framework's CSV format conventions

Files Generated

Core Data Files (Required Format)

  • spectral_form_factor_*.csv: [Ο„, K_tau, band_low, band_high] format
  • wave_crispr_scores_*.csv: Complete CRISPR disruption analysis
  • zeta_zeros_*.csv: Raw and unfolded Riemann zeta zeros

Analysis Files

  • summary_statistics_*.csv: Regime summary metrics
  • *.png: Comprehensive visualizations
  • regime_comparison_summary.csv: Cross-regime correlation data

Documentation

  • README.md: Complete usage and reproducibility guide
  • Inline code documentation for all functions
  • Parameter specifications for each regime

References

  • Unified Framework Z model documentation
  • Random Matrix Theory (Mehta, 2004)
  • Riemann zeta function (Edwards, 1974)
  • Wave-CRISPR spectral analysis framework
  • Bootstrap statistical methods (Efron & Tibshirani, 1993)
⚠️ **GitHub.com Fallback** ⚠️