Perf (test dataset) - wolfiex/AerVis GitHub Wiki

Desktop Profiling test

4 cores 2014 mac

ACURE_PPE_001_bs714a - 1 month 1GB

Reading time

 2.00 minutes: 2 files 263 cubes

Writing time

7.41 minutes - written to /Users/wolfiex/UKCA_postproc/data/ACURE_PPE_001_bs714a.nc

bk417a -4 months .pp 2GB total

Reading time

---- Reading data for bk417a ----
 2.60 minutes: 5 files 177 cubes

Write and process

2.4GB file:  8.23 minutes - written to /Users/wolfiex/UKCA_postproc/data/bk417a.nc

Loading NC file

loading entire file into memory (lazy=False) or lazy loading.

This option was removed in favour of lazy loading every time. Use .data = .data.load() to get everything.

            In [2]: d = AerData('bk417a',lazy=False)                                    
            ---- Loading File ---- : /Users/wolfiex/UKCA_postproc/data/bk417a.nc
             30.91 loadtime - lazy: False

            In [3]: d = AerData('bk417a',lazy=True)                                   
            ---- Loading File ---- : /Users/wolfiex/UKCA_postproc/data/bk417a.nc
             0.05 loadtime - lazy: True
⚠️ **GitHub.com Fallback** ⚠️