Processing workflow

Data flow

  1. Discover a lidar measurement with lidarpy.utils.file_manager.
  2. Convert Licel binary files to NetCDF with lidarpy.nc_convert.measurement.
  3. Run basic preprocessing with lidarpy.preprocessing.lidar_preprocessing.
  4. Inspect products with lidarpy.plot.quicklook.
  5. Use synthetic signals to validate retrieval behavior independently from RAW fixtures.
Expected synthetic quicklook output
Expected quicklook style for a range-corrected synthetic elastic signal. Real measurement quicklooks should follow the same plotting contract.

Basic preprocessing currently covered by tests

Retrieval validation

Retrieval tests compare Klett, Raman extinction and Raman backscatter against synthetic truth in a useful range that avoids near-field and boundary regions.

Synthetic truth versus retrieved aerosol properties
Retrieval validation uses synthetic aerosol properties as the reference and compares them with properties inverted from synthetic elastic and Raman signals.
  • quasi_beta is a single-iteration approximation, not an exact inversion.
  • iterative_beta_forward can start above the first range bin when initial_particle_optical_depth is provided.
  • Reference intervals outside the range profile raise ValueError.
  • Elastic and Raman retrievals use a molecular reference interval above the synthetic aerosol layer.
  • LPDR is derived from polarized synthetic components and compared with the particle depolarization truth.

Open workflow boundaries

Advanced overlap correction and gluing products are handled as separate migration steps so they can be reviewed without changing the basic chain.