Functions Parser GenericParser FileAnalyserParser - SmartEnviroSystem/SmartDataPorter GitHub Wiki
The FileAnalyserParser discovers file information and stores them in datasets into database. It is implemented with Modules so new file analytics can be added quickly.
| Parameter | Description | Default | Optional |
|---|---|---|---|
| fileanalyser.module. | Activates / Deactivates analyser module | true | yes |
This parser reads the following data:
| Name | Description |
|---|---|
| ts | Timestamp of file creation (if available parses timestamp from filename) |
| name | Original file name |
| path | Path where to find the file, typically relative to docroot |
| origin_url | Path to the original file |
| origin_created | Timestamp of original create date |
| origin_modified | Timestamp of last modify date |
| size | Size in byte |
| mimetype | Mimetype of files content |
If activated the ExifMetadtaModule reads Exif data from image files and stores them in the dataset. Unless other configured (the above) all metadata is stored under the name exif_Section_Subname.
Configuration:
| Parameter | Description | Default | Optional |
|---|---|---|---|
| exif.Section.Subname | Imports the exif metadata into the given attribute | - | yes |
Example:
If your image contains EXIF Metadata with the name "User Comment" and this has a content like: "AVAL:12;BVAL: 99" Then you can configure two import mappings:
"exif.User Comment.aval" = "value_a",
"exif.User Comment.bval" = "value_b"
The StaticKeogramModule reads information for a Keogram from image files.
This module has no configuration.
This module reads the following data:
| Name | Description |
|---|---|
| keogram_line | Keogram line from middle line |
| keogram_column | Keogramm column from middle column |
| image_width | Image width (px) |
| image_height | Image height (px) |
The dynamic Keogramm modules calculate the sun position and create diagrams for this position.
Configuration:
| Parameter | Description | Default | Optional |
|---|---|---|---|
| dynkeogram.fisheye.cx | Horizontaler Mittelpunkt des Fisheye‑Bildes in Pixelkoordinaten. Wird für die Projektion der Sonnenposition benötigt. | - | no |
| dynkeogram.fisheye.cy | Vertikaler Mittelpunkt des Fisheye‑Bildes in Pixelkoordinaten. Bestimmt die Lage des optischen Zentrums. | - | no |
| dynkeogram.fisheye.k1 | Erster Fisheye‑Projektionskoeffizient. Bestimmt die lineare Beziehung zwischen Einfallswinkel und Bildradius. | - | no |
| dynkeogram.fisheye.k2 | Zweiter Fisheye‑Projektionskoeffizient. Modelliert nichtlineare Verzerrungen der Optik. | ||
| dynkeogram.fisheye.k3 | Dritter Fisheye‑Projektionskoeffizient. Korrigiert höhere Verzerrungsordnungen für präzisere Projektion. | - | no |
| dynkeogram.camera.roll | Rotation der Kamera um die optische Achse (Grad). Korrigiert Schiefstellung der Kamera. | ||
| dynkeogram.camera.pitch | Neigung der Kamera nach oben/unten (Grad). Bestimmt, wie stark der Himmel nach vorne/hinten gekippt ist. | ||
| dynkeogram.camera.yaw | Drehung der Kamera nach links/rechts (Grad). Bestimmt die horizontale Ausrichtung der Kamera. | ||
| dynkeogram.location.lat | Camera position (latitude) | ||
| dynkeogram.location.lon | Camera position (longitude) |
This module reads the following data:
| Name | Description |
|---|---|
| dynkeogram_ns_png | Keogram column crossing sun position |
| dynkeogram_ew_png | Keogram row crossing sun position |
| sun_azimuth | Calculated azimuth |
| sun_elevation | Calculated suns eleveation |
| sun_pixel_u | u coordinate for suns position |
| sun_pixel_v | v coordinate for suns position |
| image_width | Image width in pixel |
| image_height | Image height in pixel |
The HistogramModule creates hisograms from image files.
NOTICE: This module is deactivated
This module has no configuration.
This module reads the following data:
| Name | Description |
|---|---|
| hist_r | Histogram for red |
| hist_g | Histogram for green |
| hist_b | Histogram for blue |
| hist_luma | Histogram for lumination |
A specialised, experimental module for detecting clouds and cloud values.
NOTICE: This Module is deactivated
Configuration:
| Parameter | Description | Default | Optional |
|---|---|---|---|
| clouddetection.fisheye.radius | Radius that masks the area analysed | 820 | yes |
This module reads the following data:
| Name | Description |
|---|---|
| raw_brightness | Brightness in selected area |
| raw_saturation | Saturation in selected area |
| raw_contrast | Contrast in selecte area |
| raw_gradient | Gradient of lumination chance between pixels |
| raw_blue_ratio | Ratio of blue pixels in picture |
| raw_horizon_radius | Radius given with radius configuration |
| derived_cloud_coverage_analytic | cloud pixels / sky pixels |
| interpreted_cloud_class_analytic | cloud class "clear", "partly_cloudy", "mostly_cloudy", "cloudy", "overcast" |
| derived_cloud_coverage_visual | analytic cloud class wightened with histogram and blue percentage |
| interpreted_cloud_class_visual | cloud class "clear", "partly_cloudy", "mostly_cloudy", "cloudy", "overcast" |
| derived_fog_index | Estimated fog factor |
| derived_cloud_opacity | Estimated cloud opacity |
| derived_fragmentation | Estimated cloud fragmentation |
| derived_haze_index | Estimated haze possibility |
| derived_luma_hist_width | |
| derived_blue_peak_strength | |
| derived_saturation_hist_width | |
| derived_cloud_histogram_score | |
| interpreted_cloud_type | |
| interpreted_cloud_height | |
| interpreted_sky_clarity | |
| interpreted_cloud_temp_proxy |
This parser does not implement preconditions. It accepts all files.