DVP Configuration - anodot/daria GitHub Wiki

Defines the way missing data points will be completed in the Anodot schema

Supported Integrations

If needed the DVP configuration object could be added to Pipeline configuration:

Clickhouse, File\Directory, Impala, Microsoft SQL, MongoDB, MySQL, Oracle, PostgreSQL, PromQL, Sage, Victoriametrics, Kafka

Properties list

Property Required Value type Description
dvpConfig no Object Indicates DVP should be used
baseRollup yes String Defines which is the minimal Anodot rollup to complete the data for. The possible values are: SHORTROLLUP (1 minute), MEDIUMROLLUP (5 minutes), LONGROLLUP (1 hour), LONGLONGROLLUP (1 day), WEEKLY (1 week). Default: MEDIUMROLLUP
maxDVPDurationHours yes Integer The number of hours Anodot will complete missing data points for a metric. The maximal completion period depends on the stream's interval. Daily streams can be filled up to 31 days (744 hours), hourly streams up to 7 days (168 hours) and less than hourly streams can be filled up to 1 day (24 hours)
preventNoData no Boolean Keep this as "true". If not provided, will be set automatically
gaugeValue / counterValue no Object The definition for gauge (average) or counter (sum) aggregation type measures in the stream related to this schema
keepLastValue no Boolean True - use the last received value as the completion value. False - set the completion value manually. Default: false
value no Float The completion value to use, in case keepLastValue is false. Default: 0.0

Example 1

For the last 24 hours with a 1-hour period missing counter values filled with 10.0 and gauge values with 0.0

"dvpConfig": {
  "baseRollup": "LONGROLLUP",
  "maxDVPDurationHours": 24,
  "gaugeValue": {
    "value": 0.0
  },
  "counterValue": {
    "value": 10.0
  }
}

Example 2

For the last 168 hours with a 1-day period missing counter values filled with 0.0 and gauge values with last appeared

"dvpConfig": {
  "baseRollup": "LONGLONGROLLUP",
  "maxDVPDurationHours": 168,
  "preventNoData": true,
  "gaugeValue": {
    "keepLastValue": true,
    "value": 0.0
  },
  "counterValue": {
    "keepLastValue": false,
    "value": 0.0
  }
}