Output Format Description for CSV2 - NOAA-OWP/wres GitHub Wiki

The WRES CSV is designed to facilitate use by machines. It emphasizes the use of a predictable set of columns, named appropriately (see below), to describe the output evaluation results, including metadata about the features (i.e., locations), variables, pooling windows for the pairs (statistics are computed for each pool), the metric and the statistic. Below, the expected output files are explained (two output files are generated), columns within the CSV file are defined, an example declaration is provided, and, finally, a partial example of an expected CSV is shown. The new CSV format contains all of the statistics for all declared metrics and, in that sense, is a β€œcomplete” format.

There is one CSV file per evaluation, which adopts a .csv.gz extension. Additionally, there is a .csvt file, which contains the data types of each column in the csv file. The .csvt file is used by GDAL-enabled software, such as QGIS to import the .csv file with the correct column classes. For example, when expanding the .csv.gz into a .csv and placing alongside the .csvt, you may drag-and-drop the .csv file into the QGIS β€œLayers” dialog and the CSV file will import (version tried: QGIS 3.10.2 Long-Term Release). If the CSV file contains a Well Known Text (WKT) representations of each evaluated geometry (e.g., if the evaluation requested data from the USGS National Water Information System, which reports the location of each river gauge), then the geometries should be imported directly and displayed as a map.

What are the two output files?

When generating the WRES CSV output, two files will be created:

evaluation.csv.gz: The evaluation output in a CSV format, columns defined below.

evaluation.csvt: A file defining the data types of each column for use in GDAL-enabled software, such as QGIS. The contents of the .csvt file is fixed across all evaluations (per CSV version) and is:

"String","String","String","String","String","Integer","String","String","WKT","Integer","String","String","WKT","Integer","String","String","WKT","Integer","String","String","String","String","String","String","String","String","String","String","String","String","Real","Real","String","Real","Real","String","String","String","Real","Real","String","Real","Real","String","String","String","String","String","String","Real","Real","Real","Integer","String","String","String","String","Real","Real","Real"

What are the columns of the CSV file?

The column names and data types are summarized below. Where helpful, a brief description is also provided. In this context, LEFT refers to data provided in the observed input source and is typically observations or simulations; RIGHT refers to data provided in the predicted source and is typically forecasts or simulations; and BASELINE refers to data provided in the baseline source and is typically of the same type as the right.

Column name Data type Description
LEFT VARIABLE NAME String For example, SQIN.
RIGHT VARIABLE NAME String
BASELINE VARIABLE NAME String
COVARIATE FILTERS String A string representation of the covariate filter(s) used to select the paired data.
POOL NUMBER Integer Evaluation pairs are gathered into pools for computing statistics. Each pool is assigned a number.
EVALUATION SUBJECT String The subject of the evaluation. This is typically the RIGHT dataset, but could be the BASELINE dataset when statistics are requested separately for the BASELINE dataset.
LEFT FEATURE NAME String For example, DRRC2 (an NWS feature name that corresponds to the Dolores River below Rico, CO).
LEFT FEATURE WKT WKT-formatted String A Well-Known Text (WKT) representation of a geometry for the LEFT dataset. See: https://en.wikipedia.org/wiki/Well-known_text_representation_of_geometry
LEFT FEATURE SRID Integer A Spatial Reference Identifier (SRID) for the LEFT dataset WKT. See: https://en.wikipedia.org/wiki/Spatial_reference_system#Identifiers
LEFT FEATURE DESCRIPTION String For example, DOLORES RIVER BELOW RICO, CO.
RIGHT FEATURE NAME String
RIGHT FEATURE WKT WKT-formatted String Same as as LEFT FEATURE WKT, but for the right source.
RIGHT FEATURE SRID Integer Same as LEFT FEATURE SRID, but for the right source.
RIGHT FEATURE DESCRIPTION String
BASELINE FEATURE NAME String
BASELINE FEATURE WKT WKT-formatted String Same as LEFT FEATURE WKT, but for the baseline source.
BASELINE FEATURE SRID Integer Same as LEFT FEATURE SRID, but for the baseline source.
BASELINE FEATURE DESCRIPTION String
EARLIEST ISSUED TIME EXCLUSIVE ISO-8601-formatted String For the pool corresponding to this row, it is the lower bound on the forecast issued time (a.k.a., forecast time, T0, reference time, etc.), which is exclusive. A value of -1000000000-01-01T00:00:00Z implies that it was unbounded.
LATEST ISSUED TIME INCLUSIVE ISO-8601-formatted String For the pool corresponding to this row, it is the upper bound on the forecast issued time (a.k.a., forecast time, T0, reference time, etc.), which is inclusive. A value of +1000000000-01-01T00:00:00Z implies that it was unbounded.
EARLIEST VALID TIME EXCLUSIVE ISO-8601-formatted String For the pool corresponding to this row, it is the lower bound on the valid time (a.k.a., observation time, forecast valid time, etc.), which is exclusive. A value of -1000000000-01-01T00:00:00Z implies that it was unbounded.
LATEST VALID TIME INCLUSIVE ISO-8601-formatted String For the pool corresponding to this row, it is the upper bound on the valid time (a.k.a., observation time, forecast valid time, etc.), which is inclusive. A value of +1000000000-01-01T00:00:00Z implies that it was unbounded.
EARLIEST LEAD DURATION EXCLUSIVE ISO-8601-formatted String For the pool corresponding to this row, it is the lower bound on the forecast lead duration (a.k.a., lead time), which is exclusive.
LATEST LEAD DURATION INCLUSIVE ISO-8601-formatted String For the pool corresponding to this row, it is the upper bound on the forecast lead duration (a.k.a., lead time), which is inclusive.
TIME SCALE DURATION ISO-8601-formatted String In conjunction with the TIME SCALE FUNCTION, this defines the time scale at which the evaluation is performed.
TIME SCALE FUNCTION String In conjunction with the TIME SCALE DURATION, this defines the time scale at which the evaluation is performed.
EVENT THRESHOLD NAME String A user- or service-assigned name for the event threshold, such as BANKFULL.
EVENT THRESHOLD LOWER VALUE Float The lower bound of an event threshold that contains two bounds (i.e., capturing a value that lies BETWEEN the two bounds), else the single bound.
EVENT THRESHOLD UPPER VALUE Float The upper bound of an event threshold that contains two bounds (i.e., capturing a value that lies BETWEEN the two bounds).
EVENT THRESHOLD UNITS String For example, CMS.
EVENT THRESHOLD LOWER PROBABILITY Float The probability associated with the EVENT THRESHOLD LOWER VALUE, if applicable.
EVENT THRESHOLD UPPER PROBABILITY Float The probability associated with the EVENT THRESHOLD UPPER VALUE, if applicable.
EVENT THRESHOLD SIDE String The side(s) of data to which the event threshold refers. For example, LEFT AND RIGHT.
EVENT THRESHOLD OPERATOR String For example, GREATER.
DECISION THRESHOLD NAME String A user- or service-assigned name for the decision threshold, such as HIGH. The decision threshold is used to classify probability data into a binary outcome.
DECISION THRESHOLD LOWER VALUE Float The lower bound of a decision threshold that contains two bounds (i.e., capturing a value that lies BETWEEN the two bounds), else the single bound.
DECISION THRESHOLD UPPER VALUE Float The upper bound of a decision threshold that contains two bounds (i.e., capturing a value that lies BETWEEN the two bounds).
DECISION THRESHOLD UNITS String Always PROBABILITY.
DECISION THRESHOLD LOWER PROBABILITY Float The probability associated with the DECISION THRESHOLD LOWER VALUE, which is the same as the DECISION THRESHOLD LOWER VALUE where defined (the decision threshold is a probability classifier).
DECISION THRESHOLD UPPER PROBABILITY Float The probability associated with the DECISION THRESHOLD UPPER VALUE, which is the same as the DECISION THRESHOLD UPPER VALUE where defined (the decision threshold is a probability classifier).
DECISION THRESHOLD SIDE String The side of data to which the decision threshold refers.
DECISION THRESHOLD OPERATOR String
METRIC NAME String For example, CONTINUOUS RANKED PROBABILITY SCORE.
METRIC COMPONENT NAME String When a metric has several components, the name of the component described in this row of data is given here. For example, The QUANTILE QUANTILE DIAGRAM has two components: the OBSERVED QUANTILES and the PREDICTED QUANTILES.
METRIC COMPONENT QUALIFIER String When a metric has several identical components, this qualifier distinguishes them. For example, The ENSEMBLE QUANTILE QUANTILE DIAGRAM has two components for each ensemble member index: the OBSERVED QUANTILES and the PREDICTED QUANTILES. In this case, the METRIC COMPONENT QUALIFIER contains the ensemble member label. When the metric is computed for an ensemble average, this field contains the averaging function used, e.g., ENSEMBLE MEAN. Added in v5.11.
METRIC COMPONENT UNITS String For example, CMS.
METRIC COMPONENT MINIMUM Float The smallest possible value of the statistic for this metric component.
METRIC COMPONENT MAXIMUM Float The largest possible value of the statistic for this metric component.
METRIC COMPONENT OPTIMUM Float The optimal value of the statistic for this metric component. For example, the optimal value of the PEARSON CORRELATION COEFFICIENT is 1.0.
STATISTIC GROUP NUMBER Integer A unique identifier for a group of statistics that belong together. For example, a BOX PLOT OF ERRORS BY FORECAST VALUE contains several whiskers, each one with a separate row. These whiskers belong together because they form one box and will have a common STATISTIC GROUP NUMBER.
SUMMARY STATISTIC NAME String The name of the metric used to calculate the summary statistic. For example, a HISTOGRAM.
SUMMARY STATISTIC COMPONENT NAME String The name of the metric component for the summary statistic. For example, a histogram is composed of two components, namely the BIN UPPER BOUND and the COUNT.
SUMMARY STATISTIC UNITS String The measurement units in which the summary statistic is expressed (e.g., CMS).
SUMMARY STATISTIC DIMENSION String The named dimension for which the summary statistic was computed (e.g., FEATURES represents all geographic features within the evaluation).
SUMMARY STATISTIC QUANTILE Float A value greater than zero and less than one that represents the quantile of the sampling distribution of the summary statistic.
SAMPLE QUANTILE Float A value greater than zero and less than one that represents the sample quantile associated with the statistic (i.e., the quantile within the sampling distribution of the statistic). This is only present when sampling uncertainties have been estimated explicitly and is otherwise empty.
STATISTIC Float The actual statistic.

Declaration

The following is an example of the declaration needed to instruct the WRES to output the CSV format:

output_formats: csv2

The csv2 refers to the WRES CSV output format. Other attributes impact the formatting of output written to the WRES CSV, as well as other output formats such as 'png':

decimal_format: The number of decimal places desired for output statistics. For example: 0.000000.
duration_format: The unit of time to use in the output, such as 'hours'.

decimal_format: '0.000000'
duration_format: hours
output_formats:
  - csv2
  - png

Example:

The following is an example of the CSV2 output:

LEFT VARIABLE NAME,RIGHT VARIABLE NAME,BASELINE VARIABLE NAME,COVARIATE FILTERS,POOL NUMBER,EVALUATION SUBJECT,LEFT FEATURE NAME,LEFT FEATURE WKT,LEFT FEATURE SRID,LEFT FEATURE DESCRIPTION,RIGHT FEATURE NAME,RIGHT FEATURE WKT,RIGHT FEATURE SRID,RIGHT FEATURE DESCRIPTION,BASELINE FEATURE NAME,BASELINE FEATURE WKT,BASELINE FEATURE SRID,BASELINE FEATURE DESCRIPTION,EARLIEST ISSUED TIME EXCLUSIVE,LATEST ISSUED TIME INCLUSIVE,EARLIEST VALID TIME EXCLUSIVE,LATEST VALID TIME INCLUSIVE,EARLIEST LEAD DURATION EXCLUSIVE,LATEST LEAD DURATION INCLUSIVE,TIME SCALE DURATION,TIME SCALE FUNCTION,EVENT THRESHOLD NAME,EVENT THRESHOLD LOWER VALUE,EVENT THRESHOLD UPPER VALUE,EVENT THRESHOLD UNITS,EVENT THRESHOLD LOWER PROBABILITY,EVENT THRESHOLD UPPER PROBABILITY,EVENT THRESHOLD SIDE,EVENT THRESHOLD OPERATOR,DECISION THRESHOLD NAME,DECISION THRESHOLD LOWER VALUE,DECISION THRESHOLD UPPER VALUE,DECISION THRESHOLD UNITS,DECISION THRESHOLD LOWER PROBABILITY,DECISION THRESHOLD UPPER PROBABILITY,DECISION THRESHOLD SIDE,DECISION THRESHOLD OPERATOR,METRIC NAME,METRIC COMPONENT NAME,METRIC COMPONENT QUALIFIER,METRIC COMPONENT UNITS,METRIC COMPONENT MINIMUM,METRIC COMPONENT MAXIMUM,METRIC COMPONENT OPTIMUM,STATISTIC GROUP NUMBER,SUMMARY STATISTIC NAME,SUMMARY STATISTIC COMPONENT NAME,SUMMARY STATISTIC UNITS,SUMMARY STATISTIC DIMENSION,SUMMARY STATISTIC QUANTILE,SAMPLE QUANTILE,STATISTIC
streamflow,streamflow,,,1,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT17H,PT17H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,COEFFICIENT OF DETERMINATION,MAIN,,DIMENSIONLESS,0.0,1.0,1.0,1,,,,,,,0.1534782395406544
streamflow,streamflow,,,1,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT17H,PT17H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,PEARSON CORRELATION COEFFICIENT,MAIN,,DIMENSIONLESS,-1.0,1.0,1.0,2,,,,,,,-0.3917629889877991
streamflow,streamflow,,,1,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT17H,PT17H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,MEAN SQUARE ERROR,MAIN,,CMS,0.0,Infinity,0.0,3,,,,,,,0.08557104128471933
streamflow,streamflow,,,1,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT17H,PT17H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,ROOT MEAN SQUARE ERROR,MAIN,,CMS,0.0,Infinity,0.0,4,,,,,,,0.2925252831546691
streamflow,streamflow,,,1,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT17H,PT17H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,BIAS FRACTION,MAIN,,DIMENSIONLESS,-Infinity,Infinity,0.0,5,,,,,,,1.5979759616040214
streamflow,streamflow,,,1,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT17H,PT17H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,MEAN ABSOLUTE ERROR,MAIN,,CMS,0.0,Infinity,0.0,6,,,,,,,0.2916527890656166
streamflow,streamflow,,,1,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT17H,PT17H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,MEAN ERROR,MAIN,,CMS,-Infinity,Infinity,0.0,7,,,,,,,0.2916527890656166
streamflow,streamflow,,,1,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT17H,PT17H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,SAMPLE SIZE,MAIN,,COUNT,-Infinity,Infinity,0.0,8,,,,,,,24.0
streamflow,streamflow,,,2,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT10H,PT10H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,COEFFICIENT OF DETERMINATION,MAIN,,DIMENSIONLESS,0.0,1.0,1.0,9,,,,,,,0.4242742314172851
streamflow,streamflow,,,2,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT10H,PT10H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,PEARSON CORRELATION COEFFICIENT,MAIN,,DIMENSIONLESS,-1.0,1.0,1.0,10,,,,,,,0.6513633635823288
streamflow,streamflow,,,2,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT10H,PT10H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,MEAN SQUARE ERROR,MAIN,,CMS,0.0,Infinity,0.0,11,,,,,,,0.09739978853406782
streamflow,streamflow,,,2,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT10H,PT10H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,ROOT MEAN SQUARE ERROR,MAIN,,CMS,0.0,Infinity,0.0,12,,,,,,,0.31208939189608453
streamflow,streamflow,,,2,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT10H,PT10H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,BIAS FRACTION,MAIN,,DIMENSIONLESS,-Infinity,Infinity,0.0,13,,,,,,,1.7343376726368764
streamflow,streamflow,,,2,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT10H,PT10H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,MEAN ABSOLUTE ERROR,MAIN,,CMS,0.0,Infinity,0.0,14,,,,,,,0.31185468821686363
streamflow,streamflow,,,2,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT10H,PT10H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,MEAN ERROR,MAIN,,CMS,-Infinity,Infinity,0.0,15,,,,,,,0.31185468821686363
streamflow,streamflow,,,2,RIGHT,07160500,POINT ( -97.5850471 36.06004045 ),4326,"Skeleton Creek near Lovell, OK",251482,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT10H,PT10H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,SAMPLE SIZE,MAIN,,COUNT,-Infinity,Infinity,0.0,16,,,,,,,24.0
streamflow,streamflow,,,3,RIGHT,07160350,POINT ( -97.8003332 36.3761449 ),4326,"Skeleton Creek at Enid, OK",250456,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT15H,PT15H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,COEFFICIENT OF DETERMINATION,MAIN,,DIMENSIONLESS,0.0,1.0,1.0,17,,,,,,,NaN
streamflow,streamflow,,,3,RIGHT,07160350,POINT ( -97.8003332 36.3761449 ),4326,"Skeleton Creek at Enid, OK",250456,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT15H,PT15H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,PEARSON CORRELATION COEFFICIENT,MAIN,,DIMENSIONLESS,-1.0,1.0,1.0,18,,,,,,,NaN
streamflow,streamflow,,,3,RIGHT,07160350,POINT ( -97.8003332 36.3761449 ),4326,"Skeleton Creek at Enid, OK",250456,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT15H,PT15H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,MEAN SQUARE ERROR,MAIN,,CMS,0.0,Infinity,0.0,19,,,,,,,0.49567358637098435
streamflow,streamflow,,,3,RIGHT,07160350,POINT ( -97.8003332 36.3761449 ),4326,"Skeleton Creek at Enid, OK",250456,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT15H,PT15H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,ROOT MEAN SQUARE ERROR,MAIN,,CMS,0.0,Infinity,0.0,20,,,,,,,0.7040408982232385
streamflow,streamflow,,,3,RIGHT,07160350,POINT ( -97.8003332 36.3761449 ),4326,"Skeleton Creek at Enid, OK",250456,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT15H,PT15H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,BIAS FRACTION,MAIN,,DIMENSIONLESS,-Infinity,Infinity,0.0,21,,,,,,,4.810818740041824
streamflow,streamflow,,,3,RIGHT,07160350,POINT ( -97.8003332 36.3761449 ),4326,"Skeleton Creek at Enid, OK",250456,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT15H,PT15H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,MEAN ABSOLUTE ERROR,MAIN,,CMS,0.0,Infinity,0.0,22,,,,,,,0.7037211298396339
streamflow,streamflow,,,3,RIGHT,07160350,POINT ( -97.8003332 36.3761449 ),4326,"Skeleton Creek at Enid, OK",250456,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT15H,PT15H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,MEAN ERROR,MAIN,,CMS,-Infinity,Infinity,0.0,23,,,,,,,0.7037211298396339
streamflow,streamflow,,,3,RIGHT,07160350,POINT ( -97.8003332 36.3761449 ),4326,"Skeleton Creek at Enid, OK",250456,,,,,,,,2017-08-07T23:59:59Z,2017-08-08T23:00:00Z,2017-08-07T00:00:00Z,2017-08-10T00:00:00Z,PT15H,PT15H,PT1M,UNKNOWN,,-Infinity,,,,,LEFT AND RIGHT,GREATER,,,,,,,,,SAMPLE SIZE,MAIN,,COUNT,-Infinity,Infinity,0.0,,,,,,,24,19.0

In a table format, it would appear as follows:

LEFT VARIABLE NAME RIGHT VARIABLE NAME BASELINE VARIABLE NAME COVARIATE FILTERS POOL NUMBER EVALUATION SUBJECT LEFT FEATURE NAME LEFT FEATURE WKT LEFT FEATURE SRID LEFT FEATURE DESCRIPTION RIGHT FEATURE NAME RIGHT FEATURE WKT RIGHT FEATURE SRID RIGHT FEATURE DESCRIPTION BASELINE FEATURE NAME BASELINE FEATURE WKT BASELINE FEATURE SRID BASELINE FEATURE DESCRIPTION EARLIEST ISSUED TIME EXCLUSIVE LATEST ISSUED TIME INCLUSIVE EARLIEST VALID TIME EXCLUSIVE LATEST VALID TIME INCLUSIVE EARLIEST LEAD DURATION EXCLUSIVE LATEST LEAD DURATION INCLUSIVE TIME SCALE DURATION TIME SCALE FUNCTION EVENT THRESHOLD NAME EVENT THRESHOLD LOWER VALUE EVENT THRESHOLD UPPER VALUE EVENT THRESHOLD UNITS EVENT THRESHOLD LOWER PROBABILITY EVENT THRESHOLD UPPER PROBABILITY EVENT THRESHOLD SIDE EVENT THRESHOLD OPERATOR DECISION THRESHOLD NAME DECISION THRESHOLD LOWER VALUE DECISION THRESHOLD UPPER VALUE DECISION THRESHOLD UNITS DECISION THRESHOLD LOWER PROBABILITY DECISION THRESHOLD UPPER PROBABILITY DECISION THRESHOLD SIDE DECISION THRESHOLD OPERATOR METRIC NAME METRIC COMPONENT NAME METRIC COMPONENT QUALIFIER METRIC COMPONENT UNITS METRIC COMPONENT MINIMUM METRIC COMPONENT MAXIMUM METRIC COMPONENT OPTIMUM STATISTIC GROUP NUMBER SUMMARY STATISTIC NAME SUMMARY STATISTIC COMPONENT NAME SUMMARY STATISTIC UNITS SUMMARY STATISTIC DIMENSION SUMMARY STATISTIC QUANTILE SAMPLE QUANTILE STATISTIC
streamflow streamflow 1 RIGHT 07160500 POINT ( –97.5850471 36.06004045 ) 4326 Skeleton Creek near Lovell, OK 251482 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT17H PT17H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER COEFFICIENT OF DETERMINATION MAIN DIMENSIONLESS 0.0 1.0 1.0 1 0.1534782395406544
streamflow streamflow 1 RIGHT 07160500 POINT ( –97.5850471 36.06004045 ) 4326 Skeleton Creek near Lovell, OK 251482 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT17H PT17H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER PEARSON CORRELATION COEFFICIENT MAIN DIMENSIONLESS –1.0 1.0 1.0 2 – 0.3917629889877991
streamflow streamflow 1 RIGHT 07160500 POINT ( –97.5850471 36.06004045 ) 4326 Skeleton Creek near Lovell, OK 251482 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT17H PT17H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER MEAN SQUARE ERROR MAIN CMS 0.0 Infinity 0.0 3 0.08557104128471933
streamflow streamflow 1 RIGHT 07160500 POINT ( –97.5850471 36.06004045 ) 4326 Skeleton Creek near Lovell, OK 251482 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT17H PT17H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER ROOT MEAN SQUARE ERROR MAIN CMS 0.0 Infinity 0.0 4 0.2925252831546691
streamflow streamflow 1 RIGHT 07160500 POINT ( –97.5850471 36.06004045 ) 4326 Skeleton Creek near Lovell, OK 251482 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT17H PT17H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER BIAS FRACTION MAIN DIMENSIONLESS -Infinity Infinity 0.0 5 1.5979759616040214
streamflow streamflow 1 RIGHT 07160500 POINT ( –97.5850471 36.06004045 ) 4326 Skeleton Creek near Lovell, OK 251482 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT17H PT17H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER MEAN ABSOLUTE ERROR MAIN CMS 0.0 Infinity 0.0 6 0.2916527890656166
streamflow streamflow 1 RIGHT 07160500 POINT ( –97.5850471 36.06004045 ) 4326 Skeleton Creek near Lovell, OK 251482 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT17H PT17H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER MEAN ERROR MAIN CMS -Infinity Infinity 0.0 7 0.2916527890656166
streamflow streamflow 1 RIGHT 07160500 POINT ( –97.5850471 36.06004045 ) 4326 Skeleton Creek near Lovell, OK 251482 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT17H PT17H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER SAMPLE SIZE MAIN COUNT -Infinity Infinity 0.0 8 24.0
streamflow streamflow 2 RIGHT 07160500 POINT ( –97.5850471 36.06004045 ) 4326 Skeleton Creek near Lovell, OK 251482 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT10H PT10H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER COEFFICIENT OF DETERMINATION MAIN DIMENSIONLESS 0.0 1.0 1.0 9 0.4242742314172851
streamflow streamflow 2 RIGHT 07160500 POINT ( –97.5850471 36.06004045 ) 4326 Skeleton Creek near Lovell, OK 251482 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT10H PT10H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER PEARSON CORRELATION COEFFICIENT MAIN DIMENSIONLESS –1.0 1.0 1.0 10 0.6513633635823288
streamflow streamflow 2 RIGHT 07160500 POINT ( –97.5850471 36.06004045 ) 4326 Skeleton Creek near Lovell, OK 251482 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT10H PT10H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER MEAN SQUARE ERROR MAIN CMS 0.0 Infinity 0.0 11 0.09739978853406782
streamflow streamflow 2 RIGHT 07160500 POINT ( –97.5850471 36.06004045 ) 4326 Skeleton Creek near Lovell, OK 251482 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT10H PT10H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER ROOT MEAN SQUARE ERROR MAIN CMS 0.0 Infinity 0.0 12 0.31208939189608453
streamflow streamflow 2 RIGHT 07160500 POINT ( –97.5850471 36.06004045 ) 4326 Skeleton Creek near Lovell, OK 251482 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT10H PT10H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER BIAS FRACTION MAIN DIMENSIONLESS -Infinity Infinity 0.0 13 1.7343376726368764
streamflow streamflow 2 RIGHT 07160500 POINT ( –97.5850471 36.06004045 ) 4326 Skeleton Creek near Lovell, OK 251482 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT10H PT10H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER MEAN ABSOLUTE ERROR MAIN CMS 0.0 Infinity 0.0 14 0.31185468821686363
streamflow streamflow 2 RIGHT 07160500 POINT ( –97.5850471 36.06004045 ) 4326 Skeleton Creek near Lovell, OK 251482 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT10H PT10H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER MEAN ERROR MAIN CMS -Infinity Infinity 0.0 15 0.31185468821686363
streamflow streamflow 2 RIGHT 07160500 POINT ( –97.5850471 36.06004045 ) 4326 Skeleton Creek near Lovell, OK 251482 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT10H PT10H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER SAMPLE SIZE MAIN COUNT -Infinity Infinity 0.0 16 24.0
streamflow streamflow 3 RIGHT 07160350 POINT ( –97.8003332 36.3761449 ) 4326 Skeleton Creek at Enid, OK 250456 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT15H PT15H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER COEFFICIENT OF DETERMINATION MAIN DIMENSIONLESS 0.0 1.0 1.0 17 NaN
streamflow streamflow 3 RIGHT 07160350 POINT ( –97.8003332 36.3761449 ) 4326 Skeleton Creek at Enid, OK 250456 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT15H PT15H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER PEARSON CORRELATION COEFFICIENT MAIN DIMENSIONLESS –1.0 1.0 1.0 18 NaN
streamflow streamflow 3 RIGHT 07160350 POINT ( –97.8003332 36.3761449 ) 4326 Skeleton Creek at Enid, OK 250456 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT15H PT15H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER MEAN SQUARE ERROR MAIN CMS 0.0 Infinity 0.0 19 0.49567358637098435
streamflow streamflow 3 RIGHT 07160350 POINT ( –97.8003332 36.3761449 ) 4326 Skeleton Creek at Enid, OK 250456 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT15H PT15H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER ROOT MEAN SQUARE ERROR MAIN CMS 0.0 Infinity 0.0 20 0.7040408982232385
streamflow streamflow 3 RIGHT 07160350 POINT ( –97.8003332 36.3761449 ) 4326 Skeleton Creek at Enid, OK 250456 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT15H PT15H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER BIAS FRACTION MAIN DIMENSIONLESS -Infinity Infinity 0.0 21 4.810818740041824
streamflow streamflow 3 RIGHT 07160350 POINT ( –97.8003332 36.3761449 ) 4326 Skeleton Creek at Enid, OK 250456 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT15H PT15H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER MEAN ABSOLUTE ERROR MAIN CMS 0.0 Infinity 0.0 22 0.7037211298396339
streamflow streamflow 3 RIGHT 07160350 POINT ( –97.8003332 36.3761449 ) 4326 Skeleton Creek at Enid, OK 250456 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT15H PT15H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER MEAN ERROR MAIN CMS -Infinity Infinity 0.0 23 0.7037211298396339
streamflow streamflow 3 RIGHT 07160350 POINT ( –97.8003332 36.3761449 ) 4326 Skeleton Creek at Enid, OK 250456 2017-08-07T23:59:59Z 2017-08-08T23:00:00Z 2017-08-07T00:00:00Z 2017-08-10T00:00:00Z PT15H PT15H PT1M UNKNOWN -Infinity LEFT AND RIGHT GREATER SAMPLE SIZE MAIN COUNT -Infinity Infinity 0.0 24 19.0