Pandora Rule to Collibra Data Quality Metric Mapping - experianplc/experian-data-studio-connector-mulesoft GitHub Wiki
Below the mapping between Pandora rule attribute names and Data Quality Metric attributes is shown.
| Pandora Column Name | Collibra Attribute Name |
|---|---|
| Name | Name |
| Score | Passing Fraction |
| Measure | Unused |
| Passed Measure | Unused |
| Failed Measure | Unused |
| Rule Category | See [1] |
| Description | See [2] |
| Included | Unused |
| Filter | Unused |
| Rows Passed | Rows Passed |
| Rows Failed | Rows Failed |
| Table | Unused (not to be confused with External Table Name) |
| Table Version | Unused |
| Versions Offset | Unused |
| Column | Unused (not to be confused with External Column Name) |
| Schema | Unused |
| Function | Unused |
| Version | Unused |
| Parameters | Unused |
| Type | Unused |
| Rows Considered | Unused |
| Rows Ignored | Unused |
| Passed | Unused |
| Failed | Unused |
| Considered | Unused |
| Ignored | Unused |
| Category | Unused (not to be confused with Rule Category) |
| Table Created | Unused |
| Last Validated | Unused |
| Connection String | Unused |
| External Column Name | Used to associate to the Data Asset Domain under Column. See [3], e.g. Description |
| External Database | Used to associate to the Data Asset Domain. See [4], e.g. postgres |
| External Schema | Used to associate to the Data Asset Domain. See [4], e.g. public |
| External Table Name | Used to associate to the Data Asset Domain under Table. See [5], e.g. ALERTS |
| Fail Range | Unused |
| Failed Score | Unused |
| Latest Table Version | Unused |
| Pass Range (first number, if range) | Threshold |
| Result | Result |
| Rule Category Id | Unused |
| Rule Threshold | Unused |
In Collibra, Conformity Score and Non Conformity Score are the same as Rows Passed and Rows Failed.
[1] - The rule category is used to determine whether or not the Pandora Data Quality Rule is sent to Collibra as a Data Quality Metric. If the Rule Category assigned to a particular row exists in the testRuleCategories configuration option, it will not be sent.
[2] - The description is parsed in the following fashion. Collibra Rule.Collibra Dimension.Collibra Description. So for example, if the Description were Collibra Rule 2.Completeness.Is complete the Data Quality Metric would execute the rule Collibra Rule 2; be classified by the dimension Completeness and have a description Is complete
[3]
[4]
[5]
