1.8.08142020 - National-Clinical-Cohort-Collaborative/Data-Ingestion-and-Harmonization GitHub Wiki
-
Added site 16000 to N3C Enclave.
-
Site 10000, facility type information is getting clipped to the size of the care_site_source_value field length.
-
The care_site_id is getting mapped to the facility_type ids in encounter, but found places where this was not getting translated properly. Fixed the issue but it will exist in the data set that was processed prior to this fix. Added facility_type_id check in the encounter source cdmh_staging stored proc.
-
High percentage of condition_type_concept_id is not getting assigned in PCORnet CDM. This is a known issue.
-
Some percentage of data will now have missing encounter ids for lab_results and procedures. Encounter id is not null constraint that was previously set has been removed from the PCORnet CDM.
-
Added site 17000 to N3C Enclave.
DQD FAILED cases for site 17000:
- The 99 percent of records that have a value in the discharge_to_concept_id field in the VISIT_OCCURRENCE table that do not conform to the Visit domain. (Threshold=0%).
- 96 percent of records that have a value in the condition_type_concept_id field in the CONDITION_OCCURRENCE table that do not conform to the Type Concept domain. (Threshold=0%).
- 86 percent of records with a value of 0 in the standard concept field observation_type_concept_id in the OBSERVATION table. (Threshold=0%).
- 52 percent of records that have a value in the observation_type_concept_id field in the OBSERVATION table that do not conform to the Type Concept domain. (Threshold=0%).
- 40 percent of records with a value of 0 in the standard concept field unit_concept_id in the OBSERVATION table. (Threshold=5%).
- 37 percent of records that have a value in the admitting_source_concept_id field in the VISIT_OCCURRENCE table that do not conform to the Visit domain. (Threshold=0%).