Data Loading - AmericanManufacturingCohort/HR-CDM-Data-Transformation GitHub Wiki

We stored the resulting tabular data in the comma-separated values (CSV) format. Anyone who has access to the files should be able to load the data into their data analytics tool or data store using this format. Currently, we have some data loading functions written in the R language. The function requires a file path that points to the CSV file location, and it will produce a data frame in R.

The table below summarizes the data size and table size of each HR-CDM table:

Table Name	Data Size (# of rows)	Table Size (# of columns)
PERSON	231,813	18
EMPLOYEE	231,813	5
HR_EVENT	3,052,017	11
EMPLOYMENT_RECORD	3,052,017	22
WORK_SITE	1,079	3
LOCATION	1,079	8
SITE_HISTORY	19,422	10
SITE_EVENT	0	9

In addition to the core tables above, we created a derived-type table for a robust data analysis about the employment history. Specifically, we have included a new table called EMPLOYMENT_RECORD_MONTHLY_GRID where new monthly rows are automatically generated and inserted into the original EMPLOYMENT_RECORD table. The purpose of this treatment is to create a uniform time-spaced data set for each employee over the period of the year 1996 to 2013.

Table Name	Data Size (# of rows)	Table Size (# of columns)
EMPLOYMENT_RECORD_MONTHLY_GRID	41,629,310	22