Peer Reviewing and Updating the Data Download Files - DOI-ONRR/nrrd GitHub Wiki
Monthly Updates
Data file preparation
Please follow these steps for peer reviewing when receiving new monthly files and combining the new numbers with the old numbers.
-
New source file (production and revenue files come from DORC team, disbursements file comes from Financial Management): copy the data and note the number of lines copied. For the production monthly file, copy all the months. For the revenue and disbursements monthly file, copy most recent month.
-
Combined source file (file comes from DORC and NRRD download): note the total number of lines before pasting the new data.
-
Paste the new data to the combined source file.
-
After pasting, check the new total number of lines is adding up to the previous total number of lines (step 2) plus the new number of lines added (step 1).
-
Check the dates format is consistent.
-
Check the non-date cells to make sure that they are formatted correctly.
-
Check all the columns were pasted correctly.
-
Check the sum of the revenue/disbursements/volume columns match.
-
Save the new combined source file.
Data file names:
- production_volumes.xlxs
- production_volumes.csv
- revenue_volumes.xlxs
- revenue_volumes.csv
- disbursements-by-month.xlxs
- disbursements-by-month.csv
Updating Data on the NRRD website with download files:
- Review file and ensure the following names match:
- File Name
- Sheet Name
- Column Names
- Data values that are strings (Example: Onshore, Offshore, Oil & Gas, etc...)
- Open Github Desktop or other favorite tool
- Switch to dev branch and pull the latest changes
- Create a new branch in our github repository from the dev branch
- Update the download file with the new file
- Files are currently located in \nrrd\static\downloads
- Commit changes
- Open the new branch in Atom and update file sizes and months in \nrrd\src\pages\downloads
- Commit changes
- Push changes
- Review changes on preview link
- If changes look correct, create a pull request to merge the branch into dev and add your reviewers
- Once approved merge the changes
Data checklist once the database is updated:
Once the database is updated with the new files, this is the checklist to use to make sure all of the data-driven information on the website is correct.
Production Monthly
Homepage
- Monthly bar charts
- CY bar charts
- FY bar charts
- Source file links
Download
- xls and csv files updated with correct dates and file size
Production Calendar Year or Fiscal Year
Explore data filters
- Switch between state and county
- Show offshore
- Switch between FY and CY
- Choose different commodities
- Add Nationwide federal card
- Add Native American Card
Explore data accuracy
- Select different commodities
- Select different years, correct FY or CY displaying
- Summary Cards: correct state title, correct county & state title, trendline, accurate year, correct abbreviation for commodity selected
- Nationwide Federal Card: % of federal land, total production for specified year, trendline, accurate year, production over time trendline data, top locations data
- Detailed state cards: % of federal land, total production for specified year, correct state title, trendline, total production for specified year, top county data, counties map
- Detailed county cards: correct county & state title, total production for specified year, trendline, accurate year, production overtimes trendline
- Native American card: total production for specified year, trendline, accurate year, production overtime trendline
- Offshore card: total production for specified year, trendline, accurate year, production overtime trendline
- Check cards for states with no data
- Production over time trend line data
- Top Nationwide locations data
Query Data
- Land type filter
- State/Offshore region filter
- County filter
- Commodity filter
- Grouping
- Change between fiscal and calendar year and change years
- Download matches selected data
Revenue Monthly
Homepage
- Revenue trends line chart
- CY bar charts
- FY bar charts
- Monthly bar charts
- Source links
Download Page
- xls and csv files updated with correct dates and file size
Revenue Calendar Year or Fiscal year
Explore data filters
- Switch between state and county
- Show offshore
- Choose different commodities
- Switch between FY and CY
- Add Nationwide federal card
- Add Native American Card
- Explore data accuracy
- Select different commodities
- Select different years, correct FY or CY displaying
- Summary Cards: correct state title, correct county & state title, trendline, accurate year, commodities data, total # of commodities
- Nationwide Federal Card: % of federal land, total revenue for specified year, trendline, accurate year, commodities data, revenue type data
- Detailed state cards: % of federal land, total revenue for specified year, correct state title, trendline, total revenue for specified year, county map
- Detailed county cards: correct county & state title, total revenue for specified year, trendline, accurate year, commodities data, revenue type data
- Native American card: total revenue for specified year, trendline, accurate year, commodities data, revenue type data
- Offshore card: total revenue for specified year, trendline, accurate year, commodities data, revenue type data
- Check cards for states with no data
- Revenue over time trend line data
- Nationwide revenue summary bar chart data
- Top Nationwide locations data
Query Data
- Land type filter
- Revenue type filter
- State/Offshore region filter
- Commodity filter
- Grouping
- Change between fiscal and calendar year and change years
- Download matches selected data
Disbursements Monthly
Homepage
- disbursement trends line charts
- monthly bar charts
- FY bar charts
- Source file links
Download:
- xls and csv files updated with correct dates and file size
Disbursements Fiscal Year
Explore data Filters
- Switch between state and county
- Fiscal Year Period
- Add Nationwide federal card
- Add Native American Card
Explore data accuracy
- Select different years
- Data displaying correct FY
- Summary Cards: correct state title, correct county & state title, trendline, accurate year, top recipient data
- Nationwide Federal Card: % of federal land, total disbursements for specified year, trendline, accurate year, disbursement by recipient data
- Detailed state cards: % of federal land, total disbursements for specified year, correct state title, trendline, total disbursement for specified year, disbursement by recipient data
- Detailed county cards: correct county & state title, total disbursement for specified year, trendline, accurate year
- Native American card: total disbursement for specified year, trendline, accurate year
- Check cards for states with no data
- Disbursements over time trend line data
- Nationwide disbursement summary bar chart data
- Top Nationwide recipients data
Query Data
- Recipient Filter
- Source Filter
- State/offshore region filter
- Grouping
- Download matches selected data