Geo Data - spinningideas/resources GitHub Wiki
Below is information on Geography related tools and datasets to aid efforts to produce solutions that have some form of map or geography related aspect
Lists and Curated Resources
Geo Data Tools
- https://maphub.net/
- https://mapshaper.org/ (good editor)
- https://mapbox.com (awesome editor and data set management - has paid element)
- https://mapsvg.com/maps
Geo Json
- https://geo-json.com/
- https://github.com/tmcw/awesome-geojson
- http://geojson.tools/
- http://geojson.io/
Geo Coding
Data Sets
NOTE: The data linked to below may be inaccurate, incomplete, or just plain wrong. As always, critically examine the data you are using, look at what organisation produced it and what agenda they may have, and beware that there are disputes over some of the data (particularly country boundaries).
Open Source
- https://www.back4app.com/database/back4app/list-of-all-continents-countries-cities
- http://geojson.xyz/
- https://www.naturalearthdata.com/downloads/110m-physical-vectors/
- https://geojson-maps.ash.ms/
- https://github.com/tmcw/awesome-geojson#data
- http://freegisdata.rtwilson.com/
- https://www.citypopulation.de/ - great source of data (see also http://world.bymap.org/)
- https://catalog.data.gov/dataset?res_format=GeoJSON
- https://www.geonames.org/datasources/ (good list of data sources)
- https://github.com/factbook/factbook.json - published by the Central Intelligence Agency (CIA) offers free country profiles in the public domain
- https://github.com/THarns/USjsonListCreator -JSON list of US counties, states with their population
- https://overturemaps.org/ + https://docs.overturemaps.org/getting-data/
Commercial
- https://data.world/datasets/geodata
- https://exploratory.io/map
- https://simplemaps.com/data
- https://datahub.io/collections/geojson
- https://mapsvg.com/maps/usa-all-counties
Continents
- https://raw.githubusercontent.com/deldersveld/topojson/master/world-continents.json
- https://medium.com/@david.reed.c/advanced-map-making-7165f7497540
- http://bl.ocks.org/piwodlaiwo/80a420f37e1c110c8d1a025d9080b5ae
- http://bl.ocks.org/piwodlaiwo/c0e10c375a7704f18b1bc813bc5eeddb
Countries
- https://github.com/johan/world.geo.json/blob/master/countries.geo.json - (low res)
- https://github.com/stefanocudini/geojson-resources/blob/master/world.json - (low res - 224k)
- https://github.com/datasets/geo-countries/blob/master/data/countries.geojson (high res - 23 MB)
- https://github.com/annexare/Countries/blob/master/data/countries.json
- https://github.com/mledoze/countries/tree/master/data
States/Provinces
- http://geojson.io/#map=3/52.19/-119.38 (US States)
- https://gist.github.com/mindplay-dk/4755200
- https://github.com/substack/provinces/blob/master/provinces.json
- https://en.wikipedia.org/wiki/ISO_3166-2
- https://www.in.gov/dor/files/4163-foreign-state-province-codes.pdf
- https://mapsvg.com/maps/usa-all-counties
Metro Areas
The OMB defines a Metropolitan Statistical Area as one or more adjacent counties, or county equivalents, that have at least one urban core area of at least 50,000 population, plus adjacent territory that has a high degree of social and economic integration with the core as measured by the commuting tie.
Categories of CBSAs are: Metropolitan Statistical Areas, based on urbanized areas of 50,000 or more
Micropolitan Statistical Areas, based on urban clusters of at least 10,000 population but less than 50,000.
MSA = area with one city >50000 CSBA = core based statistical area
- https://vividmaps.com/map-of-largest-metropolitan-areas/
- https://neighborhoodnexus.org/case-studies/100-metros-dashboard/
Data
- https://en.wikipedia.org/wiki/List_of_metropolitan_statistical_areas
- https://catalog.data.gov/dataset/tiger-line-shapefile-2019-nation-u-s-current-metropolitan-statistical-area-micropolitan-statist
- https://www.census.gov/geographies/mapping-files/time-series/geo/tiger-geodatabase-file.html
Zip Codes
- https://github.com/OpenDataDE/State-zip-code-GeoJSON
- https://www.huduser.gov/portal/datasets/usps_crosswalk.html
Global Cities
There are about 100 cities in the world with more than 500k inhabitants:
- X-Large 2.5M+ (21)
- Large 1M - 2.5M (32)
- Medium 500K - 1M (47)
- Small 50K - 500K (???)
There are more than 4000 cities with more than 100k inhabitants:
- https://brilliantmaps.com/4037-100000-person-cities/
- http://fingolas.carto.com/viz/5b9a0e5c-ba27-11e4-9fc4-0e0c41326911/public_map
- https://datahub.io/core/world-cities
- https://github.com/lutangar/cities.json
Here are maps of these cities
-
https://public.opendatasoft.com/explore/dataset/worldcitiespop/api/?disjunctive.country
-
https://github.com/nvkelso/natural-earth-vector/blob/master/geojson/ne_10m_populated_places.geojson
United States Cities/Geographies
Accuracy
Most scenarios in which GeoJSON is useful (i.e. web-related applications) do not require survey-grade precision (eg 7+ digits). Trimming the precision of coordinates can greatly reduce file size, while removing the appearance of fake high precision.
https://gis.stackexchange.com/questions/8650/measuring-accuracy-of-latitude-and-longitude/8674#8674
| decimal places | degrees | distance |
|---|---|---|
| 0 | 1.0 | 111 km |
| 1 | 0.1 | 11.1 km |
| 2 | 0.01 | 1.11 km |
| 3 | 0.001 | 111 m |
| 4 | 0.0001 | 11.1 m |
| 5 | 0.00001 | 1.11 m |
| 6 | 0.000001 | 0.111 m |
| 7 | 0.000001 | 1.11 cm |
| 8 | 0.00000001 | 1.11 mm |
Wide-Area Motion Imagery (WAMI)
Wide-Area Motion Imagery (WAMI) is an airborne persistent surveillance technology that captures continuous video over city-sized areas (kilometers in diameter). Unlike standard drone cameras, WAMI tracks every moving vehicle and person in its entire field of view, archiving the data for real-time and forensic "time machine"
- https://en.wikipedia.org/wiki/Wide-area_motion_imagery
- https://transparentsky.com/
- https://www.youtube.com/watch?v=cWbBsfwtCIo — Bilawal Sidhu video on aerial surveillance
Historical Programs
- ARGUS-IS - DARPA + BAE Systems - 2007–2010, public demo around 2013, operationally transitioned around 2014.
- Gorgon Stare Increment 2 - US Air Force + Sierra Nevada Corporation, using ARGUS-derived tech - 2011–2014.
- AWARE / AWARE-2 - DARPA + Duke University consortium - roughly 2009–2013.
- MOIRE - DARPA + Ball Aerospace - roughly 2010–2013, space-based real-time imaging concept.
- Persistics - Lawrence Livermore National Laboratory - around 2011, video compression / tracking / exploitation pipeline.
- Persistent Surveillance Systems / HawkEye — PSS, Ross McNutt — 2006–2021+, city-wide airborne surveillance used in places like Baltimore.