Geo Data - spinningideas/resources GitHub Wiki
Below is information on Geography related tools and datasets to aid efforts to produce solutions that have some form of map or geography related feature set.
NOTE: The data linked to below may be inaccurate, incomplete, or just plain wrong. As always, critically examine the data you are using, look at what organisation produced it and what agenda they may have, and beware that there are disputes over some of the data (particularly country boundaries). Also note that offerings and pricing listed may have changed.
Lists and Curated Resources
3D Visualization Tools
Geo Data Tools (Editing)
- https://maphub.net/
- https://mapshaper.org/ (good editor)
- https://mapbox.com (awesome editor and data set management - has paid element)
- https://mapsvg.com/maps
Geo Json
- https://geo-json.com/
- https://github.com/tmcw/awesome-geojson
- http://geojson.tools/
- http://geojson.io/
- https://github.com/topojson/world-atlas
Geocoding
Below are resources that specifically deal with geocoding locations.
Free & Open APIs (No Credit Card / Self-Hostable)
- OpenStreetMap Nominatim - 100% Free (Open source, rate-limited to 1 request/second, requires a descriptive User-Agent and attribution).
- Photon by Komoot - 100% Free search-as-you-type API powered by OpenStreetMap. Highly scalable and can be self-hosted.
- US Census Bureau Geocoder - 100% Free. No API key required, but strictly limited to United States addresses and geographies.
- Open-Meteo Geocoding API - Free for non-commercial use (up to 10,000 requests/day). No API key required.
- LatLong.net - Free online tool to look up latitude and longitude coordinates of places.
Freemium APIs (Generous Free Tiers)
- Geocode.maps.co - Free tier provides 1 request/second. Paid plans start at $15/month for higher limits.
- Positionstack - Free tier allows 25,000 requests/month (personal/non-commercial). Paid plans start at $9.99/month.
- Geoapify - Free tier provides 3,000 credits/day (typically 1 request = 1 credit). Paid plans start at €49/month.
- LocationIQ - Free tier provides 5,000 requests/day (limited to 2 requests/second). Paid plans start at $49/month.
- Radar Geocoding - Free tier provides 100,000 requests/month. Paid plans start at $29/month.
- Geocod.io - Free tier provides 2,500 lookups/day (US, Canada, and UK only). Paid tiers are pay-as-you-go ($1.00 per 1,000 lookups).
- OpenCage Geocoding - Free tier provides 2,500 requests/day (no credit card required). Paid plans start at $25/month.
Premium & Commercial APIs
- Google Maps Platform Geocoding - Provides a $200 monthly free credit (approx. 40,000 requests/month). Costs $5.00 per 1,000 requests thereafter.
- Mapbox Geocoding API - Free tier provides 100,000 temporary requests/month. Costs $0.75 per 1,000 requests thereafter. Permanent storage requires a paid/enterprise plan.
- TomTom Geocoding API - Free tier provides 2,500 requests/day. Pay-as-you-go starts at $0.50 per 1,000 requests.
- HERE Geocoding API - Free tier provides 30,000 transactions/month. Pay-as-you-go starts at $1.00 per 1,000 transactions.
- ArcGIS World Geocoding Service - Free tier provides 20,000 requests/month (temporary/non-stored). Costs $0.25 per 1,000 geocodes thereafter.
Data Sets
Global Data Sources
Below are 65+ external providers and APIs across geopolitics, finance, energy, climate, aviation, cyber, military, infrastructure, and news intelligence - surfaced through 500+ curated feeds. Full catalog at https://www.worldmonitor.app/docs/data-sources
Energy & Commodities
- https://agsi.gie.eu/ - EU gas storage/inventory (AGSI)
- https://www.eia.gov/opendata/ - US Energy Information Administration API
Finance & Economics
- https://data-api.ecb.europa.eu/ - European Central Bank rates
- https://ec.europa.eu/eurostat - Eurostat statistics
- https://fred.stlouisfed.org/ - Federal Reserve Economic Data (FRED)
- https://data.worldbank.org/ - World Bank Open Data
- https://stats.bis.org/ - Bank for International Settlements
- https://www.bls.gov/developers/ - US Bureau of Labor Statistics
- https://api.usaspending.gov/ - US federal spending data
- https://comtradeapi.un.org/ - UN Comtrade international trade
- https://www.coingecko.com/ - Crypto market data
Geopolitics & Conflict
- https://acleddata.com/ - Armed Conflict Location & Event Data (ACLED)
- https://ucdp.uu.se/ - Uppsala Conflict Data Program (UCDP)
- https://www.gdeltproject.org/ - Global Database of Events, Language, and Tone (GDELT)
- https://portwatch.imf.org/ - IMF port monitoring
Environment & Disasters
- https://earthquake.usgs.gov/ - USGS real-time earthquake data (M2.5+)
- https://firms.modaps.eosdis.nasa.gov/ - NASA FIRMS active fire/hotspot data
- https://eonet.gsfc.nasa.gov/ - NASA Earth Observatory Natural Event Tracker (EONET)
- https://www.gdacs.org/ - Global Disaster Alert and Coordination System
- https://open-meteo.com/ - Open-Meteo weather API
Infrastructure & Cyber
- https://radar.cloudflare.com/ - Cloudflare Radar (internet traffic, outages)
- https://www.submarinecablemap.com/ - Submarine cable map (TeleGeography)
- https://www.abuseipdb.com/ - AbuseIPDB (IP threat reputation)
- https://celestrak.org/ - CelesTrak (satellite/orbital tracking)
Aviation
- https://wingbits.com/ - Wingbits ADS-B flight data
- https://opensky-network.org/ - OpenSky Network (flight tracking)
- https://nasstatus.faa.gov/ - FAA NAS status (delays, NOTAMs)
- https://www.icao.int/ - ICAO aviation data
Intelligence Feeds
- https://oref.org.il/ - OREF rocket alert integration (Israel)
- https://gpsjam.org/ - GPS/GNSS interference detection
Weather Feeds
Cities/Countries Open Source
- https://www.back4app.com/database/back4app/list-of-all-continents-countries-cities
- http://geojson.xyz/
- https://www.naturalearthdata.com/downloads/110m-physical-vectors/
- https://geojson-maps.ash.ms/
- https://github.com/tmcw/awesome-geojson#data
- http://freegisdata.rtwilson.com/
- https://www.citypopulation.de/ - great source of data (see also http://world.bymap.org/)
- https://catalog.data.gov/dataset?res_format=GeoJSON
- https://www.geonames.org/datasources/ (good list of data sources)
- https://github.com/factbook/factbook.json - published by the Central Intelligence Agency (CIA) offers free country profiles in the public domain
- https://github.com/THarns/USjsonListCreator -JSON list of US counties, states with their population
- https://overturemaps.org/ + https://docs.overturemaps.org/getting-data/
Cities/Countries Commercial
- https://data.world/datasets/geodata
- https://exploratory.io/map
- https://simplemaps.com/data
- https://datahub.io/collections/geojson
- https://mapsvg.com/maps/usa-all-counties
Continents
- https://raw.githubusercontent.com/deldersveld/topojson/master/world-continents.json
- https://medium.com/@david.reed.c/advanced-map-making-7165f7497540
- http://bl.ocks.org/piwodlaiwo/80a420f37e1c110c8d1a025d9080b5ae
- http://bl.ocks.org/piwodlaiwo/c0e10c375a7704f18b1bc813bc5eeddb
Countries
- https://github.com/johan/world.geo.json/blob/master/countries.geo.json - (low res)
- https://github.com/stefanocudini/geojson-resources/blob/master/world.json - (low res - 224k)
- https://github.com/datasets/geo-countries/blob/master/data/countries.geojson (high res - 23 MB)
- https://github.com/annexare/Countries/blob/master/data/countries.json
- https://github.com/mledoze/countries/tree/master/data
States/Provinces
- http://geojson.io/#map=3/52.19/-119.38 (US States)
- https://gist.github.com/mindplay-dk/4755200
- https://github.com/substack/provinces/blob/master/provinces.json
- https://en.wikipedia.org/wiki/ISO_3166-2
- https://www.in.gov/dor/files/4163-foreign-state-province-codes.pdf
- https://mapsvg.com/maps/usa-all-counties
Metro Areas
The OMB defines a Metropolitan Statistical Area as one or more adjacent counties, or county equivalents, that have at least one urban core area of at least 50,000 population, plus adjacent territory that has a high degree of social and economic integration with the core as measured by the commuting tie.
Categories of CBSAs are: Metropolitan Statistical Areas, based on urbanized areas of 50,000 or more
Micropolitan Statistical Areas, based on urban clusters of at least 10,000 population but less than 50,000.
MSA = area with one city >50000 CSBA = core based statistical area
- https://vividmaps.com/map-of-largest-metropolitan-areas/
- https://neighborhoodnexus.org/case-studies/100-metros-dashboard/
Data
- https://en.wikipedia.org/wiki/List_of_metropolitan_statistical_areas
- https://catalog.data.gov/dataset/tiger-line-shapefile-2019-nation-u-s-current-metropolitan-statistical-area-micropolitan-statist
- https://www.census.gov/geographies/mapping-files/time-series/geo/tiger-geodatabase-file.html
Zip Codes
- https://github.com/OpenDataDE/State-zip-code-GeoJSON
- https://www.huduser.gov/portal/datasets/usps_crosswalk.html
Global Cities
There are about 100 cities in the world with more than 500k inhabitants:
- X-Large 2.5M+ (21)
- Large 1M - 2.5M (32)
- Medium 500K - 1M (47)
- Small 50K - 500K (???)
There are more than 4000 cities with more than 100k inhabitants:
- https://brilliantmaps.com/4037-100000-person-cities/
- http://fingolas.carto.com/viz/5b9a0e5c-ba27-11e4-9fc4-0e0c41326911/public_map
- https://datahub.io/core/world-cities
- https://github.com/lutangar/cities.json
Here are maps of these cities
-
https://public.opendatasoft.com/explore/dataset/worldcitiespop/api/?disjunctive.country
-
https://github.com/nvkelso/natural-earth-vector/blob/master/geojson/ne_10m_populated_places.geojson
United States Cities/Geographies
Accuracy
Most scenarios in which GeoJSON is useful (i.e. web-related applications) do not require survey-grade precision (eg 7+ digits). Trimming the precision of coordinates can greatly reduce file size, while removing the appearance of fake high precision.
https://gis.stackexchange.com/questions/8650/measuring-accuracy-of-latitude-and-longitude/8674#8674
| decimal places | degrees | distance |
|---|---|---|
| 0 | 1.0 | 111 km |
| 1 | 0.1 | 11.1 km |
| 2 | 0.01 | 1.11 km |
| 3 | 0.001 | 111 m |
| 4 | 0.0001 | 11.1 m |
| 5 | 0.00001 | 1.11 m |
| 6 | 0.000001 | 0.111 m |
| 7 | 0.000001 | 1.11 cm |
| 8 | 0.00000001 | 1.11 mm |