Generating Vector Tiles - Rapid-Imaging-Tech/tileserver-gl GitHub Wiki
Notes: imposm3 seems to handle up to 12 CPUs. It suggests 2x RAM for a given PBF file. This doesn't seem to be the case on the openmaptiles framework.
Planet PBF files: https://wiki.openstreetmap.org/wiki/Planet.osm
Tile builder will likely need 12 CPU, 96GB RAM, a 200GB SSD and roughly 6 hours.
At the generate-tiles step, pass UV_THREADPOOL_SIZE=[num CPU] as an environment variable.
docker-compose run -e UV_THREADPOOL_SIZE=10 generate-vectortiles
(for 10 CPUs)
generate-vectortiles
seems to be the rate-limiting step. An appropriate method might be to split the system into a database, some information loaders that get spun up and back down, and then a very large vector tile generator that burns through the job.
Re-running the quickstart.sh
script after the osm.pbf
file has been downloaded makes the script fail right before the generate-vectortiles
stage because of the lack of a config file:
INFO: analyzing "aerodrome_label.updates"
INFO: "updates": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
ANALYZE
-------------------------------------------------------------------------------------
====> : Bring up postserve at localhost:8090/tiles/{z}/{x}/{y}.pbf
Creating openmaptiles_postserve_1
-------------------------------------------------------------------------------------
====> : Start generating MBTiles (containing gzipped MVT PBF) from a TM2Source project.
: TM2Source project definitions : ./build/openmaptiles.tm2source/data.yml
: Output MBTiles: ./data/tiles.mbtiles
: Source code: https://github.com/openmaptiles/generate-vectortiles
: We are using a lot of Mapbox Open Source tools! : https://github.com/mapbox
: Thank you https://www.mapbox.com !
: See other MVT tools : https://github.com/mapbox/awesome-vector-tiles
:
: You will see a lot of deprecated warning in the log! This is normal!
: like : Mapnik LOG> ... is deprecated and will be removed in Mapnik 4.x ...
.IOError: [Errno 2] No such file or directory: u'././data/docker-compose-config.yml'