EMu data web - fieldmuseum/EMu-Documentation GitHub Wiki
EMu data for the web
(Updated November 5, 2024)
This page documents EMu infrastructure for the web. It's meant to present a clear diagram of data flow from our public instance of EMu to Elasticsearch.
EMu (Ross EMu, only publically available records)
- EMu to MongoDB uses emuout -
Go CLI to export data (
texqlandtexexporton the command line)
MongoDB (internally hosted on the cluster)
- MongoDB to Elasticsearch uses Pat's Python syncing script; ask Pat for more info
Elasticsearch (managed at Elastic Cloud)
graph TD;
EMu-->MongoDB;
MongoDB-->Elasticsearch;
Elasticsearch
Elasticsearch is the primary source for our data served to the web. Especially for our Vercel hosted websites.