Examples of use cases solved with Versatile Data Kit SDK:

• Hello World Data Job

Simple Flow-based API where you can ingest using only configuration. It's an alpha so it's not stable, yet.

• VDK Ingest Tutorial Notebook

This is a more "low" level and advanced API but provides more power

• Ingesting data from REST API into Database
• Ingesting data from DB into Database
• Ingesting data from S3 into Database
• Ingesting local CSV file into Database
• Incremental ingestion using Job Properties
• Ingesting data from a authenticated REST API using Job Secrets

• Data Modeling Guide: Treating Data as a Product
• Processing data using SQL and local database
• Processing data using Kimball warehousing templates and a Big Data database (Presto/Trino)

• Create a Data Job through the Jupyter UI
• Develop a Data Job through the Jupyter UI
• Convert Data Job to Jupyter Notebook

• Debug Data Job in IDE
• Testing VDK Jobs with Pytest

• Ingest, process, and publish using VDK & Streamlit Vincent Van Gogh's paintings
• Ingest, process, and publish using VDK & Streamlit American states life expectancy
• Ingest, process, and publish using VDK & Streamlit analysis of relationship between Natural Gas prices and the temperature