Page Index - vmware/versatile-data-kit GitHub Wiki
99 page(s) in this GitHub Wiki:
- Home
- Achitecture
- bi journey
- Brainstorming: structure
- Coding Standard
- Community Meetings
- Configuration
- Configuring Hashicorp Vault Instance for storing Secrets
- Control Service Key Concepts
- Convert Data Job to Jupyter Notebook
- Create a Data Job through the Jupyter UI
- Data Job
- Data Jobs Development Workflow
- Data Modeling Guide: Treating Data as a Product
- Data Sources and Targets
- db_connection_decorate_operation and db_connection_recover_operation hooks
- Dependencies licensing
- Deploy Data Job through the Jupyter UI
- Deploy VDK Demo
- Deployment
- Design Principles
- Dev Guide
- Dev How tos
- Develop a Data Job through the Jupyter UI
- Develop Plugins
- dictionary
- Documentation Guide
- example dw processing
- example using debugger
- ExampleHome
- Examples
- Examples Control Service
- Execution
- External Resources
- First Data Job
- Getting Started
- Getting started workflow toolings research
- Gitlab CICD
- GPU Resource Management on the VDK
- How to create a GIF
- How to prepare a new PR
- Ideas
- Ideas for Examples with VDK
- Ingest Source Research
- Ingesting data from a authenticated REST API using Job Secrets
- Ingesting data from DB into Database
- Ingesting data from REST API into Database
- Ingesting data from S3 into Database
- Ingesting local CSV file into Database
- Ingestion
- Install VDK Control Service with custom SDK
- Install VDK Plugins
- Installation
- Interfaces
- Jupyter integration with VDK research
- Markdown tricks & tips
- ML Training on VDK
- Operations UI
- Operator Guide
- Overview
- Processing data using SQL and local database
- Production
- Properties
- Properties and Secrets
- Python Dependencies
- Quickstart VDK
- Ray in VDK
- Research GreatExpectations
- Research: Dynamic Configuration
- Research: Getting started and Configuration
- Research: Progress Indicators
- Research: Progress Indicators Appendix
- Resiliency
- Roadmap
- Scheduling a Data Job for automatic execution
- SDK Key Concepts
- SQL Data Processing templates examples
- Template for a Tutorial
- Templates
- Test VDK Data Jobs with pytest
- Transformation
- Tutorial Guidelines
- UI Getting Started
- UI Installation
- UI Overview
- Using DAGs to orchestrate Data Jobs with arguments
- Using Data Job Properties vs Secrets
- Using VDK DAGs to orchestrate data jobs
- VDK and LLamaIndex
- VDK and RAG: periodically scrape the organisational data source and publish new data into the vector store ideas
- VDK Jupyter Integration
- VDK Jupyter Integration Convert Job Operation
- VDK Logging And Error Handling: Technical Analysis
- VDK Logs Usability Testing
- VDK Structlog Integration
- VDK: SQL and Data Flow Improvements
- VDK: Support multiple databases in the same job
- Versatile Data Kit Control Service
- Versatile Data Kit Plugins