Versatile Data Kit Plugins - vmware/versatile-data-kit GitHub Wiki

A plugin is a Python module or distribution that enhances or changes the behavior of a Versatile Data Kit. Through plugins, functionalities like notebook development of jobs, automatic lineage detection, control service CLI commands and more can be added.

Plugins are:

• Modular: use only what you need. Extensible: build what you miss.
• Easy to install any plugins as python packages using pip.
• Used in enhancing data processing, ingestion, job execution, command-line lifecycle

Full documentation on plugins can be found here. Each plugin has its own documentation; you can find a README file in each plugin in plugins directory.

Get started with using some VDK plugins:

1. Browse available plugins

2. Interesting plugins to check out:

• Track Lineage of your jobs using vdk-lineage
• Import/Ingest or Export CSV files using vdk-csv

3. Write your own plugin

➡ Next Section: Install VDK Plugins