Delta Spark connector - CSharplie/ploosh GitHub Wiki

This connector is used to read Detla table files using Spark.

⚠️ A spark connector can be use only with another spark connector. It is not possible to use a spark connector with a non spark connector.

See Spark documentation for more information.

Connection configuration

No connection is required by this connector

Configuration

Test case configuration

Name Mandatory Default Description
path yes Path to the Delta table

Example

Example Delta Spark:
  source:
    type: delta_spark
    path: data/employees
  expected:
    type: sql_spark
    query: |
      select * 
          from employees
          where hire_date < "2000-01-01"
⚠️ **GitHub.com Fallback** ⚠️