读取ACID表问题 - aliyun/MaxCompute-Spark GitHub Wiki

新版本Spark支持读取ACID表，需要添加以下参数切换到新版本

Spark 2.3.0

spark.hadoop.odps.task.major.version = default
spark.hadoop.odps.cupid.resources = public.__spark_libs__2.3.0-odps0.34.0.zip
spark.driver.extraClassPath = ./public.__spark_libs__2.3.0-odps0.34.0.zip/* 
spark.executor.extraClassPath = ./public.__spark_libs__2.3.0-odps0.34.0.zip/*

Spark 2.4.5

spark.hadoop.odps.task.major.version = default
spark.hadoop.odps.cupid.resources = public.__spark_libs__2.4.5-odps0.34.0.zip
spark.driver.extraClassPath = ./public.__spark_libs__2.4.5-odps0.34.0.zip/* 
spark.executor.extraClassPath = ./public.__spark_libs__2.4.5-odps0.34.0.zip/*

⚠️ GitHub.com Fallback ⚠️