Spark DF - vaquarkhan/Apache-Kafka-poc-and-notes GitHub Wiki

Read partitions in dataframe

ds.select(partitionColumn).distinct().collectAsList();

//

http://parrotprediction.com/partitioning-in-apache-spark/