Home - abronte/PysparkProxy GitHub Wiki

Implementation Status

Whats been implemented

Look at the tests to see exactly what is implemented and tested.

There are various catch all functions so don't be worried if you don't see a specific function tested. It should still work.

If you run into something that hasn't been implemented or doesn't work, please open an issue.

What has not been implemented

The machine learning and streaming packages are mostly what are left. Specifically if you require any of these:

  • pyspark session builder
  • pyspark.ml (In development)
  • pyspark.mlib
  • pyspark.streaming