Spark Commands - keshavbaweja-git/guides GitHub Wiki

Start Spark Master

sbin/start-master.sh -h <hostname> --webui-port 9292

Start Spark Slave

sbin/start-slave.sh spark://<master_hostname>:7077

Submit a Spark Job

bin/spark-submit \
--class "<mainClass>" \
--master spark://<master_hostname>:7077 \
--deploy-mode cluster \
--supervise  \
--executor-memory 20G \
--total-executor-cores 100 "</path/to/jar>"

⚠️ GitHub.com Fallback ⚠️