Netty - animeshtrivedi/notes GitHub Wiki

log contains where the transport config is initialized

Parameter of interests are :

spark.io.rpc.threads
spark.io.files.threads
spark.io.shuffle.threads --> not used 

shuffle client uses the number of executor cores for the netty. Hence, 1 executor/worker cores get 1 network thread (network threads are global for the shuffle manager). Class to look for is SparkTransportConf.