How to enable write ahead logs for receivers

Question

I want to input data received by receivers to be written in write-ahead logs so that if there are any driver failures, then recovery would be easy. How can I do this?

Answer 1

To enable write-ahead logs, run the following command in the spark shell:

val sc = new SparkContext(new SparkConf())

./bin/spark-submit <all your existing options> --spark.streaming.receiver.writeAheadLog.enable=true