Question

what are the job optimization Technics in spark and scala

Answer 1

There are different methods to achieve optimization in Spark, for example:

• Data Serialization
• Memory Management
• Memory Consumption
• Data Structure Tuning
• Garbage Collection
• Parallelism
• Data Locality

To know more on the optimization techniques, visit the documentation: https://spark.apache.org/docs/latest/tuning.html