Spark event log location

0 votes
Hi. Need urgent help. I need to know to the location where spark event logs are stored to find the logs of an event. Thanks in advance.
Mar 6, 2019 in Apache Spark by Prateek
669 views

1 answer to this question.

0 votes

Unless and until you have not changed any configurations, you should find the logs in the following path:

file:///tmp/spark-events

There will a sub-directory for the application whose logs you are looking for. You will find the logs inside this directory. 

answered Mar 6, 2019 by Rohit

Related Questions In Apache Spark

0 votes
1 answer

Log every block update in Spark

By default, Spark does not log all ...READ MORE

answered Mar 6, 2019 in Apache Spark by Rohit
965 views
0 votes
1 answer

How to enable Spark event logging?

To make Spark store the event logs, ...READ MORE

answered Mar 6, 2019 in Apache Spark by Rohit
2,896 views
0 votes
1 answer

How to increase Spark listener bus event queue capacity?

The default capacity of listener bus is ...READ MORE

answered Mar 12, 2019 in Apache Spark by Raj
7,199 views
0 votes
1 answer

Changing Column position in spark dataframe

Yes, you can reorder the dataframe elements. You need ...READ MORE

answered Apr 19, 2018 in Apache Spark by Ashish
• 2,650 points
13,767 views
+1 vote
2 answers
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
11,035 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
2,542 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
108,863 views
0 votes
1 answer

How to change the location of Spark event logs?

You can change the location where you ...READ MORE

answered Mar 6, 2019 in Apache Spark by Rohit
4,532 views
0 votes
1 answer

Invalid syntax in spark

There's a problem with your syntax. There ...READ MORE

answered Jan 31, 2019 in Apache Spark by Omkar
• 69,220 points
2,131 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP