Recent questions tagged apache-spark

0 votes
1 answer

Spark memory processing on a not temporary table

Jul 14, 2019 in Apache Spark by Kunal
 • 1,539 views
0 votes
1 answer

Can we change the path where the Hive data is stored in HDFS?

Jul 14, 2019 in Apache Spark by Kevin
 • 1,050 views
0 votes
1 answer

What does the command df.registerTempTable() do?

Jul 14, 2019 in Apache Spark by ophelia
 • 8,368 views
0 votes
1 answer

Spark: How can i create temp views in user defined database instead of default database?

Jul 14, 2019 in Apache Spark by Ashul
 • 4,488 views
0 votes
1 answer

org.apache.spark.sql.AnalysisException: cannot resolve "`id`" given input columns

Jul 14, 2019 in Apache Spark by Esha
 • 17,686 views
0 votes
1 answer

Difference between cogroup and full outer join in spark

Jul 14, 2019 in Apache Spark by Hiran
 • 9,885 views
+1 vote
1 answer

How do I turn off INFO Logging in Spark?

Jul 12, 2019 in Apache Spark by nitinrawat895
 • 11,380 points • 6,254 views
0 votes
1 answer

Working of map function on data

Jul 11, 2019 in Apache Spark by Medha
 • 945 views
0 votes
1 answer

Spark error: Caused by: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

Jul 11, 2019 in Apache Spark by Raghu
 • 7,711 views
0 votes
1 answer

Is fetching data from apache flume webcrawling?

Jul 11, 2019 in Apache Spark by Karan
 • 901 views
0 votes
1 answer

Why do we use sc.parallelize?

Jul 11, 2019 in Apache Spark by Sumit
 • 13,474 views
0 votes
1 answer

Error Loading data to mysql in Spark

Jul 11, 2019 in Apache Spark by Karan
 • 1,133 views
0 votes
1 answer

Spark Streaming Pyspark code not working

Jul 11, 2019 in Apache Spark by Rishi
 • 2,356 views
+1 vote
1 answer

How to add package com.databricks.spark.avro in spark?

Jul 10, 2019 in Apache Spark by Karuna
 • 6,118 views
0 votes
1 answer

Query regarding Appending " to a string in Scala

Jul 10, 2019 in Apache Spark by Rishi
 • 2,419 views
0 votes
1 answer

org.apache.spark.sql.AnalysisException: cannot resolve given input columns

Jul 10, 2019 in Apache Spark by Firoz
 • 42,830 views
0 votes
1 answer

Query regarding Operator Overloading in Scala

Jul 10, 2019 in Apache Spark by Rachit
 • 1,666 views
0 votes
2 answers

Error : split value is not a member of org.apache.spark.sql.Row

Jul 10, 2019 in Apache Spark by Kiran
 • 11,928 views
0 votes
1 answer

Scala join comma delimited file as tables

Jul 9, 2019 in Apache Spark by Lohit
 • 969 views
0 votes
1 answer

How to use yield keyword in scala and why it is used instead of println?

Jul 6, 2019 in Apache Spark by gandhi
 • 1,915 views
0 votes
1 answer

How to print loop with condition in scala?

Jul 5, 2019 in Apache Spark by neha
 • 570 views
0 votes
1 answer

How to implement two level loop in scala?

Jul 5, 2019 in Apache Spark by rajiv
 • 753 views
0 votes
1 answer

How can you use "for" statement in scala to print list from collection?

Jul 5, 2019 in Apache Spark by nisha
 • 802 views
0 votes
1 answer

How can we iterate any function using "foreach" function in scala?

Jul 5, 2019 in Apache Spark by nisha
 • 1,592 views
0 votes
1 answer

How to print string text in scala?

Jul 5, 2019 in Apache Spark by rajesh
 • 2,669 views
0 votes
1 answer

How can we optimize and minimize the memory when work with scala use case?

Jul 5, 2019 in Apache Spark by nilam
 • 864 views
0 votes
1 answer

Which syntax to use to take the sum of list of collection in scala?

Jul 5, 2019 in Apache Spark by tanvi
 • 1,854 views
0 votes
1 answer

How to assign block expression in scala?

Jul 5, 2019 in Apache Spark by tejas
 • 856 views
0 votes
1 answer

load/save in spark

Jul 5, 2019 in Apache Spark by Esha
 • 1,558 views
0 votes
1 answer

How to create dataframe for the comma delimited file?

Jul 5, 2019 in Apache Spark by Yogi
 • 3,438 views
0 votes
1 answer

Spark Installation problem

Jul 5, 2019 in Apache Spark by Jin
 • 4,632 views
0 votes
1 answer

When we create an RDD, does it bring the data and load it into the memory?

Jul 5, 2019 in Apache Spark by geeta
 • 874 views
0 votes
1 answer

Is it mandatory to start Hadoop to run spark application?

Jul 5, 2019 in Apache Spark by disha
 • 992 views
0 votes
1 answer

What is Lazy evaluated in Spark?

Jul 5, 2019 in Apache Spark by rashmi
 • 1,340 views
0 votes
1 answer

Which File System is supported by Apache Spark?

Jul 5, 2019 in Apache Spark by naina
 • 6,318 views
0 votes
1 answer

How will you explain yield keyword in Scala?

Jul 5, 2019 in Apache Spark by jeena
 • 811 views
0 votes
1 answer

Do real-time data processing is possible with Spark SQL?

Jul 5, 2019 in Apache Spark by Tina
 • 1,453 views
0 votes
1 answer

What is Spark Driver?

Jul 5, 2019 in Apache Spark by nita
 • 2,502 views
0 votes
1 answer

How to run spark in Standalone client mode?

Jul 5, 2019 in Apache Spark by jinish
 • 1,791 views
0 votes
0 answers

How to create RDD as string file?

Jul 5, 2019 in Apache Spark by anand
 • 896 views
0 votes
1 answer

error: reassingment to val

Jul 5, 2019 in Apache Spark by nikhil
 • 3,429 views
0 votes
1 answer

What does reduce action do in Spark?

Jul 4, 2019 in Apache Spark by kanika
 • 647 views
0 votes
1 answer

What is RDD Lineage in Spark?

Jul 4, 2019 in Apache Spark by nandini
 • 4,290 views
0 votes
1 answer

What is SparkCore functionalities?

Jul 4, 2019 in Apache Spark by naina
 • 975 views
+1 vote
1 answer

Error: value textfile is not a member of org.apache.spark.SparkContext

Jul 4, 2019 in Apache Spark by amrita
 • 4,358 views
0 votes
1 answer

error: identified expected but integer literal found.

Jul 4, 2019 in Apache Spark by NItin
 • 6,142 views
0 votes
1 answer

How to create RDD from an external file source in scala?

Jul 4, 2019 in Apache Spark by Reena
 • 1,764 views
0 votes
1 answer

How to create RDD from existing RDD in scala?

Jul 4, 2019 in Apache Spark by Nihal
 • 1,423 views
0 votes
1 answer

How to create RDD from parallelized collection in scala?

Jul 3, 2019 in Apache Spark by sunny
 • 1,603 views
0 votes
1 answer

error: identifier expected but ']' found.

Jul 3, 2019 in Apache Spark by tara
 • 5,532 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.