Recent questions tagged spark

0 votes
1 answer

Spark - load CSV file as DataFrame?

Sep 25, 2018 in Big Data Hadoop by digger
 • 26,740 points • 7,217 views
0 votes
1 answer

Spark job using kubernetes instead of yarn

Sep 6, 2018 in Kubernetes by lina
 • 8,220 points • 1,401 views
0 votes
1 answer

What happens to RDD when one of the nodes goes down?

Sep 3, 2018 in Apache Spark by Shubham
 • 13,490 points • 2,201 views
0 votes
1 answer

Does Spark provide the storage layer too?

Sep 3, 2018 in Apache Spark by Shubham
 • 13,490 points • 1,844 views
0 votes
1 answer

Functions of Spark SQL?

Sep 3, 2018 in Apache Spark by Meci Matt
 • 9,460 points • 1,912 views
0 votes
1 answer

Languages supported by Apache Spark?

Sep 3, 2018 in Apache Spark by Meci Matt
 • 9,460 points • 7,783 views
0 votes
1 answer

How to connect Amazon RedShift in Apache Spark?

Aug 22, 2018 in AWS by datageek
 • 2,540 points • 8,292 views
+2 votes
3 answers

**Important** Apache Spark Interview Questions (Bank)

Aug 22, 2018 in Career Counselling by Priyaj
 • 58,020 points • 2,904 views
0 votes
2 answers

Which cluster type should I choose for Spark?

Aug 21, 2018 in Apache Spark by Shubham
 • 13,490 points • 2,523 views
0 votes
1 answer

How to stop INFO messages displaying on Spark console?

Aug 21, 2018 in Apache Spark by Meci Matt
 • 9,460 points • 2,764 views
0 votes
2 answers

Which of these will vanish: Flink vs Spark?

Aug 10, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,785 views
0 votes
2 answers

How does Hadoop/Spark is used for building large analytics report?

Aug 7, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 1,218 views
0 votes
1 answer

What makes Spark faster than MapReduce?

Jul 27, 2018 in Apache Spark by Neha
 • 6,300 points • 2,017 views
0 votes
1 answer

PySpark Config ?

Jul 26, 2018 in Apache Spark by shams
 • 3,670 points • 1,237 views
+1 vote
1 answer

getting null values in spark dataframe while reading data from hbase

Jul 18, 2018 in Apache Spark by Raj
 • 130 points • 2,763 views
0 votes
1 answer

A strange spark ERROR on AWS EMR

Jul 13, 2018 in AWS by Luke cage
 • 360 points • 2,102 views
+1 vote
8 answers

How to print the contents of RDD in Apache Spark?

Jul 6, 2018 in Apache Spark by Shubham
 • 13,490 points • 63,362 views
0 votes
2 answers

How to use RDD filter with other function?

Jul 5, 2018 in Apache Spark by Shubham
 • 13,490 points • 10,362 views
0 votes
1 answer

How to add third party java jars for use in PySpark?

Jul 4, 2018 in Apache Spark by Shubham
 • 13,490 points • 9,219 views
0 votes
1 answer

Difference between sparkContext, JavaSparkContext, SQLContext, & SparkSession?

Jul 4, 2018 in Apache Spark by Shubham
 • 13,490 points • 5,779 views
+1 vote
2 answers

How can I convert Spark Dataframe to Spark RDD?

Jul 4, 2018 in Apache Spark by code799
 • 21,508 views
0 votes
1 answer

Difference between Spark ML & Spark MLlib package

Jul 4, 2018 in Apache Spark by code799
 • 2,756 views
0 votes
3 answers

Sorting rows in descending order in Spark SQL

Jul 4, 2018 in Apache Spark by code799
 • 17,308 views
0 votes
1 answer

Spark streaming with Kafka dependency error

Jul 4, 2018 in Apache Spark by code799
 • 1,719 views
+1 vote
1 answer

map vs mapValues in Spark

Jun 29, 2018 in Apache Spark by Shubham
 • 13,490 points • 16,848 views
+1 vote
3 answers

Which cluster type should I choose for Spark?

Jun 27, 2018 in Apache Spark by Shubham
 • 13,490 points • 2,236 views
+2 votes
14 answers

How to create new column with function in Spark Dataframe?

Jun 26, 2018 in Apache Spark by coldcode
 • 2,090 points • 91,240 views
0 votes
1 answer

Which is better in term of speed, Shark or Spark?

Jun 26, 2018 in Apache Spark by Shubham
 • 13,490 points • 1,283 views
0 votes
1 answer

Spark Driver roles

Jun 21, 2018 in Apache Spark by shams
 • 3,670 points • 1,383 views
0 votes
2 answers

Parquet Files Advantages

Jun 21, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 2,604 views
0 votes
2 answers

map() and flatmap()

Jun 20, 2018 in Apache Spark by Ashish
 • 2,650 points • 1,582 views
0 votes
1 answer

Spark standalone client mode

Jun 20, 2018 in Apache Spark by shams
 • 3,670 points • 1,530 views
0 votes
1 answer

Ways to create RDD in Apache Spark

Jun 19, 2018 in Apache Spark by Shubham
 • 13,490 points • 4,509 views
0 votes
3 answers

Lineage Graph in Spark

Jun 19, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 12,801 views
0 votes
1 answer

Minimizing Data Transfers in Spark

Jun 19, 2018 in Apache Spark by shams
 • 3,670 points • 1,833 views
0 votes
1 answer

How RDD persist the data in Spark?

Jun 18, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 1,803 views
0 votes
1 answer

What do we mean by an RDD in Spark?

Jun 18, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 4,497 views
0 votes
1 answer

cqlsh queries fial if tombstones are present

Jun 18, 2018 in DevOps Tools by shubham
 • 7,340 points • 1,245 views
0 votes
1 answer

When running Spark on Yarn, do I need to install Spark on all nodes of Yarn Cluster?

Jun 14, 2018 in Apache Spark by Shubham
 • 13,490 points • 6,986 views
0 votes
1 answer

Is it mandatory to start Hadoop to run spark application?

Jun 14, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 1,207 views
0 votes
1 answer

Persistence Levels in Spark

Jun 8, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 6,576 views
0 votes
1 answer

What is Shark?

Jun 8, 2018 in Apache Spark by shams
 • 3,670 points • 1,380 views
+1 vote
1 answer

Kafka Feature

Jun 7, 2018 in Apache Spark by shams
 • 3,670 points • 2,294 views
0 votes
1 answer

SQLInterpreter in Spark

Jun 7, 2018 in Apache Spark by shams
 • 3,670 points • 1,118 views
0 votes
1 answer

How to find the number of elements present in the array in a Spark DataFame column?

Jun 6, 2018 in Apache Spark by code799
 • 23,107 views
0 votes
3 answers

Filtering a row in Spark DataFrame based on matching values from a list

Jun 6, 2018 in Apache Spark by code799
 • 93,634 views
0 votes
1 answer

Convert the given Spar rdd object to Spark DataFrame.

Jun 6, 2018 in Apache Spark by code799
 • 1,543 views
0 votes
1 answer

Unable to spawn executor on remote worker node using multinode spark cluster in spark-shell

Jun 4, 2018 in DevOps Tools by ffdfd
 • 5,550 points • 2,429 views
0 votes
1 answer

Different Spark Ecosystem

Jun 4, 2018 in Apache Spark by shams
 • 3,670 points • 1,268 views
0 votes
1 answer

Parquet File

Jun 4, 2018 in Apache Spark by shams
 • 3,670 points • 1,404 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.