Recent questions tagged apache-spark

0 votes
1 answer

What is Action in Spark?

Jul 3, 2019 in Apache Spark by roza
 • 13,304 views
0 votes
1 answer

What is Map and flatMap in Spark?

Jul 3, 2019 in Apache Spark by Naina
 • 3,101 views
0 votes
1 answer

Why Partitions are immutable in Spark?

Jul 3, 2019 in Apache Spark by neha
 • 4,187 views
0 votes
1 answer

How SparkSQL is different from HQL and SQL?

Jul 3, 2019 in Apache Spark by Ranjan
 • 5,189 views
0 votes
1 answer

What is Piping in Spark?

Jul 3, 2019 in Apache Spark by Diana
 • 4,514 views
0 votes
1 answer

What is the difference between persist() and cache() in apache spark?

Jul 3, 2019 in Apache Spark by Nihal
 • 5,796 views
0 votes
1 answer

What is meant by Transformation? Give some examples.

Jul 3, 2019 in Apache Spark by deric
 • 1,801 views
0 votes
0 answers

When we create an RDD, does it bring the data and load it into the memory?

Jul 3, 2019 in Apache Spark by monalisa
 • 2,089 views
+1 vote
2 answers

What is sparkContext?

Jul 3, 2019 in Apache Spark by Liza
 • 3,316 views
+1 vote
1 answer

What is reduce() action in Spark?

Jul 2, 2019 in Apache Spark by amrita
 • 7,082 views
0 votes
1 answer

What is persist() in Spark?

Jul 2, 2019 in Apache Spark by Tina
 • 1,992 views
0 votes
1 answer

What is a Parquet file in Spark?

Jul 2, 2019 in Apache Spark by Anindit
 • 2,539 views
0 votes
1 answer

What is GraphX in Spark?

Jul 2, 2019 in Big Data Hadoop by Nitin
 • 2,026 views
0 votes
0 answers

what are the commonly used Spark ecosystem?

Jul 2, 2019 in Big Data Hadoop by ranjan
 • 1,174 views
0 votes
1 answer

what is Hive on spark?

Jul 2, 2019 in Big Data Hadoop by Nikhil
 • 2,173 views
0 votes
1 answer

By which components spark ecosystem libraries are composed of?

Jul 1, 2019 in Apache Spark by zaved
 • 1,707 views
0 votes
1 answer

What is polyglot in spark?

Jul 1, 2019 in Apache Spark by Lisa
 • 4,149 views
0 votes
1 answer

What is RDD in Apache spark?

Jul 1, 2019 in Apache Spark by Lila
 • 2,658 views
0 votes
1 answer

What are the challenges we faced as Hadoop Admin?

Jun 25, 2019 in Big Data Hadoop by deepak
 • 3,548 views
0 votes
1 answer

Spark CLI issue

Jun 19, 2019 in Apache Spark by Giri
 • 1,682 views
0 votes
1 answer

Spark foldbykey doubt

Jun 19, 2019 in Apache Spark by Jai
 • 4,369 views
0 votes
1 answer

Is there a possibility to run Apache Spark without Hadoop?

Jun 6, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,689 views
0 votes
1 answer

Error: org.apache.thrift.transport.TTransportException (state=08S01,code=0)

Jun 4, 2019 in Big Data Hadoop by Guru
 • 14,058 views
+1 vote
0 answers

_spark_metadata/0 doesn't exist while Compacting batch 9 Structured streaming error

May 31, 2019 in Apache Spark by AzimKangda
 • 130 points • 5,638 views
0 votes
1 answer

Starting Spark Scala console

May 24, 2019 in Apache Spark by Rishi
 • 1,645 views
0 votes
1 answer

Spark Error: java.lang.IllegalStateException: Cannot call methods on a stopped SparkContext.

May 24, 2019 in Apache Spark by Paul
 • 12,423 views
0 votes
1 answer

Spark: Problem creating RDD

May 24, 2019 in Big Data Hadoop by Karan
 • 1,634 views
0 votes
1 answer

Difference between RDD as val and var

May 23, 2019 in Apache Spark by SHeen
 • 3,608 views
0 votes
1 answer

Error while reading multiline Json

May 23, 2019 in Apache Spark by Ritu
 • 3,878 views
0 votes
1 answer

Starting Spark in Windows

May 22, 2019 in Apache Spark by Jishan
 • 2,083 views
0 votes
1 answer

Spark: Saving file csv

May 22, 2019 in Apache Spark by Jai
 • 3,695 views
+1 vote
2 answers

How can I convert Spark Dataframe to Spark RDD?

Jul 4, 2018 in Apache Spark by code799
 • 23,019 views
0 votes
1 answer

Difference between Spark ML & Spark MLlib package

Jul 4, 2018 in Apache Spark by code799
 • 3,761 views
0 votes
3 answers

Sorting rows in descending order in Spark SQL

Jul 4, 2018 in Apache Spark by code799
 • 18,770 views
+2 votes
14 answers

How to create new column with function in Spark Dataframe?

Jun 26, 2018 in Apache Spark by coldcode
 • 2,090 points • 99,539 views
0 votes
1 answer

Minimizing Data Transfers in Spark

Jun 19, 2018 in Apache Spark by shams
 • 3,670 points • 3,070 views
0 votes
1 answer

How to find the number of elements present in the array in a Spark DataFame column?

Jun 6, 2018 in Apache Spark by code799
 • 24,449 views
0 votes
3 answers

Filtering a row in Spark DataFrame based on matching values from a list

Jun 6, 2018 in Apache Spark by code799
 • 95,765 views
0 votes
1 answer

Convert the given Spar rdd object to Spark DataFrame.

Jun 6, 2018 in Apache Spark by code799
 • 2,339 views
0 votes
1 answer

Different Spark Ecosystem

Jun 4, 2018 in Apache Spark by shams
 • 3,670 points • 2,312 views
0 votes
1 answer

How to import the dependencies of Spark MLlib into eclipse project?

May 31, 2018 in Apache Spark by hack236
 • 3,452 views
0 votes
1 answer

Spark Machine Learning pipeline works fine in Spark 1.6, but it gives error when executed on Spark 2.x?

May 31, 2018 in Apache Spark by hack236
 • 2,198 views
0 votes
1 answer

What is Spark Piping?

May 31, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 3,371 views
0 votes
1 answer

How to convert rdd object to dataframe in spark

May 30, 2018 in Apache Spark by Shubham
 • 13,490 points • 5,586 views
0 votes
3 answers

How to transpose Spark DataFrame?

May 24, 2018 in Apache Spark by anonymous
 • 22,665 views
0 votes
1 answer

Getting error while connecting zookeeper in Kafka - Spark Streaming integration

May 24, 2018 in Apache Spark by user-code
 • 4,194 views
0 votes
1 answer

How to set keys & access tokens for Twitter Spark streaming?

May 24, 2018 in Apache Spark by coder_jazz
 • 3,158 views
0 votes
2 answers

In a Spark DataFrame how can I flatten the struct?

May 24, 2018 in Apache Spark by code799
 • 8,229 views
0 votes
3 answers

How to connect Spark to a remote Hive server?

May 17, 2018 in Big Data Hadoop by code799
 • 15,246 views
+2 votes
4 answers

use length function in substring in spark

May 3, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 47,629 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.