Recent questions tagged spark

0 votes
1 answer

Spark Core How to fetch max n rows of an RDD function without using Rdd.max()

Dec 3, 2020 in Apache Spark by Prashant
 • 120 points • 3,569 views
+1 vote
1 answer

When to use Hadoop, HBase, Hive and Pig?

Nov 20, 2020 in Big Data Hadoop by anonymous
 • 10,440 points • 2,159 views
0 votes
1 answer

File not found exception while processing the spark job in yarn cluster mode with multinode hadoop cluster

Jul 30, 2020 in Apache Spark by Ganendra
 • 140 points • 6,619 views
0 votes
1 answer

how to run spark job from EC2 to EMR?

Jun 25, 2020 in Apache Spark by Edureka
 • 120 points • 3,605 views
0 votes
1 answer

Can the executor core be greater than the total number of spark tasks?

Jun 17, 2020 in Apache Spark by Rishi
 • 160 points • 3,425 views
0 votes
1 answer

Where can I get best spark tutorials for beginners?

May 14, 2020 in Apache Spark by akhtar
 • 38,260 points • 1,788 views
0 votes
1 answer

TypeError: Invalid param value given for param "inputCols". Could not convert DataFrame[R&D Spend: double, Administration: double, Marketing Spend: double]to list of strings

May 7, 2020 in Apache Spark by akhtar
 • 38,260 points • 4,089 views
0 votes
1 answer

Error: No module named 'findspark'

May 6, 2020 in Apache Spark by akhtar
 • 38,260 points • 23,452 views
0 votes
1 answer

ImportError: No module named 'pyspark'

May 6, 2020 in Apache Spark by akhtar
 • 38,260 points • 17,963 views
0 votes
1 answer

env: ‘python’: No such file or directory in pyspark.

Apr 7, 2020 in Apache Spark by akhtar
 • 38,260 points • 7,834 views
0 votes
0 answers

One Hot Encoding in Apache Spark

Feb 11, 2020 in Apache Spark by Manish
 • 120 points • 3,539 views
0 votes
1 answer

Exception in thread "main" java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: ${system:java.io.tmpdir%7D/$%7Bsystem:user.name%7D

Feb 5, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 10,471 views
0 votes
1 answer

Does spark streaming provides checkpoint?

Feb 4, 2020 in Apache Spark by akhtar
 • 38,260 points • 2,636 views
0 votes
0 answers

not able to get output in spark streaming??

Feb 4, 2020 in Apache Spark by akhtar
 • 38,260 points • 1,745 views
0 votes
1 answer

Is Spark Sql provides indexing to improve processing speed?

Feb 4, 2020 in Apache Spark by akhtar
 • 38,260 points • 2,011 views
0 votes
1 answer

What are Dstreams?

Feb 4, 2020 in Apache Spark by akhtar
 • 38,260 points • 2,269 views
+1 vote
1 answer

is not a Parquet file. expected magic number at tail [80, 65, 82, 49] but found [51, 53, 10, 10]

Feb 3, 2020 in Apache Spark by akhtar
 • 38,260 points • 21,366 views
0 votes
1 answer

env : R : No such file or directory

Jan 31, 2020 in Apache Spark by Hasid
 • 370 points • 2,854 views
0 votes
1 answer

Not enough space to cache rdd_80_1 in memory!

Jan 29, 2020 in Apache Spark by akhtar
 • 38,260 points • 4,034 views
+1 vote
0 answers

How to create a list of RDDs(or RDD of RDDs, if possible) from a single JavaRDD<List<Integers>> in Java?

Jan 11, 2020 in Apache Spark by itsroops
 • 130 points • 4,133 views
+1 vote
1 answer

Is there any efficient way of dealing null values during concat functionality of pyspark.sql version 2.3.4?

Nov 5, 2019 in Apache Spark by aizhar
 • 130 points • 46,672 views
0 votes
1 answer

Primary keys in Apache Spark

Sep 11, 2019 in Apache Spark by nitinrawat895
 • 11,380 points • 2,711 views
+1 vote
1 answer

Primary keys in Apache Spark

Aug 9, 2019 in Apache Spark by nitinrawat895
 • 11,380 points • 7,726 views
0 votes
1 answer

How do I access the Map Task ID in Spark?

Jul 23, 2019 in Apache Spark by nitinrawat895
 • 11,380 points • 3,360 views
0 votes
1 answer

Spark Null Pointer Exception.

Jul 19, 2019 in Apache Spark by nitinrawat895
 • 11,380 points • 8,199 views
0 votes
1 answer

Primary keys in apache Spark

Jul 11, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,460 views
0 votes
1 answer

Is it possible to run Apache Spark without Apache Hadoop?

Jun 17, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,017 views
0 votes
1 answer

Is there a possibility to run Apache Spark without Hadoop?

Jun 6, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,689 views
0 votes
1 answer

Is it possible to run Apache Spark without Hadoop?

May 3, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,775 views
+1 vote
2 answers

How do I get number of columns in each line from a delimited file??

Mar 8, 2019 in Apache Spark by Vijay Dixon
 • 190 points • 8,046 views
0 votes
1 answer

Spark workers are not accepting any job (Kubernetes-Docker-Spark)

Feb 27, 2019 in Apache Spark by Hamza
 • 200 points • 3,847 views
0 votes
1 answer

Spark SQL in databricks

Feb 24, 2019 in Apache Spark by Sunny
 • 3,325 views
+1 vote
1 answer

Spark interview

Feb 7, 2019 in Apache Spark by anonymous
 • 2,145 views
0 votes
1 answer

ReduceByKey Avereage

Jan 22, 2019 in Big Data Hadoop by slayer
 • 29,370 points • 1,905 views
0 votes
1 answer

What is Executor Memory in a Spark application?

Jan 5, 2019 in Apache Spark by Neha
 • 6,300 points • 7,812 views
–1 vote
1 answer

How to start pyspark?

Jan 3, 2019 in Big Data Hadoop by digger
 • 26,740 points • 1,577 views
–1 vote
1 answer

How we can run spark SQL over hive tables in our cluster?

Dec 26, 2018 in Big Data Hadoop by digger
 • 26,740 points • 3,079 views
0 votes
1 answer

Apache Spark vs MapReduce

Dec 19, 2018 in Big Data Hadoop by slayer
 • 29,370 points • 2,348 views
0 votes
1 answer

Can you build “Spark” with any particular Hadoop version?

Dec 14, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 2,374 views
0 votes
1 answer

How to get ID of a map task in Spark?

Nov 20, 2018 in Apache Spark by Neha
 • 6,300 points • 4,803 views
0 votes
1 answer

How to open/stream .zip files through Spark?

Nov 20, 2018 in Apache Spark by Neha
 • 6,300 points • 3,708 views
0 votes
1 answer

Hadoop Spark: __spark_lib.zip does not exist

Nov 15, 2018 in Big Data Hadoop by digger
 • 26,740 points • 4,006 views
0 votes
1 answer

Hadoop Spark: What is version to find SparkSession in library Spark?

Nov 13, 2018 in Big Data Hadoop by digger
 • 26,740 points • 3,274 views
0 votes
1 answer

Is 'sparkline' a method?

Nov 9, 2018 in Apache Spark by Neha
 • 6,300 points • 2,868 views
0 votes
1 answer

Filter, Option or FlatMap in spark

Nov 9, 2018 in Apache Spark by Neha
 • 6,300 points • 3,963 views
0 votes
3 answers

Hadoop Spark: How to iterate hdfs directories?

Oct 29, 2018 in Big Data Hadoop by digger
 • 26,740 points • 13,055 views
0 votes
1 answer

Does Hadoop and Spark support iPv6 now?

Oct 15, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 3,315 views
0 votes
1 answer

Internal work of Spark

Oct 11, 2018 in Apache Spark by Meci Matt
 • 9,460 points • 1,999 views
0 votes
1 answer

Spark - repartition() vs coalesce()

Oct 11, 2018 in Apache Spark by Meci Matt
 • 9,460 points • 9,173 views
0 votes
1 answer

What should be the choice of database and what type of data format is suitable for Spark/hadoop?

Sep 28, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 2,510 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.