Recent questions tagged big-data

0 votes
1 answer

How to declare sets with value in Scala?

Jul 30, 2019 in Apache Spark by Dhiraj
 • 902 views
0 votes
1 answer

Hive: Assign subquery to variable

Jul 30, 2019 in Big Data Hadoop by Kishan
 • 7,642 views
0 votes
1 answer

PySpark not starting: No active sparkcontext

Jul 30, 2019 in Apache Spark by Karan
 • 4,982 views
0 votes
1 answer

FAILEDError: java.io.IOException: Type mismatch in key from map

Jul 30, 2019 in Big Data Hadoop by Will
 • 1,926 views
0 votes
1 answer

Converting CSV files to Parquet

Jul 30, 2019 in Big Data Hadoop by Shri
 • 7,553 views
0 votes
1 answer

Unable to use ml library in pyspark

Jul 30, 2019 in Apache Spark by Yashita
 • 3,034 views
0 votes
1 answer

Scala: org.apache.poi.openxml4j.exceptions.InvalidFormatException: Your InputStream was neither an OLE2 stream, nor an OOXML stream

Jul 30, 2019 in Apache Spark by Nitin
 • 1,844 views
0 votes
1 answer

Unable to run the java- spark standalone program

Jul 30, 2019 in Apache Spark by Junaid
 • 1,337 views
0 votes
1 answer

java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found.

Jul 30, 2019 in Big Data Hadoop by Will
 • 7,856 views
0 votes
1 answer

What is "java.sql.SQLException: org.apache.thrift.transport.TTransportException" in Hive?

Jul 30, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 7,284 views
+1 vote
2 answers

Spark: Dataframe vs Dataset

Jul 29, 2019 in Apache Spark by Jesse
 • 45,968 views
0 votes
1 answer

How to choose number of Executors and Executor cores?

Jul 29, 2019 in Big Data Hadoop by Kim
 • 3,744 views
0 votes
1 answer

Date formats : how to cast string to date?

Jul 29, 2019 in Apache Spark by Rahul
 • 6,066 views
0 votes
1 answer

Error while Loading data to Hive.

Jul 29, 2019 in Big Data Hadoop by Will
 • 1,399 views
0 votes
1 answer

How to fit multiple assignment statements into one statement in Scala?

Jul 29, 2019 in Apache Spark by Raghu
 • 1,081 views
0 votes
1 answer

Killing oozie Jobs by userid

Jul 29, 2019 in Big Data Hadoop by Lohit
 • 2,002 views
0 votes
1 answer

How to search for a Key in a Scala Map?

Jul 29, 2019 in Apache Spark by Ronita
 • 1,339 views
0 votes
1 answer

How to concatenate Maps in Scala?

Jul 29, 2019 in Apache Spark by sunny
 • 2,719 views
0 votes
1 answer

How to declare a Empty Scala Map?

Jul 29, 2019 in Apache Spark by Tarinder
 • 2,698 views
0 votes
1 answer

ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Cannot run program "hive": error=2, No such file or directory

Jul 29, 2019 in Big Data Hadoop by Rasheed
 • 2,226 views
0 votes
1 answer

"main" java.lang.NoClassDefFoundError: org/apache/hadoop/fs/FSDataInputStream

Jul 29, 2019 in Apache Spark by Rishi
 • 6,355 views
+1 vote
3 answers

What is the best way to merge multi-part HDFS files into single file?

Jul 29, 2019 in Big Data Hadoop by Karan
 • 31,361 views
0 votes
1 answer

How the if-else statement is different for Scala and Java?

Jul 29, 2019 in Apache Spark by Nidha
 • 1,124 views
0 votes
1 answer

What is the differentiate between equals() and == in Scala. Is the latter the same as == in Java?

Jul 29, 2019 in Apache Spark by pavitra
 • 1,483 views
0 votes
1 answer

Scala: 30: error: value partitions is not a member of String

Jul 29, 2019 in Apache Spark by Kamal
 • 3,580 views
0 votes
1 answer

Difference between put and copyFromLocal

Jul 29, 2019 in Big Data Hadoop by Karan
 • 13,125 views
0 votes
1 answer

What is Lazy val in Scala?

Jul 29, 2019 in Apache Spark by Ishaan
 • 1,235 views
0 votes
1 answer

What is Case Class in Scala?

Jul 29, 2019 in Apache Spark by Dinesh
 • 1,044 views
0 votes
1 answer

what is an anonymous function Scala?

Jul 29, 2019 in Apache Spark by Ritika
 • 1,225 views
0 votes
1 answer

Consider for-comprehensions in Scala. What are they syntactic sugars for?

Jul 29, 2019 in Apache Spark by Nikita
 • 602 views
0 votes
1 answer

What is Options in Scala?

Jul 26, 2019 in Apache Spark by Suraj
 • 685 views
0 votes
1 answer

What is tail-recursion in Scala?

Jul 26, 2019 in Apache Spark by Sumit
 • 899 views
0 votes
1 answer

What is the work of Yield Keyword in Scala?

Jul 26, 2019 in Apache Spark by Naina
 • 1,068 views
0 votes
1 answer

How to append a list in Scala?

Jul 26, 2019 in Apache Spark by Nishant
 • 6,134 views
0 votes
1 answer

Different types of identifiers in Scala?

Jul 26, 2019 in Apache Spark by rashmi
 • 1,129 views
0 votes
1 answer

How does Closure function works in Scala?

Jul 26, 2019 in Apache Spark by Mehnaj
 • 822 views
0 votes
1 answer

What is a lens in Scala?

Jul 26, 2019 in Apache Spark by Sahan
 • 1,199 views
0 votes
1 answer

What is function currying in Scala?

Jul 26, 2019 in Apache Spark by Lima
 • 1,016 views
0 votes
1 answer

How to call the Debug Mode in PySpark?

Jul 26, 2019 in Apache Spark by nitinrawat895
 • 11,380 points • 6,368 views
0 votes
1 answer

How to use nested function in Scala?

Jul 26, 2019 in Apache Spark by Dheer
 • 1,124 views
0 votes
1 answer

Multiple Output format in Hadoop

Jul 26, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,024 views
0 votes
1 answer

How to use Scala anonymous functions and why do we use it?

Jul 26, 2019 in Apache Spark by sunny
 • 1,019 views
0 votes
1 answer

Does HQL query go to all the nodes to process data?

Jul 26, 2019 in Big Data Hadoop by Tina
 • 800 views
0 votes
1 answer

Why is Hive called as Data Warehouse?

Jul 26, 2019 in Big Data Hadoop by Will
 • 6,571 views
0 votes
1 answer

Spark Submit: class does not exists

Jul 26, 2019 in Apache Spark by Rohit
 • 1,716 views
0 votes
2 answers

How to pass external date parameter in hive hql

Jul 26, 2019 by anonymous
 • 120 points • 2,644 views
0 votes
1 answer

Spark: Read from Hive, store in HDFS

Jul 26, 2019 in Apache Spark by Kiran
 • 2,862 views
0 votes
1 answer

Write data into hive table in a parquet

Jul 26, 2019 in Big Data Hadoop by Amrita
 • 3,107 views
0 votes
1 answer

Explanation to outputcollector vs context

Jul 26, 2019 in Big Data Hadoop by Jai
 • 1,824 views
0 votes
2 answers

Load data into the hive table

Jul 26, 2019 in Big Data Hadoop by Jai
 • 2,270 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.