Recent questions tagged big-data

0 votes
1 answer

Copy file from local to hdfs from the spark job in yarn mode

Jul 16, 2019 in Big Data Hadoop by Kriti
 • 12,254 views
0 votes
1 answer

How does data gets split in Sqoop?

Jul 16, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 9,513 views
0 votes
1 answer

how to store images and videos on to HDFS?

Jul 16, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 3,537 views
0 votes
1 answer

Spark Processing Internals

Jul 15, 2019 in Apache Spark by John
 • 2,464 views
0 votes
1 answer

Pig script not dumping the data correctly

Jul 15, 2019 in Big Data Hadoop by Tony
 • 1,564 views
0 votes
1 answer

Spark-shell not working

Jul 15, 2019 in Apache Spark by Rishi
 • 5,462 views
0 votes
2 answers

Error in running hdfs commands

Jul 15, 2019 in Big Data Hadoop by Suman
 • 2,467 views
0 votes
1 answer

How to Import the complete directory into HDFS?

Jul 15, 2019 in Big Data Hadoop by Naruto
 • 1,123 views
0 votes
1 answer

Which one is better MR or Spark?

Jul 15, 2019 in Big Data Hadoop by Lohit
 • 2,233 views
0 votes
1 answer

Sqoop: Dsqoop.export.records.per.statement option

Jul 15, 2019 in Big Data Hadoop by Quill
 • 3,802 views
0 votes
1 answer

Load data into teradata using sqoop

Jul 15, 2019 in Big Data Hadoop by Kunal
 • 2,716 views
0 votes
2 answers

Exception in thread "main" java.lang.UnsupportedClassVersionError

Jul 15, 2019 in Big Data Hadoop by KS
 • 2,077 views
0 votes
1 answer

Import JSON file into hive

Jul 15, 2019 in Big Data Hadoop by Kiran
 • 15,309 views
0 votes
1 answer

Hive Query to sort data

Jul 14, 2019 in Big Data Hadoop by Esha
 • 1,337 views
0 votes
1 answer

Creating a hive script and execute in the edureka cloudlab.

Jul 14, 2019 in Big Data Hadoop by Brian
 • 1,167 views
0 votes
1 answer

Spark memory processing on a not temporary table

Jul 14, 2019 in Apache Spark by Kunal
 • 1,997 views
0 votes
1 answer

Can we change the path where the Hive data is stored in HDFS?

Jul 14, 2019 in Apache Spark by Kevin
 • 1,441 views
0 votes
1 answer

What does the command df.registerTempTable() do?

Jul 14, 2019 in Apache Spark by ophelia
 • 9,119 views
0 votes
1 answer

Spark: How can i create temp views in user defined database instead of default database?

Jul 14, 2019 in Apache Spark by Ashul
 • 5,061 views
0 votes
1 answer

org.apache.spark.sql.AnalysisException: cannot resolve "`id`" given input columns

Jul 14, 2019 in Apache Spark by Esha
 • 18,157 views
0 votes
1 answer

Difference between cogroup and full outer join in spark

Jul 14, 2019 in Apache Spark by Hiran
 • 10,585 views
0 votes
2 answers

How to set up Map and Reduce Tasks?

Jul 12, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,744 views
+1 vote
1 answer

How do I turn off INFO Logging in Spark?

Jul 12, 2019 in Apache Spark by nitinrawat895
 • 11,380 points • 6,813 views
0 votes
1 answer

Working of map function on data

Jul 11, 2019 in Apache Spark by Medha
 • 1,478 views
0 votes
1 answer

Unable to Locate WinUtils Library in Hadoop binary path.

Jul 11, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,548 views
0 votes
1 answer

How to remove duplicate records from Hive table?

Jul 11, 2019 in Big Data Hadoop by Isha
 • 10,535 views
0 votes
1 answer

Spark error: Caused by: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

Jul 11, 2019 in Apache Spark by Raghu
 • 8,416 views
0 votes
1 answer

Is fetching data from apache flume webcrawling?

Jul 11, 2019 in Apache Spark by Karan
 • 1,321 views
0 votes
1 answer

Why do we use sc.parallelize?

Jul 11, 2019 in Apache Spark by Sumit
 • 13,957 views
0 votes
1 answer

Hive: ParseException line 5:20 missing EOF at '.' near

Jul 11, 2019 in Big Data Hadoop by Dinesh
 • 19,214 views
0 votes
1 answer

Not able to upload files to hdfs: No such file or directory

Jul 11, 2019 in Big Data Hadoop by Punit
 • 5,114 views
0 votes
1 answer

HDFS: Upload file from local file system to Edureka cloud lab

Jul 11, 2019 in Big Data Hadoop by Rehan
 • 1,959 views
0 votes
1 answer

Command to copy file from desktop to hdfs

Jul 11, 2019 in Big Data Hadoop by Quill
 • 4,597 views
0 votes
1 answer

Error Loading data to mysql in Spark

Jul 11, 2019 in Apache Spark by Karan
 • 1,628 views
0 votes
1 answer

How to retrieve/get complete HQL hive query from hive,spark and tez?

Jul 11, 2019 in Big Data Hadoop by Esha
 • 5,014 views
0 votes
1 answer

Spark Streaming Pyspark code not working

Jul 11, 2019 in Apache Spark by Rishi
 • 2,843 views
0 votes
1 answer

Pig: Does these jar files run in NodeManager to produce result?

Jul 10, 2019 in Big Data Hadoop by Will
 • 1,004 views
0 votes
1 answer

Is data sent to some other location to be processed in pig?

Jul 10, 2019 in Big Data Hadoop by Rishi
 • 1,013 views
0 votes
1 answer

When and when not to use PigStore?

Jul 10, 2019 in Big Data Hadoop by July
 • 1,085 views
0 votes
1 answer

Use of Group ALL in Pig

Jul 10, 2019 in Big Data Hadoop by Esha
 • 4,079 views
0 votes
1 answer

How to import data to hbase database?

Jul 10, 2019 in Big Data Hadoop by Rina
 • 6,025 views
+1 vote
1 answer

How to add package com.databricks.spark.avro in spark?

Jul 10, 2019 in Apache Spark by Karuna
 • 6,825 views
0 votes
1 answer

Sqoop ERROR 1290 (HY000): The MySQL server is running with the --secure-file-priv option

Jul 10, 2019 in Big Data Hadoop by Adi
 • 2,979 views
0 votes
1 answer

Query regarding Appending " to a string in Scala

Jul 10, 2019 in Apache Spark by Rishi
 • 2,722 views
0 votes
1 answer

org.apache.spark.sql.AnalysisException: cannot resolve given input columns

Jul 10, 2019 in Apache Spark by Firoz
 • 44,154 views
0 votes
1 answer

Query regarding Operator Overloading in Scala

Jul 10, 2019 in Apache Spark by Rachit
 • 2,104 views
0 votes
1 answer

Syntax to mention that the data is enclosed in double quotes in pig

Jul 10, 2019 in Big Data Hadoop by Giri
 • 1,744 views
0 votes
1 answer

How can we ignore header line while loading data into Pig?

Jul 10, 2019 in Big Data Hadoop by Ritu
 • 3,337 views
0 votes
2 answers

Error : split value is not a member of org.apache.spark.sql.Row

Jul 10, 2019 in Apache Spark by Kiran
 • 13,030 views
0 votes
1 answer

Can we use different i/p and o/p format classes in mapreduce code?

Jul 10, 2019 in Big Data Hadoop by Joshua
 • 1,191 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.