Trending questions in Big Data Hadoop

+1 vote
2 answers

Hadoop Administration

Make the following changes to your configuration ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Simran
2,093 views
+1 vote
0 answers

Output of dump command has empty records

this is my input file output_pig_group_education_comma/input_load.txt and its ...READ MORE

Aug 10, 2019 in Big Data Hadoop by Manju Bhargavi
1,915 views
0 votes
1 answer

HBase shell failed to connect

Enter the below command in the terminal ...READ MORE

Jul 23, 2019 in Big Data Hadoop by Joshua
2,630 views
0 votes
1 answer

What are the different daemons in yarn?

Hi, The different Daemons in YARN are:- Resources Manager:- Runs ...READ MORE

Apr 24, 2019 in Big Data Hadoop by Gitika
• 65,730 points
6,531 views
0 votes
1 answer

How to Compress Map output?

With MR2, now we should set conf.set("mapreduce.map.output.compress", true)  conf.set("mapreduce.output.fileoutputformat.compress", ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Varun
2,554 views
0 votes
1 answer

Error: schemaTool failed

Hey, The error you got because you might ...READ MORE

May 13, 2019 in Big Data Hadoop by Gitika
• 65,730 points
5,662 views
0 votes
1 answer

Error while Loading data to Hive.

Your data node is not running that ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Quill
2,328 views
0 votes
1 answer

How to use appnedToFile command in HDFS?

Hey, This Hadoop fs command appends single sources ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Gitika
• 65,730 points
4,051 views
0 votes
1 answer

Hive: LOCATION and WITH DBPROPERTIES command in create table command

By default, the Hive database will be ...READ MORE

May 22, 2019 in Big Data Hadoop by Firoz
5,245 views
0 votes
1 answer

Which one is better MR or Spark?

The above difference clearly points out that ...READ MORE

Jul 15, 2019 in Big Data Hadoop by Daniel
2,914 views
0 votes
1 answer

Error: permission denied locoalhost: chown: cannot access /usr/local/hadoop/ No such file or directory

Hey, As the error suggested that you have ...READ MORE

Jun 17, 2019 in Big Data Hadoop by Gitika
• 65,730 points
4,114 views
+1 vote
2 answers

Error: com/eng/mr/WordCountDriver : Unsupported major.minor version 52.0

The reason why you get this error ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Venkita
• 240 points
1,898 views
0 votes
2 answers

What is the relationship between Hadoop and Database?

Hadoop software framework work is very well ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Dinesh
2,819 views
0 votes
1 answer

Hive- unable to load data into table

The command you are typing is incorrect. ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Firoz
2,501 views
0 votes
1 answer

Command to see the status of MapReduce job?

Hi, You can use this command given below: Syntax: $ ...READ MORE

Jun 14, 2019 in Big Data Hadoop by Gitika
• 65,730 points
4,235 views
0 votes
0 answers

How to replicate task so that a task will be computed by two mappers? Or each task will be done twice.

i want replicate task of mapper but ...READ MORE

Aug 21, 2019 in Big Data Hadoop by dodo aly
1,241 views
0 votes
1 answer

What is DAG in Hive?

Hey, DAG in Hive architecture is nothing but ...READ MORE

May 11, 2019 in Big Data Hadoop by Gitika
• 65,730 points
5,608 views
0 votes
1 answer

When do Reduce tasks start in Hadoop?

As much I understand Reduce phase start ...READ MORE

Aug 9, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
1,674 views
0 votes
1 answer

Hadoop input folder not found?

Hey, This is because the user directory not ...READ MORE

Jun 14, 2019 in Big Data Hadoop by Gitika
• 65,730 points
4,114 views
0 votes
1 answer

Install PostgreSQL JDBC driver for Sqoop

All you have to do to install ...READ MORE

Jun 6, 2019 in Big Data Hadoop by Quill
4,411 views
0 votes
1 answer

Unable to find Java and eclipse installation on my webconsole.

You can either install java and eclipse ...READ MORE

Aug 9, 2019 in Big Data Hadoop by Isha
1,598 views
0 votes
1 answer

Unable to create table in Hive

It is looking like your Hadoop daemons ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Yogi
1,730 views
0 votes
1 answer

What is fork Keyword in Oozie? How Fork and Join keyword are related t o each other in Oozie?

Hey, Basically, when we want to run multiple jobs ...READ MORE

Jun 12, 2019 in Big Data Hadoop by Gitika
• 65,730 points
4,136 views
0 votes
2 answers

What is the difference between Oozie and Nifi ?

The main difference between Oozie and Nifi ...READ MORE

May 7, 2019 in Big Data Hadoop by Omkar
• 69,180 points
5,615 views
0 votes
1 answer

Can a table be renamed in hive?

Hey, Yes, you can rename a table in ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
• 65,730 points
3,524 views
0 votes
1 answer
0 votes
1 answer

Is it possible to change the default location of a managed table?

Hi, Yes, you can do it by using ...READ MORE

Jun 18, 2019 in Big Data Hadoop by Gitika
• 65,730 points
3,820 views
0 votes
3 answers

Hadoop Spark: How to iterate hdfs directories?

Using PySpark  hadoop = sc._jvm.org.apache.hadoop fs = hadoop.fs.FileSystem conf = ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Kiran
12,985 views
0 votes
1 answer

What are the challenges we faced as Hadoop Admin?

Hey,  There are some of the key responsibilities ...READ MORE

Jun 25, 2019 in Big Data Hadoop by Gitika
• 65,730 points
3,509 views
0 votes
1 answer

Why do we use job.waitForCompletion(true) ?

The main reason for job.waitForCompletion exists is that ...READ MORE

Jul 22, 2019 in Big Data Hadoop by Kiran
2,287 views
0 votes
1 answer
0 votes
1 answer

How to download Large Hadoop[]closed] Data?

The best thing with Millions Songs Dataset ...READ MORE

Jul 23, 2019 in Big Data Hadoop by ravikiran
• 4,620 points

edited Jul 25, 2019 by ravikiran 2,218 views
0 votes
1 answer

Mapreduce: What is the use of setting the name of the job?

Job job = new Job(conf,"job_name"), is just ...READ MORE

Jul 22, 2019 in Big Data Hadoop by Madhu
2,254 views
0 votes
2 answers

Using PHP to get all file names in a folder stored in HDFS

So i found a workaround for the ...READ MORE

Mar 13, 2019 in Big Data Hadoop by Bhavish
• 370 points

edited Mar 13, 2019 by Omkar 7,975 views
0 votes
1 answer

How to merge two consecutive regions using command line in HBase?

Hey, The Master and RegionServer both participate in ...READ MORE

May 29, 2019 in Big Data Hadoop by Gitika
• 65,730 points
4,581 views
0 votes
1 answer

How to fix corrupt files on HDFS

1 - Spark if following slave/master architecture. So ...READ MORE

Jul 18, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,399 views
0 votes
1 answer

HDFS: Upload file from local file system to Edureka cloud lab

To upload a file from your local ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Zora
2,708 views
+1 vote
1 answer

Sqoop: How to load all tables except one?

You can use the import-all-tables option and along with ...READ MORE

Feb 18, 2019 in Big Data Hadoop by Omkar
• 69,180 points
8,837 views
0 votes
1 answer

How to assign server access to client(s) through NFS export file?

Hi, You can create the export folder, you will ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
• 65,730 points
1,576 views
0 votes
1 answer

How to load data from flat files into different partitions of Hive table?

Hi, You can load data from flat files ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
• 65,730 points
3,271 views
0 votes
1 answer

Map-reduce code for finding average salary

You can choose your mapper output key ...READ MORE

May 22, 2019 in Big Data Hadoop by Yogi
4,771 views
0 votes
1 answer

Unable to run Sqoop scirpt to copy data to Cassandra

Unfortunately, this can't be achieved with open ...READ MORE

Jul 23, 2019 in Big Data Hadoop by Shri
2,093 views
0 votes
2 answers

What is ElasticSearch Hadoop?

it as a connector that allows data to flow bi-directionaly so ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Dinish
2,373 views
0 votes
1 answer

Running Mapreduce on compressed data

It is very straight forward, no need ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Nanda
1,997 views
0 votes
1 answer

Mapreduce: custom Input format

Here's a list of Input Formats: CombineFileInputFormat CombineS ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Veer
1,995 views
0 votes
1 answer

Explain to me the correct way to get a Hadoop FileSystem object so that I can use it for reading from HDFS as well as writing to HDFS.

FileSystem needs only one configuration key to successfully ...READ MORE

Jun 7, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
4,005 views
0 votes
1 answer

Output Splitting problem in Hadoop

When you are loading two different files, ...READ MORE

Jul 16, 2019 in Big Data Hadoop by Sayni
2,317 views
0 votes
1 answer

Does Caching stand as the only advantage in Spark compared to Hadoop?

Spark has much lower per job and ...READ MORE

Jul 31, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
1,661 views