Trending questions in Big Data Hadoop

0 votes
1 answer

Hadoop: Format namenode gives error: Shutting down NameNode at java.net.UnknownHostException

UnknownHostException is thrown when hadoop tries to resolve ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
• 69,180 points
7,431 views
0 votes
1 answer

Sqoop error while importing data from MySql

As the error states, the target directory ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,432 views
0 votes
1 answer

How to load multiple tables in Sqoop?

U can use " import-all-tables " option ...READ MORE

Feb 18, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,079 views
+1 vote
3 answers

HIVE: java.net.URISyntaxException

Change in hfs-site.xml this properties <name>hive.exec.scratchdir</name> <value>/tmp/hive-${user.name}</value> <name>hive.exec.local.scratchdir</name> <value>/tmp/${user.name}</value> <name>hive.downloaded.resources.dir</name> <value>/tmp/${user.name}_resources</value> <name>hive.scratch.dir.permission</name> ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Roshan
7,112 views
0 votes
2 answers

Command to check the Hadoop distribution as well as it’s version which is installed in my cluster

One of the options to check the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
7,349 views
0 votes
1 answer

How to install Hadoop in Ubuntu?

Hey. Follow these steps to install hadoop. First ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,003 views
–1 vote
1 answer

Namenode daemon not starting properly

Add this in your hdfs-site.xml <property> ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
• 69,180 points
4,700 views
0 votes
1 answer

How does Avro schema evolution work?

If you have one avro file and ...READ MORE

Sep 19, 2018 in Big Data Hadoop by Frankie
• 9,830 points
9,584 views
0 votes
1 answer

Hadoop: How to copy directory from local system to hdfs using Java code?

Just use the FileSystem's copyFromLocalFile method. If the source Path ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
7,140 views
0 votes
1 answer

What is SerDe in Hadoop Hive?

The SerDe interface allows you to instruct ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Akshay
6,859 views
–1 vote
1 answer

Create Hive table with bucketing and ORC file format

create table hive_dml (emp_id int, first_name string, last_name ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
• 69,180 points
4,954 views
0 votes
1 answer

How to import PIG data into HBase?

Follow the below steps to do it: # ...READ MORE

Feb 15, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,135 views
0 votes
1 answer

Hadoop Mapper is failed because of the following error - “Container killed by the ApplicationMaster”

I suggest you include below property files ...READ MORE

Dec 1, 2018 in Big Data Hadoop by Omkar
• 69,180 points
6,402 views
0 votes
1 answer

How to retrieve the list of sql (Hive QL) commands that has been executed in a hadoop cluster?

Well, what you can do is use ...READ MORE

Apr 4, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
16,754 views
0 votes
1 answer

How to get absolute path of files in a directory in Hadoop?

You can use HDFS API like the ...READ MORE

Dec 4, 2018 in Big Data Hadoop by Frankie
• 9,830 points
6,194 views
0 votes
1 answer

Doubt regarding --last-value in sqoop while importing.

I think you are a little confused. ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,838 views
0 votes
1 answer

Hive installation on Linux

Download hive from: http://www.apache.org/dyn/closer.cgi/hive/ Extract the files using ...READ MORE

Feb 28, 2019 in Big Data Hadoop by Mahesh
2,469 views
0 votes
1 answer

Hadoop Hive: recursively descending into subdirectories without partitions or editing hive-site.xml

 I set the following properties before I ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
• 69,180 points
6,967 views
0 votes
1 answer

What does hadoop mean?

I see that you are confused about ...READ MORE

Mar 6, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,151 views
0 votes
1 answer

Unable to execute HDFS commands on the terminal

Maybe because you have not started hadoop ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,312 views
0 votes
0 answers

Difference between Name node and Secondary Name node

Explain to me the difference between the ...READ MORE

Mar 26, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,278 views
0 votes
1 answer

Hadoop: localhost: Error: JAVA_HOME is not set.

Seems like PATH problem in hadoop-env.sh file. Try ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
• 69,180 points
7,246 views
0 votes
1 answer

Sqoop installation on Linux

Before installing Sqoop, make sure Hadoop is ...READ MORE

Feb 26, 2019 in Big Data Hadoop by Kriti
2,384 views
0 votes
1 answer

Location of Sqoop job

It depends on how you are running ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,642 views
0 votes
1 answer

Hadoop Hive: How to convert multiple rows into comma separated values?

You can use the aggregator function collect_set to do ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
6,833 views
0 votes
1 answer

Point data from Hive to Hbase

Refer to the below steps to transfer ...READ MORE

Feb 15, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,839 views
0 votes
1 answer

Value for HADOOP_CONF_DIR from Cluster

Install Hadoop as well. In my case ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Frankie
• 9,830 points
4,613 views
0 votes
1 answer

What do you understand by an inner bag and outer bag in Pig?

Outer bag or relation is nothing but ...READ MORE

Feb 21, 2019 in Big Data Hadoop by Frankie
• 9,830 points
2,465 views
0 votes
1 answer

Unable to run import script using sqoop

You are writing incorrect command. Please write ...READ MORE

Mar 8, 2019 in Big Data Hadoop by Raj
1,828 views
0 votes
1 answer

Bucketing in Hive

By default, only 1 bucket will be ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,866 views
0 votes
1 answer

Sqoop overwrite a directory

You can use the --hive-overwrite: $ sqoop import --connect ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,852 views
0 votes
1 answer

What does a secondary namenode do in Hadoop?

The Secondary namenode is mainly used as a ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
5,079 views
0 votes
1 answer

How to install scala on Ubuntu?

You can install Scala using apt-get using the ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,450 views
0 votes
2 answers

Not able to use npm after installing yarn

 "The easiest way to get started is ...READ MORE

Feb 5, 2019 in Big Data Hadoop by rajesh
• 1,270 points
3,021 views
0 votes
1 answer

Error while hitting the hadoop jar command to execute my map reduce

Since your jar file was inside the ...READ MORE

Feb 12, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,763 views
+1 vote
1 answer

How to read HDFS and local files with the same code in Java?

You can try something like this: ​ ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
• 69,180 points
6,223 views
0 votes
1 answer

Hbase: Client not able to connect with remote Hbase server

You have to remove the localhost entry from hbase server's ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
• 69,180 points
6,860 views
0 votes
1 answer

Validation in Spark

This can be prevented if you use ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,397 views
0 votes
1 answer

Hadoop HDFS: Exception in createBlockOutputStream

It's a connection error. Have you turned ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
6,321 views
0 votes
1 answer

Not able to run hdfs commands

Because you said it ran yesterday and ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
• 69,180 points
4,413 views
0 votes
1 answer

Installing Pig on Linux System

It was a good thing that you ...READ MORE

Feb 27, 2019 in Big Data Hadoop by Yuri
2,013 views
0 votes
1 answer

Update new sql data in sqoop

You can use incremental for this. When ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,692 views
0 votes
1 answer

com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure

Sqoop is not able to communicate with ...READ MORE

Jan 29, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,278 views
0 votes
2 answers

start-dfs.sh command is not starting Hadoop JobTracker & TaskTracker

On which version of hadoop do you ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Lokesh Singh
5,632 views
0 votes
1 answer

How to run Java file in Hadoop?

Try this: hadoop fs -cat hdfs:///user/hadoop/values.txt READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,180 points
5,278 views
0 votes
1 answer

How to count meta data?

In Hadoop, Namenode consumes about 150 bytes ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,808 views
0 votes
1 answer

Sqoop import where clause problem

The syntax you are using is wrong. ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,102 views
0 votes
1 answer

Sqoop import failed while importing mysql table to Hbase

There is a spelling mistake in your ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,801 views
0 votes
1 answer

How to convert Spark data into CSV?

You can use this: df.write .option("header", "true") ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
6,097 views
0 votes
1 answer

Hadoop: How to get the column name along with the output in Hive?

You can get the column names by ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
6,136 views