Trending questions in Big Data Hadoop

–1 vote
1 answer

Create Hive table with bucketing and ORC file format

create table hive_dml (emp_id int, first_name string, last_name ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 3,942 views
–1 vote
1 answer

Namenode daemon not starting properly

Add this in your hdfs-site.xml <property> ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 3,636 views
0 votes
1 answer

Hadoop: Format namenode gives error: Shutting down NameNode at java.net.UnknownHostException

UnknownHostException is thrown when hadoop tries to resolve ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 6,179 views
0 votes
2 answers

Which one among the both MapRed and MapReduce is considered better to create a Hadoop job?

The new API is cleaner and faster. ...READ MORE

Mar 11, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,070 views
0 votes
1 answer

How to import PIG data into HBase?

Follow the below steps to do it: # ...READ MORE

Feb 15, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,085 views
0 votes
1 answer

Hive installation on Linux

Download hive from: http://www.apache.org/dyn/closer.cgi/hive/ Extract the files using ...READ MORE

Feb 28, 2019 in Big Data Hadoop by Mahesh
 • 1,513 views
0 votes
1 answer

Hadoop: How to copy directory from local system to hdfs using Java code?

Just use the FileSystem's copyFromLocalFile method. If the source Path ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 6,056 views
0 votes
1 answer

Doubt regarding --last-value in sqoop while importing.

I think you are a little confused. ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,848 views
0 votes
1 answer

Unable to execute HDFS commands on the terminal

Maybe because you have not started hadoop ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,328 views
0 votes
1 answer

What does hadoop mean?

I see that you are confused about ...READ MORE

Mar 6, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 1,109 views
0 votes
1 answer

Hadoop Mapper is failed because of the following error - “Container killed by the ApplicationMaster”

I suggest you include below property files ...READ MORE

Dec 1, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 5,246 views
0 votes
1 answer

How does Avro schema evolution work?

If you have one avro file and ...READ MORE

Sep 19, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 8,351 views
0 votes
1 answer

Sqoop installation on Linux

Before installing Sqoop, make sure Hadoop is ...READ MORE

Feb 26, 2019 in Big Data Hadoop by Kriti
 • 1,415 views
0 votes
1 answer

Point data from Hive to Hbase

Refer to the below steps to transfer ...READ MORE

Feb 15, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,905 views
0 votes
1 answer

Location of Sqoop job

It depends on how you are running ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,666 views
0 votes
1 answer

Unable to run import script using sqoop

You are writing incorrect command. Please write ...READ MORE

Mar 8, 2019 in Big Data Hadoop by Raj
 • 918 views
0 votes
1 answer

What do you understand by an inner bag and outer bag in Pig?

Outer bag or relation is nothing but ...READ MORE

Feb 21, 2019 in Big Data Hadoop by Frankie
 • 9,830 points • 1,547 views
0 votes
1 answer

Bucketing in Hive

By default, only 1 bucket will be ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,945 views
0 votes
1 answer

Validation in Spark

This can be prevented if you use ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,590 views
0 votes
1 answer

How to install scala on Ubuntu?

You can install Scala using apt-get using the ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,586 views
0 votes
1 answer

Pig mapreduce mode vs local mode?

Both MapReduce mode and local mode seem ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 3,559 views
0 votes
1 answer

Hadoop Hive: recursively descending into subdirectories without partitions or editing hive-site.xml

 I set the following properties before I ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 5,713 views
0 votes
1 answer

Sqoop overwrite a directory

You can use the --hive-overwrite: $ sqoop import --connect ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,884 views
0 votes
1 answer

Installing Pig on Linux System

It was a good thing that you ...READ MORE

Feb 27, 2019 in Big Data Hadoop by Yuri
 • 1,154 views
0 votes
1 answer

How to get absolute path of files in a directory in Hadoop?

You can use HDFS API like the ...READ MORE

Dec 4, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,814 views
0 votes
1 answer

Update new sql data in sqoop

You can use incremental for this. When ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,814 views
0 votes
1 answer

com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure

Sqoop is not able to communicate with ...READ MORE

Jan 29, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,406 views
0 votes
1 answer

Hadoop Hive: How to convert multiple rows into comma separated values?

You can use the aggregator function collect_set to do ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 5,648 views
0 votes
2 answers

Command to check the Hadoop distribution as well as it’s version which is installed in my cluster

One of the options to check the ...READ MORE

Apr 15, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 5,777 views
0 votes
1 answer

Error while hitting the hadoop jar command to execute my map reduce

Since your jar file was inside the ...READ MORE

Feb 12, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,788 views
0 votes
1 answer

Sqoop import where clause problem

The syntax you are using is wrong. ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,264 views
0 votes
1 answer

Difference between Application Master and Application Manager?

The Application Master is responsible for the ...READ MORE

Apr 10, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 15,000 views
0 votes
1 answer

How to count meta data?

In Hadoop, Namenode consumes about 150 bytes ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,878 views
0 votes
1 answer

Sqoop import failed while importing mysql table to Hbase

There is a spelling mistake in your ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,912 views
+1 vote
3 answers

HIVE: java.net.URISyntaxException

Change in hfs-site.xml this properties <name>hive.exec.scratchdir</name> <value>/tmp/hive-${user.name}</value> <name>hive.exec.local.scratchdir</name> <value>/tmp/${user.name}</value> <name>hive.downloaded.resources.dir</name> <value>/tmp/${user.name}_resources</value> <name>hive.scratch.dir.permission</name> ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Roshan
 • 5,444 views
0 votes
1 answer

Hadoop: localhost: Error: JAVA_HOME is not set.

Seems like PATH problem in hadoop-env.sh file. Try ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 5,897 views
0 votes
1 answer

Value for HADOOP_CONF_DIR from Cluster

Install Hadoop as well. In my case ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Frankie
 • 9,830 points • 3,356 views
0 votes
1 answer

Not able to run hdfs commands

Because you said it ran yesterday and ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 3,350 views
0 votes
1 answer

To whom is the Hadoop job submitted?

When a hadoop job is submitted, it ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Loki
 • 1,334 views
0 votes
1 answer

Speculative Execution in Hadoop

In Hadoop, Speculative Execution is a process ...READ MORE

Aug 28, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 8,893 views
0 votes
1 answer

Hadoop HDFS: Exception in createBlockOutputStream

It's a connection error. Have you turned ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 5,219 views
0 votes
1 answer

Hadoop Hive: Correlating expression cannot contain unqualified column references

Try the following command and see if ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,606 views
0 votes
1 answer

How to perform a word count on a dataframe column?

You can use the below code to ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,455 views
0 votes
1 answer

Hbase: Client not able to connect with remote Hbase server

You have to remove the localhost entry from hbase server's ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 5,684 views
0 votes
1 answer

How to run Java file in Hadoop?

Try this: hadoop fs -cat hdfs:///user/hadoop/values.txt READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,160 views
0 votes
1 answer

Pig: mismatched input "T1" expecting RIGHT_CURLY

In Pig, the bag and tuple format ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Yuri
 • 1,418 views
–1 vote
1 answer

Error while creating Hive Database table

In your error, it says that the ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 3,008 views
0 votes
1 answer

Not able to delete file using pig

rmf is a hadoop file system command and you ...READ MORE

Feb 4, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,829 views
+1 vote
1 answer

How to read HDFS and local files with the same code in Java?

You can try something like this: ​ ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,932 views
0 votes
1 answer

Differentiate: hadoop fs -text vs hadoop fs -cat vs hadoop fs -get

The main difference between -cat and -text ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,418 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.