Trending questions in Big Data Hadoop

–1 vote
1 answer

Spark multiple version without major version

Yes. It is not necessary to set ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,220 points
800 views
0 votes
1 answer

How to read Spark elements having multiple lines each?

Try this: val new_records = sc.newAPIHadoopRDD(hadoopConf,classOf[ ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,402 views
0 votes
2 answers

How to exit NameNode safe mode?

hadoop dfsadmin -safemode leave READ MORE

Apr 11, 2019 in Big Data Hadoop by anonymous
3,959 views
–1 vote
1 answer

Can't seem to make hdfs commands to work

Check the ip address mentioned in core-site.xml ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,054 views
0 votes
1 answer

Hadoop regarding input split

Hadoop framework divides a large file into ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,220 points
743 views
0 votes
1 answer

Not able to start jobtracker in hadoop

There is no jobtracker in hadoop 2.2.0 YARN framework. ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,415 views
–1 vote
1 answer

Mapreduce in Python

mapper.py #!/usr/bin/python import sys #Word Count Example # input comes from ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,054 views
–1 vote
1 answer

Hadoop cluster is not running in vm

First check if all daemons are running: sudo ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,220 points
772 views
0 votes
1 answer

Cant find slave on ResourceManager Web UI

Seems like it is running on default ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,668 views
0 votes
1 answer

Mapreduce shuffle and sort

The mapreduce task happens in the following ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,220 points
676 views
0 votes
1 answer

How is a file written in hdfs?

When you copy a file from the ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
941 views
–1 vote
1 answer

File is available at HDFS location. Still system throws en error.

This is happening because the file name ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,220 points
450 views
–1 vote
1 answer

Facing the below error while installing mysql in VM

We would like to say that the ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
963 views
0 votes
1 answer

What is local file System?

LocalFS means it may be your LinuxFS ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,313 views
0 votes
1 answer

All daemons starting except datanode

There could be more than one reason ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
867 views
0 votes
1 answer

How to fix corrupt HDFS FIles?

You can use hdfs fsck / to ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,337 views
0 votes
1 answer

Not able to install hadoop using maven

First make sure you have ant installed ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,500 views
0 votes
1 answer

Not able to list sqoop jobs

It seems like you are missing a ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,191 views
0 votes
1 answer

How to export file from sqoop to sql table?

For SQOOP export please try below command: bin/sqoop ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,147 views
0 votes
1 answer

Sqoop import not working

The error you are getting is because ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,220 points
965 views
0 votes
1 answer

Datanode not running and not able start

Please type the below command in the ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Omkar
• 69,220 points
862 views
0 votes
1 answer

Apache Spark vs MapReduce

Both Spark and Hadoop MapReduce are used ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,220 points
894 views
0 votes
1 answer

What is the meaning of Write Ahead Log in Hadoop?

Write Ahead Log (WAL) is a file ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Sunil
2,135 views
0 votes
1 answer

Which side join is taken by default by hive? Map-side or Reduce-side?

The syntax for Map-side join and Reduce-side ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,141 views
+2 votes
5 answers

Not able to start hadoop dfs

You can re-install openssh-client and openssh-server: $ sudo ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Jino
3,084 views
0 votes
1 answer

Hadoop Hive partitioning

Partitioning: Hive has been one of the preferred ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,129 views
0 votes
1 answer

Hadoop: Datanode not starting correctly

You can do the following method, copy to ...READ MORE

Nov 5, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,730 views
0 votes
1 answer

Hadoop MapReduce wordcount "type job is not applicable for the arguments" error

The combiner class is not required in ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,220 points
824 views
0 votes
1 answer

Command to partition table in Hive

Yes, You need to mention the below ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,220 points
899 views
0 votes
1 answer

Hadoop Data node acknowledgement

Let's understand full write mechanism so that ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,220 points
834 views
0 votes
1 answer

How to connect impala to cloud lab?

impala-shell -i <domain_name>: <port > READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,042 views
+2 votes
1 answer

How To Configure Tls Encryption For Cloudera Manager?

The Cloudera Connect Partner Program, more than ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Frankie
• 9,830 points
681 views
–1 vote
1 answer

Namenode start error

Seems like the content in core-site.xml file is ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,220 points
483 views
0 votes
1 answer

How to Upgrade Apache Hadoop from 2.4.1 to 2.6.0

If the downtime is not an issue, ...READ MORE

Nov 30, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,575 views
–1 vote
1 answer

What is shared FS in the standby namenode?

Shared FS Basically implies to the high ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
706 views
0 votes
1 answer

I want to install snappy on Hadoop 1.2.1. How do I do that?

As per Cloudera, if you install hadoop ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,070 views
–1 vote
1 answer

Not able to access hadoop cluster

The issue which you are facing is ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
653 views
0 votes
1 answer

What is the difference between Hadoop API and Streaming?

Usually we have Map/Reduce pair written in ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Neha
• 6,300 points
1,004 views
+1 vote
1 answer

Do Cloudera’s Products Work With My Existing Data Management Infrastructure?

The Cloudera Connect Partner Program, more than ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Frankie
• 9,830 points
663 views
0 votes
1 answer

How to provide encryption for Cloudera HDFS?

You can provide security to cloudera hdfs by using HDFS ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
586 views
0 votes
1 answer

How to create external Hive table?

It's simple. You just have to add external ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,220 points
885 views
0 votes
1 answer

Hadoop mapreduce java: NullPoint Exception

Try this: String cords = it.next().toString(); lattitude = Double.toString((inst.decode(cords))[0]); longitude ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,220 points
861 views
–1 vote
1 answer

Is standby node missing in Hadoop 1.0?

Yes, Hadoop 1.0 didn't have standby namenode. ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
634 views
0 votes
1 answer

Error while connecting to Hive using Java JDBC

Use ​org.apache.hive.jdbc.HiveDriver as your driver ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,848 views
0 votes
1 answer

Which is helpful SVN or Git for Hadoop Development?

The official location for Hadoop is the ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,190 views
0 votes
1 answer

What are the different relational operations in “Pig Latin” you worked with?

Different relational operators are: for each order by fil ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
865 views
0 votes
1 answer

Getting some warning/error while loading java file using Hbase commands

In your code, you have set some ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,220 points
848 views
0 votes
1 answer

Executing mapper and reducer individually

This is what happens: Map reduce framework will ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,220 points
671 views
0 votes
1 answer

Unable to set JAVA_HOME path.

Check if bin/start-all.sh doesn't override JAVA_HOME put echo ...READ MORE

Dec 1, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,441 views
0 votes
1 answer

How to use sqoop import?

Here is an example of import command. ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,220 points
840 views