Trending questions in Big Data Hadoop

0 votes
1 answer

Not able to install hadoop using maven

First make sure you have ant installed ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,357 views
0 votes
1 answer

All daemons starting except datanode

There could be more than one reason ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,695 views
–1 vote
1 answer

Mapreduce in Python

mapper.py #!/usr/bin/python import sys #Word Count Example # input comes from ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,763 views
0 votes
1 answer

Mapreduce shuffle and sort

The mapreduce task happens in the following ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,370 views
0 votes
1 answer

How to configure Hosts file for Hadoop Eco-System?

For UBUNTU Hosts File and other configuration for Hadoop ...READ MORE

Sep 25, 2018 in Big Data Hadoop by Frankie
• 9,830 points
5,362 views
0 votes
1 answer

What is local file System?

LocalFS means it may be your LinuxFS ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,020 views
0 votes
1 answer

What is the difference between Hadoop API and Streaming?

Usually we have Map/Reduce pair written in ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Neha
• 6,300 points
1,973 views
0 votes
1 answer

Hadoop MapReduce wordcount "type job is not applicable for the arguments" error

The combiner class is not required in ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,644 views
–1 vote
1 answer

Hadoop cluster is not running in vm

First check if all daemons are running: sudo ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,359 views
0 votes
1 answer

I want to install snappy on Hadoop 1.2.1. How do I do that?

As per Cloudera, if you install hadoop ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,977 views
0 votes
3 answers

How to specify KeyValueTextInputFormat Separator in Hadoop-.20 api?

conf.set("key.value.separator.in.input.line", ","); Job job = new ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Rio
3,068 views
0 votes
1 answer

Which side join is taken by default by hive? Map-side or Reduce-side?

The syntax for Map-side join and Reduce-side ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,870 views
0 votes
1 answer

How to Upgrade Apache Hadoop from 2.4.1 to 2.6.0

If the downtime is not an issue, ...READ MORE

Nov 30, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,433 views
0 votes
1 answer

Not able to list sqoop jobs

It seems like you are missing a ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,839 views
0 votes
1 answer

How to export file from sqoop to sql table?

For SQOOP export please try below command: bin/sqoop ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,798 views
+2 votes
1 answer

How To Configure Tls Encryption For Cloudera Manager?

The Cloudera Connect Partner Program, more than ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,511 views
–1 vote
1 answer

File is available at HDFS location. Still system throws en error.

This is happening because the file name ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,180 points
1,008 views
0 votes
1 answer

Datanode not running and not able start

Please type the below command in the ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,498 views
0 votes
1 answer

Hadoop Data node acknowledgement

Let's understand full write mechanism so that ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,583 views
0 votes
1 answer

Hadoop Hive partitioning

Partitioning: Hive has been one of the preferred ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,795 views
0 votes
1 answer

In Hadoop what does dfs replicate mean?

The total number of files in the ...READ MORE

Sep 25, 2018 in Big Data Hadoop by Frankie
• 9,830 points
5,196 views
+1 vote
1 answer

Do Cloudera’s Products Work With My Existing Data Management Infrastructure?

The Cloudera Connect Partner Program, more than ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,477 views
0 votes
1 answer

Sqoop import not working

The error you are getting is because ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,545 views
0 votes
1 answer

Hadoop: How to keep duplicates in Hive using collect_set()?

SELECT hash_id, COLLECT_LIST(num_of_cats) AS ...READ MORE

Nov 2, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,534 views
0 votes
1 answer

What does AM in “AM Container” mean in Hadoop

Here's another link from Hadoop which may ...READ MORE

Nov 2, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,527 views
0 votes
1 answer

Hadoop: Not able to start Namenode

Stop all running server 1) stop-all.sh Edit the ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,263 views
–1 vote
1 answer

Namenode start error

Seems like the content in core-site.xml file is ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,217 views
0 votes
1 answer

Hadoop mapreduce java: NullPoint Exception

Try this: String cords = it.next().toString(); lattitude = Double.toString((inst.decode(cords))[0]); longitude ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,698 views
0 votes
1 answer

How to connect impala to cloud lab?

impala-shell -i <domain_name>: <port > READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,737 views
0 votes
1 answer

Error while connecting to Hive using Java JDBC

Use ​org.apache.hive.jdbc.HiveDriver as your driver ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,658 views
0 votes
1 answer

Getting some warning/error while loading java file using Hbase commands

In your code, you have set some ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,669 views
+1 vote
1 answer

Hadoop: Using composite-key

You can use a Writable, something like ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,989 views
0 votes
1 answer

How to create external Hive table?

It's simple. You just have to add external ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,635 views
0 votes
1 answer

Command to partition table in Hive

Yes, You need to mention the below ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,496 views
0 votes
1 answer

Which is helpful SVN or Git for Hadoop Development?

The official location for Hadoop is the ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,956 views
+3 votes
5 answers

Hadoop DistributedCache is deprecated - what is the preferred API?

I had the same problem. And not ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Rohan
4,399 views
–1 vote
1 answer

What is shared FS in the standby namenode?

Shared FS Basically implies to the high ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,390 views
0 votes
1 answer

Can not list/access files of local system from hadoop

You can not directory use files from ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,676 views
0 votes
1 answer

How to provide encryption for Cloudera HDFS?

You can provide security to cloudera hdfs by using HDFS ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,290 views
0 votes
1 answer

How to move Word and PDF documents to Hadoop HDFS?

Try with below commands: hadoop fs -copyFromLocal <localsrc> ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,984 views
0 votes
2 answers

How to convert .txt file to Hadoop's sequence file format

import java.io.IOException; import java.net.URI; import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.fs.FileSystem; import org.apache.hadoop.fs.Path; import org.apache.hadoop.io.IOUtils; import ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Sanjay
4,580 views
0 votes
1 answer

Hadoop Spark: What is version to find SparkSession in library Spark?

you need both core and SQL artifacts <repositories> ...READ MORE

Nov 13, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,931 views
0 votes
1 answer

Unable to set JAVA_HOME path.

Check if bin/start-all.sh doesn't override JAVA_HOME put echo ...READ MORE

Dec 1, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,176 views
0 votes
1 answer

How to implement sqoop jobs?

Step 1: Give the below command to ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,401 views
0 votes
1 answer

Free Hadoop Cluster Experiments

I doubt if there is something which ...READ MORE

Nov 27, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,286 views
0 votes
1 answer

How to use sqoop import?

Here is an example of import command. ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,553 views
0 votes
1 answer

Executing mapper and reducer individually

This is what happens: Map reduce framework will ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,363 views
0 votes
1 answer

Hadoop: How to use Jps command with Sun JDK installed?

You can put JPS into your path ...READ MORE

Nov 9, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,024 views
0 votes
1 answer

What are the different relational operations in “Pig Latin” you worked with?

Different relational operators are: for each order by fil ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,506 views
0 votes
1 answer

Hadoop Pig: java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/filter/Filter

This seems like a problem with the ...READ MORE

Nov 16, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,703 views