Trending questions in Big Data Hadoop

–1 vote
1 answer

Getting error when writing to HDFS. Unable to load native-hadoop library for your platform

Try this: sudo service hadoop-master restart After that try ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,948 views
0 votes
1 answer

MapReduce "cannot be resolved to a type" error

One of the reasons could be different ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,950 views
0 votes
1 answer

Not able to start MySql service

Hello. "The system never lies :-P".  The service ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,600 views
–1 vote
1 answer

Not able to execute mapreduce code

Follow the below steps to execute the ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 1,117 views
0 votes
1 answer

Hadoop sqoop import not working. Error: ERROR manager.SqlManager: Error reading from database

In the command, try mentioning the driver ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 2,490 views
0 votes
1 answer

What is -cp command in hadoop? How it works?

/user/cloudera/data1 is not a directory, it is ...READ MORE

Oct 17, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,617 views
+1 vote
1 answer

Why minimum 3 Journal Nodes are required in Hadoop HA architecture?

Initially in Hadoop 1.x, the NameNode was ...READ MORE

Apr 20, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 12,313 views
0 votes
1 answer

Processing image in hdfs

If your block size is 64 MB, ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,508 views
0 votes
1 answer

Hadoop plugin (1.0.3) for eclipse

When you have Hadoop Eclipse plugin installed ...READ MORE

Dec 28, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,499 views
0 votes
1 answer

Transfer data between 2 Tables having issues with Date conversion from string to Date datatype.

This can be solved making use of ...READ MORE

Dec 28, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,450 views
+1 vote
1 answer

What is difference between Hadoop Namenode HA and HDFS federation?

The main difference between HDFS High Availability ...READ MORE

Oct 31, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 3,954 views
0 votes
1 answer

Extracting pig log messages

You can use the following commands in ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 1,001 views
0 votes
1 answer

Hadoop backup and recovery tool and guidance

There are a few options for backup ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Frankie
 • 9,830 points • 1,152 views
–1 vote
1 answer

How to restrict nodes that talk to namenode?

Step 1: Create includes file in /home/hadoop ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 1,148 views
+1 vote
1 answer

Not able to start datanode in Hadoop

Follow these steps: Stop namenode Delete the datanode directory ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 2,057 views
0 votes
1 answer

Small files and HDFS blocks

Multiple files are not stored in a ...READ MORE

Nov 16, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 3,192 views
0 votes
1 answer

Hadoop Spark: __spark_lib.zip does not exist

To find this file, your HADOOP_CONF_DIR env ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 3,241 views
0 votes
1 answer

Hadoop regarding input split

Hadoop framework divides a large file into ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,419 views
0 votes
1 answer

How to securely transfer data from rdms to hdfs using sqoop?

Sqoop stores metadata in a repository and ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,802 views
0 votes
1 answer

How can I calculate exact median with Apache Spark?

You need to sort RDD and take ...READ MORE

Oct 8, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 4,875 views
–1 vote
1 answer

Job History Server edit logs

When the application master fails, each file ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,484 views
0 votes
1 answer

Hive ACID semantics

ACID stands for Atomicity, Consistency, Isolation, and Durability.  Until ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 1,038 views
0 votes
1 answer

How to execute wordcount in Hadoop?

Follow these steps: Step 1:  Import all these hadoop ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,714 views
0 votes
1 answer

How to use mountable HDFS on Centos?

Hey. You can use the following commands ...READ MORE

Nov 26, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 2,695 views
–1 vote
1 answer

Serde input and output

Input Processing Hive's execution engine (referred to as ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,389 views
–1 vote
1 answer

Copying jar file into hadoop

hdfs dfs -put input_file_name output_location READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,716 views
0 votes
1 answer

How do I install cloudera Hadoop without internet connection?

You can do that by selecting the ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 1,986 views
–1 vote
1 answer

Issue with MySql Server connection

Try to restart the mysqld server and then login: sudo ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 1,107 views
0 votes
1 answer

What is distributed Cache in MapReduce Framework ?

Distributed Cache is an important feature provided ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,198 views
–1 vote
1 answer

Where does reduce take place in Hadoop MapReduce?

A MapReduce job usually splits the input data-set into ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,726 views
0 votes
1 answer

Pig CLI mode

Pig can be used in two modes: 1) ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 953 views
–1 vote
1 answer

How to Set cluster Rebalancer threshold

The command you are using is wrong. ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 980 views
–1 vote
1 answer

How to start pyspark?

Follow these steps: First start hadoop daemons: cd $HADOOP_HOME/sbin ./start-all.sh Now ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
 • 69,180 points • 1,013 views
0 votes
1 answer

Apache Spark vs MapReduce

Both Spark and Hadoop MapReduce are used ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,617 views
–1 vote
1 answer

Spark multiple version without major version

Yes. It is not necessary to set ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,289 views
0 votes
1 answer

Cant find slave on ResourceManager Web UI

Seems like it is running on default ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 2,221 views
–1 vote
1 answer

Can't seem to make hdfs commands to work

Check the ip address mentioned in core-site.xml ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,501 views
–1 vote
1 answer

When to use Sqoop?

Sqoop is used to transfer any data ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,061 views
0 votes
1 answer

How to fix corrupt HDFS FIles?

You can use hdfs fsck / to ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 3,924 views
0 votes
0 answers

wordcount example not running on edureka vm

Hi, wordcount example failing on edureka vm(VM is ...READ MORE

Dec 25, 2018 in Big Data Hadoop by PRASAD
 • 120 points • 1,292 views
0 votes
1 answer

Can you build “Spark” with any particular Hadoop version?

Yes, one can build “Spark” for a specific ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,731 views
0 votes
1 answer

Not able to start jobtracker in hadoop

There is no jobtracker in hadoop 2.2.0 YARN framework. ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,838 views
0 votes
1 answer

How to read Spark elements having multiple lines each?

Try this: val new_records = sc.newAPIHadoopRDD(hadoopConf,classOf[ ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,776 views
–1 vote
1 answer

Mapreduce in Python

mapper.py #!/usr/bin/python import sys #Word Count Example # input comes from ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,440 views
0 votes
1 answer

Hadoop: Datanode not starting correctly

You can do the following method, copy to ...READ MORE

Nov 5, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 3,336 views
0 votes
1 answer

Mapreduce shuffle and sort

The mapreduce task happens in the following ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,087 views
0 votes
1 answer

Not able to install hadoop using maven

First make sure you have ant installed ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,990 views
0 votes
1 answer

What is the meaning of Write Ahead Log in Hadoop?

Write Ahead Log (WAL) is a file ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Sunil
 • 2,677 views
0 votes
1 answer

All daemons starting except datanode

There could be more than one reason ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,335 views
–1 vote
1 answer

Facing the below error while installing mysql in VM

We would like to say that the ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
 • 69,180 points • 1,368 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.