How can Hadoop discover missing or corrupt HDFS data

0 votes
I want to check my HDFS corrupt data. Which command does Hadoop offer to discover missing or corrupt HDFS data?

Please help!
Jul 19, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,446 views

1 answer to this question.

0 votes
HDFS supports fsck command to check for various inconsistencies.

It is designed for reporting problems with various files, for e.g. missing blocks for a file or under replicated blocks. Unlike a traditional fsck utility for native filesystems, this command does not correct the errors it detects.

Normally Namenode automatically corrects most of the recoverable failures. HDFS' fsck is not a Hadoop shell command. It can be run as 'bin/hadoop fsck'. Fsck can be run on the whole filesystem or on a subset of files.

Hope you understand.
answered Jul 19, 2018 by nitinrawat895
 • 11,380 points

Related Questions In Big Data Hadoop

0 votes
1 answer

How can we send data from MongoDB to Hadoop?

The MongoDB Connector for Hadoop reads data ...READ MORE

answered Mar 27, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,099 views
0 votes
1 answer

How can anyone recover deleted HDFS data?

Yes, there is a trash policy in ...READ MORE

answered May 16, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 10,913 views
0 votes
1 answer

How can I change data in HDFS?

You can not modified data once stored ...READ MORE

answered Feb 19, 2019 in Big Data Hadoop by Rishi
 • 4,866 views
+1 vote
2 answers

Sir if i have no knowledge of any programming language then it is good or bad for me but i have learned Big Data and Hadoop so i can get a job or not

Hey Rahul,  You have mentioned that you have no ...READ MORE

answered May 6, 2019 in Big Data Hadoop by poonam
 • 1,479 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 4,612 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
 • 11,380 points • 11,029 views
0 votes
1 answer

How to get started with Hadoop?

Well, hadoop is actually a framework that ...READ MORE

answered Mar 21, 2018 in Big Data Hadoop by coldcode
 • 2,090 points • 1,176 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 108,832 views
0 votes
1 answer

How to discover missing or corrupt HDFS data?

HDFS supports fsck command to check for ...READ MORE

answered Sep 19, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 1,817 views
0 votes
1 answer

How can I download only hdfs and not hadoop?

No, you cannot download HDFS alone because ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 1,541 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP
"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.