Trending questions in Big Data Hadoop

0 votes
1 answer

How will you decide whether you need to use the Capacity Scheduler or the Fair Scheduler?

Fair Scheduling is the process in which ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,257 views
0 votes
1 answer

Not able to list tables in sqoop

The default port number for MySQL is ...READ MORE

Jan 29, 2019 in Big Data Hadoop by Omkar
• 69,180 points
1,544 views
0 votes
1 answer

Doubt regarding sqoop updated data

Incremental append or load in sqoop will ...READ MORE

Feb 15, 2019 in Big Data Hadoop by Omkar
• 69,180 points
804 views
0 votes
1 answer

What are active and passive “NameNodes” in Hadoop?

In HA (High Availability) architecture, we have ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,468 views
0 votes
1 answer

How to control logging functionality in Hadoop?

 Logs are distributed across your cluster, but ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Frankie
• 9,830 points
4,799 views
–1 vote
1 answer

Hadoop MapReduce word count program failed

Seems like Firewall is blocking the connection. ...READ MORE

Jan 21, 2019 in Big Data Hadoop by Omkar
• 69,180 points
1,799 views
0 votes
1 answer

Can't access hadoop job logs

The error which you are getting can ...READ MORE

Jan 28, 2019 in Big Data Hadoop by Omkar
• 69,180 points
1,456 views
0 votes
1 answer

Not able to start namenode with ./start-all.sh

Try this: stop all the daemons: ./stop-all.sh format the namenode: cd ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,530 views
–1 vote
1 answer

Namenode not running

Never mind. I forgot to run hadoop namenode ...READ MORE

Dec 27, 2018 in Big Data Hadoop by digger
• 26,740 points
2,862 views
0 votes
1 answer

Hadoop HDFS: Java API to move files to hdfs

You can use the FileUtil api to do this. Example: Configuration ...READ MORE

Nov 19, 2018 in Big Data Hadoop by Omkar
• 69,180 points
4,456 views
0 votes
1 answer

Not able to install yarn on Ubuntu

Seems like your system does not have ...READ MORE

Feb 5, 2019 in Big Data Hadoop by Omkar
• 69,180 points
1,061 views
0 votes
1 answer

Hadoop: namenode -format error "java.io.IOException"

Run the command as sudo or add the ...READ MORE

Nov 26, 2018 in Big Data Hadoop by Omkar
• 69,180 points
4,081 views
–1 vote
1 answer

Hadoop error: can not start-all.sh

Try adding <property> <name>dfs.name.dir</name> <value>/path/to/hdfs/dir</value> ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,096 views
0 votes
1 answer

Error while starting hadoop daemons

First, format the namenode and then try ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,052 views
0 votes
1 answer

Why scala generates 2 files, Person.class and Person$.class?

While running Scala, Scala objects are translated ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,180 points
857 views
0 votes
1 answer

How to set input split settings?

It can be controlled by setting the ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,669 views
0 votes
1 answer

Class not found exception when I am running my Word Count Program jar file

You have forgotten to include the package name ...READ MORE

Jan 18, 2019 in Big Data Hadoop by Omkar
• 69,180 points
1,702 views
0 votes
1 answer

Cant access file from Hive. permission denied

There are two possible reasons for this: Wrong ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,438 views
0 votes
1 answer

What is the hdfs command to check free space available?

You can see the free available space ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
4,161 views
0 votes
1 answer

Start-dfs.sh daemons not starting. localhost: mkdir: cannot create directory `/user': Permission denied

Make the following changes to the hadoop-env.sh ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,516 views
0 votes
1 answer

What are the different types of tombstone markers in HBase for deletion?

1)Family Delete Marker- This markers marks all ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,951 views
0 votes
1 answer

Hadoop: “Unhealthy Node local-dirs and log-dirs are bad”

You can increase the threshold in yarn-site.xml <property> ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
• 69,180 points
4,643 views
–1 vote
1 answer

How to use multiple spark version?

You can use the  SPARK_MAJOR_VERSION for this. Suppose ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,540 views
0 votes
1 answer

Hbase installation Issue. Cant start HRegionServer and HQuorumPeer

It seems hbase did not start properly ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,506 views
–1 vote
1 answer

Hadoop daemons not starting

You have to write this directory in ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
• 69,180 points
1,850 views
0 votes
1 answer

Creating a Parquet or Avro file

In hadoop, we do not create different ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,180 points
1,376 views
0 votes
1 answer

Hadoop installation issue on fedora 24

type jps and check whether namenode and datanode is ...READ MORE

Jan 24, 2019 in Big Data Hadoop by Frankie
• 9,830 points
1,252 views
–1 vote
1 answer

Pig code in Eclipse shows error :LongWritable cannot be resolved to a type

To rectify this errors, you need to ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,180 points
2,223 views
0 votes
1 answer

Hive: How to know the path of a created table?

You can use the DESCRIBE command to ...READ MORE

Nov 28, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,685 views
0 votes
1 answer

How to run Nutch in Hadoop installed in pseudo-distributed mode

Make sure you have built Nutch from ...READ MORE

Jan 24, 2019 in Big Data Hadoop by Frankie
• 9,830 points
1,228 views
0 votes
1 answer

Hadoop tools/eco-system version compatibility doubt

Below are the versions which can be used ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
• 69,180 points
907 views
0 votes
1 answer

Junit test for Map Reduce Hadoop

Hi. This is the code I used ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,828 views
0 votes
1 answer

Hadoop Java Error: java.lang.NoClassDefFoundError: WordCount (wrong name: org/myorg/WordCount)

Hey, try this code import java.io.IOException; import java.util.Iterator; import java.util.StringTokenizer; import ...READ MORE

Sep 19, 2018 in Big Data Hadoop by slayer
• 29,370 points
6,676 views
0 votes
1 answer

How to open MySql console in Ubuntu?

sudo service mysqld restart mysql -u <username> root ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,934 views
0 votes
1 answer

Update hdfs data before stroring in MySql

Yes, you can update the data before ...READ MORE

Jan 27, 2019 in Big Data Hadoop by Omkar
• 69,180 points
1,017 views
0 votes
1 answer

UnsupportedClassVersionError while running Mapreduce program.

Seems like the jar file was not ...READ MORE

Jan 18, 2019 in Big Data Hadoop by Omkar
• 69,180 points
1,385 views
0 votes
1 answer

Issue in hdfs dfs command

Hadoop has a special file system called ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,180 points
1,849 views
0 votes
1 answer

How to copy files in hdfs with wildcards?

You can use the hdfs command: hdfs fs ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,999 views
–1 vote
1 answer

Sqoop split-by problem

Hello. The -m or --num-mappers is just a ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,663 views
0 votes
1 answer

ReduceByKey Avereage

You can try the code mentioned below ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,180 points
1,181 views
–1 vote
1 answer

Not able to run java mapreduce

The error which you are getting i.e ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
• 69,180 points
1,693 views
–1 vote
1 answer

Hdfs command to see available free space in hdfs

Yes, you check the free space using ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,180 points
1,218 views
–1 vote
1 answer

How many FSimage files will be created in hard disk?

In Hdfs, data and metadata are decoupled. ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,589 views
+1 vote
1 answer

How to get status of hdfs directory using python?

import commands hdir_list = commands.getoutput('hadoop fs -ls hdfs: ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,077 views
+1 vote
1 answer

How to print data without brackets using PIG Dump?

Please refer to the below commands: student = ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,554 views
0 votes
1 answer

How to read more than one files in Apache Spark?

Try this: val text = sc.wholeTextFiles("student/*") text.collect() ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,874 views
0 votes
1 answer

Hue Health issue

The status of Hue is shown in ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
• 69,180 points
653 views
–1 vote
1 answer

IDE Eclipse: Failed to locate the winutils binary in the hadoop binary path

Try this: First, click on file import appliance. Now ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,032 views
0 votes
1 answer

Error while creating avrodatafile?

The error you are getting is AvroWrapper class not ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,180 points
1,034 views
0 votes
1 answer

In Hue, how to to download the script?

You can download the script to your ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,180 points
1,684 views