Trending questions in Big Data Hadoop

0 votes
1 answer

Is Data locality concept applicable for Reducers also?

No, Data-Locality concept applies to MAPPERS only. Reducers ...READ MORE

Nov 30, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,710 views
–1 vote
1 answer

Hadoop unit not found error

Unfortunately the command that you are giving ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
830 views
0 votes
1 answer

How to move Word and PDF documents to Hadoop HDFS?

Try with below commands: hadoop fs -copyFromLocal <localsrc> ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,480 views
+1 vote
1 answer

How to switch off Cloudera Manager Service?

First list the running services: chkconfig --list And then ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,180 points
908 views
0 votes
0 answers

Number of tasks submitted and executed within the day in hadoop

Tasks Write a software application, service, daemon or ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Irfan
• 120 points
1,201 views
0 votes
1 answer

Hadoop: How to use Jps command with Sun JDK installed?

You can put JPS into your path ...READ MORE

Nov 9, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,544 views
–1 vote
1 answer

Need help in Installation of Hadoop

To set up Hadoop VM in centOS ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,180 points
843 views
0 votes
1 answer

Hadoop Hive: How to drop a table?

You cannot drop column directly from a ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,324 views
0 votes
1 answer

Understanding LongWritable

Hadoop needs to be able to serialise ...READ MORE

Oct 29, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,970 views
0 votes
1 answer

Hadoop Hive Bucketing

Partition helps in increasing the efficiency when ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
993 views
0 votes
1 answer

How to use jar file without putting it in hdfs?

If by "using", you mean distributing it, ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,325 views
0 votes
1 answer

Hadoop PIG extraction shows no output

To see whether the extraction was done ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,180 points
966 views
0 votes
1 answer

Best way of starting & stopping the Hadoop daemons with command line

First way is to use start-all.sh & ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
11,373 views
0 votes
1 answer

What is the usage of Configured class in Hadoop programs?

Configured is a default implementation of the Configurable interface - ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,777 views
+1 vote
1 answer

How to count number of rows in alias in PIG?

COUNT is part of pig LOGS= LOAD 'log'; LOGS_GROUP= ...READ MORE

Oct 15, 2018 in Big Data Hadoop by Omkar
• 69,180 points
3,358 views
0 votes
1 answer

Why Hadoop is not implemented using MPI?

 One of the big features of Hadoop/map-reduce ...READ MORE

Dec 4, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,228 views
0 votes
1 answer

Hadoop Sqoop: How to change sqoop metastore?

In sqoop-site.xml I configured it with, the ...READ MORE

Nov 13, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,118 views
0 votes
1 answer

Do worker hosts need access to the Cloudera public repositories for an install with Cloudera Manager?

You can perform an installation or upgrade ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,082 views
0 votes
1 answer

Not able to run mapreduce job. Attempt failes error

The most common reason for this is ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,703 views
0 votes
1 answer

How to delete hdfs folder from java app?

Try this: Configuration conf = new Configuration(); ...READ MORE

Oct 30, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,647 views
0 votes
3 answers

Can we run Spark without using Hadoop?

No, you can run spark without hadoop. ...READ MORE

May 7, 2019 in Big Data Hadoop by pradeep
3,215 views
0 votes
1 answer

How to access Hadoop Data using REST service?

The REST API gateway for the Apache ...READ MORE

Sep 5, 2018 in Big Data Hadoop by Frankie
• 9,830 points
4,981 views
0 votes
0 answers

Is the Hadoop scalability linear or proportional to number of nodes?

Is it common to see this sentence: ...READ MORE

Nov 27, 2018 in Big Data Hadoop by Jins
• 140 points
1,391 views
0 votes
1 answer

Hadoop: What is the difference between `hadoop dfs` and `hadoop fs`?

You can find the definition here: $HADOOP_HOME/bin/hadoop ... elif [ ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,263 views
0 votes
1 answer

How to include third party library in Python MapReduce?

Problem has been solved by zipimport. Then I zip chardet to ...READ MORE

Nov 27, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,304 views
0 votes
1 answer

Hadoop hdfs: How to count number of lines?

You can count the number of lines ...READ MORE

Nov 19, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,578 views
+3 votes
1 answer

Apache Nifi Execute Process Processor

Hey soujanyabargavi!  NO, ExecuteProcess does not allow incoming ...READ MORE

Sep 20, 2018 in Big Data Hadoop by Omkar
• 69,180 points
4,942 views
0 votes
1 answer

Does Cloudera Manager Support an API?

Yes. A comprehensive set of APIs for ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Frankie
• 9,830 points
789 views
+3 votes
5 answers

Hadoop DistributedCache is deprecated - what is the preferred API?

I had the same problem. And not ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Rohan
3,237 views
0 votes
1 answer

What is Streaming data and Hadoop?

The hack you describe is more or ...READ MORE

Nov 2, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,273 views
0 votes
1 answer

Hadoop: What does RDD mean?

RDD is the acronym for Resilient Distribution ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Deepak
1,484 views
0 votes
1 answer

Hadoop MacOS: formatting namenode: Could not find or load main class

You need to point the HADOOP_PREFIX to ...READ MORE

Nov 13, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,798 views
0 votes
1 answer

Which is the easiest way for text analytics with hadoop?

Apache pig provides CSVExcelStorage class for loading ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,357 views
0 votes
1 answer

Hadoop: Java code to get Hive table properties.

You can try this: org.apache.hadoop.hive.metastore.api.Table table=..........; org.apache.hadoop.hive.metastore.api.StorageDescriptor sd=table.getSd(); String loc=sd.getLocation(); String ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,402 views
0 votes
2 answers

What is Shuffle Phase?

The process where the intermediate results from ...READ MORE

Mar 27, 2019 in Big Data Hadoop by Krishnan
• 140 points
2,393 views
0 votes
1 answer

How Namenode handles data node failures?

Let me explain you the whole scenario. NameNode ...READ MORE

Jul 11, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
7,111 views
0 votes
1 answer

In Hadoop MapReduce, how can i set an Object as the Value for Map output?

Try this and see if it works: public ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,377 views
0 votes
1 answer

Hadoop Pig: How to include external jar file in PIG?

You can do this: register /local/path/to/Jar_name.jar READ MORE

Nov 16, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,558 views
0 votes
1 answer

What are the different ways of Installing Hadoop into our local machine?

Hadoop runs on Unix and on Windows. ...READ MORE

Aug 4, 2018 in Big Data Hadoop by Neha
• 6,300 points
6,071 views
0 votes
1 answer

Hadoop Apache: Could not fully initialize service [org.apache.oozie.service.ShareLibService]

As mentioned in the error, the problem ...READ MORE

Nov 19, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,406 views
0 votes
1 answer

What is Network Topology in Hadoop?

Let's imagine your cluster as a tree ...READ MORE

Sep 6, 2018 in Big Data Hadoop by Frankie
• 9,830 points
4,608 views
0 votes
1 answer

Job and Task Scheduling In Hadoop

I  n case of fair scheduler, when there is ...READ MORE

Oct 31, 2018 in Big Data Hadoop by Neha
• 6,300 points
2,182 views
0 votes
1 answer

Hadoop: `.' no such file or directory while installing

Try hadoop fs -mkdir -p /user/[Username] and then run ...READ MORE

Nov 2, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,064 views
0 votes
1 answer

Hadoop: RHadoop: packages ‘rmr’, ‘rJava‘, ‘RJSONIO‘, ‘rhdfs’, ‘rhbase’, ‘plyrmr’ are not available

You need to first download the packages ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,540 views
+2 votes
1 answer

How to calculate Maximum salary of the employee with the name using the Map Reduce Technique

Please try the below code and it ...READ MORE

Jul 25, 2018 in Big Data Hadoop by Neha
• 6,300 points
6,280 views
0 votes
1 answer

Setting textinputformat.record.delimiter in spark

I got this working with plain uncompressed ...READ MORE

Oct 10, 2018 in Big Data Hadoop by Omkar
• 69,180 points
2,988 views
0 votes
1 answer

What is the best way to integrate SAS with Hadoop without losing the parallel processing capacity of Hadoop

One of the major pushes at SAS ...READ MORE

Oct 16, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,701 views
0 votes
1 answer

How to write a file in HDFS using Java Programming language?

Define the HADOOP_CONF_DIR environment variable to your Hadoop configuration ...READ MORE

Sep 28, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,451 views
0 votes
1 answer

Where can I find AMI for Hadoop on EC2?

To find that, please try with below ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,504 views
0 votes
1 answer

Hadoop Oozie: E0902: Exception occured: [User: oozie is not allowed to impersonate oozie]

Seems like your version of Hadoop does ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
• 69,180 points
1,485 views