Trending questions in Big Data Hadoop

0 votes
1 answer

Not able to delete file using pig

rmf is a hadoop file system command and you ...READ MORE

Feb 4, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,789 views
0 votes
1 answer

Hadoop: How to get the column name along with the output in Hive?

You can get the column names by ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 5,016 views
+1 vote
1 answer

How to read HDFS and local files with the same code in Java?

You can try something like this: ​ ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,890 views
0 votes
1 answer

Error while accessing the file outformat method SetOutputpath

You have imported org.apache.hadoop.mapred.FileOutputFormat, ​​you need to import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat So, make ...READ MORE

Feb 22, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 959 views
0 votes
1 answer

How to reduce shuffling cost in map reduce?

You can define a Combiner function, which does the ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,224 views
0 votes
2 answers

Not able to use npm after installing yarn

 "The easiest way to get started is ...READ MORE

Feb 5, 2019 in Big Data Hadoop by rajesh
 • 1,270 points • 1,598 views
0 votes
1 answer

Sqoop getting error while connecting to MySQL

Have you set a password for MySQL? ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,508 views
0 votes
1 answer

Hbase to pig integration

First enter into grunt shell: $ ./pig –x ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 962 views
0 votes
0 answers

How Pig programming gets converted into MapReduce jobs?

Could you please give me a brief ...READ MORE

Feb 21, 2019 in Big Data Hadoop by Neha
 • 6,300 points • 913 views
0 votes
1 answer

How to create a Hive table with a sequence file?

In Hive we can create a sequence ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,713 views
0 votes
1 answer

Error connecting hive using python pyhs2

Seems like the host IP is not ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,580 views
0 votes
1 answer

Apache storm installation

The “conf/storm.yaml” file contains configurations of Storm. And ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,104 views
0 votes
1 answer

Hadoop Spark Derby: Caused by: ERROR XSDB6: Another instance of Derby may have already booted the database

As mentioned in the error, there's another ...READ MORE

Nov 16, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 5,003 views
0 votes
1 answer

hadoop: command not found

The reason you are getting hadoop as ...READ MORE

Mar 28, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 15,090 views
0 votes
1 answer

How to retrieve the list of sql (Hive QL) commands that has been executed in a hadoop cluster?

Well, what you can do is use ...READ MORE

Apr 4, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 14,745 views
0 votes
1 answer

Permission denied while uploading files to hdfs

It is not the problem about permission ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,962 views
0 votes
1 answer

How to convert Spark data into CSV?

You can use this: df.write .option("header", "true") ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,736 views
0 votes
1 answer

Hadoop Hive query to filter employees

select * from tablename where DOJ> '2018-01-01' ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,770 views
0 votes
1 answer

How to concatenate hdfs files and store in output file?

You can use a combination of cat and put command. Something ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,106 views
0 votes
1 answer

How to send curl downloaded data in hdfs?

Try using put command with stdin as ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,936 views
–1 vote
1 answer

WARN util.NativeCodeLoader: Unable to load native-hadoop library

To remove this warning, you can use:  hdfs ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,089 views
0 votes
1 answer

Unable to instantiate org.apache.hadoop.hive

You might not have set the connector. ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,899 views
0 votes
1 answer

How to create new directory in hdfs using java code?

Try this: { Configuration config ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,012 views
0 votes
1 answer

MapReduce: Map Value Mismatch error

Seems like you have not specified few ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Haman
 • 1,011 views
0 votes
1 answer

BigData in MPI

MPI is a communication protocol for programming ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Disha
 • 1,008 views
0 votes
1 answer

Hadoop Distribution Differences

The Yahoo distribution is a version of ...READ MORE

Feb 18, 2019 in Big Data Hadoop by Frankie
 • 9,830 points • 831 views
0 votes
1 answer

Why should we use "extends Mapper" for Mapreduce code?

The Mapper class belongs to package org.apache.hadoop.mapreduce ...READ MORE

Feb 8, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,222 views
0 votes
1 answer

Failing to execute the script pig file on HDFS

By convention, the pig script that you ...READ MORE

Feb 15, 2019 in Big Data Hadoop by John
 • 958 views
0 votes
2 answers

start-dfs.sh command is not starting Hadoop JobTracker & TaskTracker

On which version of hadoop do you ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Lokesh Singh
 • 4,043 views
0 votes
1 answer

What is the difference between Apache ZooKeeper and Apache Oozie?

The main difference between these two is ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Anoop
 • 4,653 views
0 votes
1 answer

Not able to see racks in reports

Seems like rack awareness is not configure.  Try ...READ MORE

Feb 22, 2019 in Big Data Hadoop by Lucky
 • 575 views
–1 vote
1 answer

Getting error while starting hdfs namenode -format

Check your /etc/hosts file, the format should be like ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,359 views
0 votes
1 answer

Mapreduce problem with output part file

As the error suggests and you have ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,156 views
0 votes
1 answer

How to check Cloudera Manager Service status?

There surely is a command to check ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,385 views
0 votes
1 answer

Doubt in word count query

The COUNT function returns the number of ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 649 views
0 votes
1 answer

Can DataNode and NameNode be commodity hardware?

DataNodes are the commodity hardware only as ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 3,318 views
0 votes
1 answer

What is Metastore in Hive?

It stores metadata for Hive tables (like their schema ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 3,228 views
0 votes
1 answer

What does a secondary namenode do in Hadoop?

The Secondary namenode is mainly used as a ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,209 views
0 votes
1 answer

Spark - load CSV file as DataFrame?

spark-csv is part of core Spark functionality ...READ MORE

Sep 25, 2018 in Big Data Hadoop by slayer
 • 29,370 points • 6,929 views
0 votes
1 answer

Hadoop Job Tracker problem. I cannot connect to http://localhost:50030/

I think you are using new version ...READ MORE

Nov 30, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,091 views
0 votes
1 answer

Browse HDFS & Job Logs

You can browse the hdfs and see the ...READ MORE

Jan 26, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,617 views
0 votes
1 answer

Not able to insert data into hive table

Seems like a hive version problem.​ insert operation is ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,411 views
–1 vote
1 answer

Display contents of my Parquet file.

Make sure you are running from the ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,216 views
–1 vote
1 answer

Setting Hive properties

Hey. It's definitely not a stupid question. ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,510 views
–1 vote
1 answer

Does Hadoop merge the output files after reduce phase?

No, the files after the reduce phase are ...READ MORE

Jan 23, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,707 views
0 votes
1 answer

What is the Path of hdfs.site.xml?

Here's where you can find the file: /etc/hadoop/[service ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,441 views
0 votes
1 answer

expected org.apache.hadoop.io.IntWritable, received org.apache.hadoop.io.LongWritable

Hey George!  This error comes whenever you use ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,523 views
0 votes
1 answer

How will you submit job as particular user?

You need to create a new user ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,290 views
0 votes
1 answer

What is the command to count number of lines in a file in hdfs?

hadoop fs -cat /example2/doc1 | wc -l READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,269 views
0 votes
1 answer

How to create files in hdfs?

You can create a file directly in ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,531 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.