Trending questions in Big Data Hadoop

+1 vote
1 answer

what are the typicall block sizes in HDFS

HDFS is a block structured file system ...READ MORE

Apr 8, 2019 in Big Data Hadoop by Gitika
• 65,730 points
1,996 views
0 votes
1 answer

Why should we use "distinct" keyword in pig script?

Hey, The "distinct" statement is very simple. It ...READ MORE

May 3, 2019 in Big Data Hadoop by Gitika
• 65,730 points
940 views
0 votes
1 answer

Writing File into HDFS using spark scala

The reason you are not able to ...READ MORE

Apr 6, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
17,895 views
+1 vote
1 answer

Need help Installing Sqoop on Windows.

Download Sqoop from this link: http://www.apache.org/dyn/closer.lua/sqoop/1.4.7 This link is ...READ MORE

Feb 25, 2019 in Big Data Hadoop by Chandu
3,761 views
0 votes
1 answer

What is the difference in DistCP command and Sqoop command in Hadoop?

Both the distCP (Distributed copy in Hadoop) ...READ MORE

Apr 11, 2019 in Big Data Hadoop by Gitika
• 65,730 points
1,845 views
0 votes
1 answer

Explain to me to download a Hadoop documentation of a particular version.

I'll drop a link here which will ...READ MORE

May 7, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
686 views
0 votes
0 answers

How run wordcount on multi node hadoop using eclipse?

Apr 24, 2019 in Big Data Hadoop by حسين
• 200 points

recategorized Apr 24, 2019 by Omkar 1,300 views
0 votes
1 answer

How to decide number of mappers?

The number of mapper depends on the ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
• 69,180 points
4,816 views
0 votes
1 answer

Connect to Hive using Pyhive

Here's how we can connect to Hive ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
• 69,180 points
5,775 views
0 votes
0 answers

What is the motivation behind developing Hive?

Hey, I am learning Hive in a basic ...READ MORE

May 9, 2019 in Big Data Hadoop by dyna
604 views
0 votes
1 answer

Deleting directory in Sqoop

You can use the --delete-target-dir : $ sqoop import ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
• 69,180 points
4,277 views
0 votes
1 answer

Difference between hive.exec.compress.output=true; and mapreduce.output.fileoutputformat.compress=true;

Hey there! The definition of these two properties ...READ MORE

Dec 28, 2018 in Big Data Hadoop by Omkar
• 69,180 points
6,216 views
0 votes
1 answer

Explain to me the method to transfer data between Azure tables and Hadoop on Azure

this article on HiveStorageHandler will let you ...READ MORE

May 3, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
805 views
0 votes
1 answer

Copy files to all Hadoop DFS directories

Hi @Bhavish. There is no Hadoop command ...READ MORE

Feb 24, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,707 views
0 votes
1 answer

I am install hadoop on signal node and run program but delay time if have dataset size 3.3 GB take time about 2 hours

Hey @Faris! Try increasing the number of reducers. ...READ MORE

Apr 12, 2019 in Big Data Hadoop by Omkar
• 69,180 points
1,635 views
–1 vote
1 answer

Apache Spark - Nested JSON array to flatten columns

It depends on the structure of your ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,180 points
5,993 views
0 votes
1 answer

How to handle exceptions in Spark and Scala?

There is no particular format to handle ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,180 points
5,104 views
0 votes
1 answer

Why do we need Hadoop framework?

The function of Distributes File System is ...READ MORE

Apr 10, 2019 in Big Data Hadoop by Gitika
• 65,730 points

edited Apr 12, 2019 by Gitika 1,716 views
0 votes
1 answer

Why sqoop internally generates MapRed code?

By default Sqoop always create 4 Map ...READ MORE

Apr 11, 2019 in Big Data Hadoop by Gitika
• 65,730 points
1,635 views
0 votes
1 answer

Method to schedule the number of Mappers and Reducers in a Hadoop MapReduce Tsk.

The number of Mapper tasks for a ...READ MORE

Apr 25, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
993 views
0 votes
1 answer

Can I use Amazon Web Services for free?

If you would like to use AWS ...READ MORE

Apr 25, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
976 views
0 votes
1 answer

Why do we need the FOR EACH operation in Pig Scripts?

The operation FOREACH in Apache Pig is ...READ MORE

Apr 30, 2019 in Big Data Hadoop by Gitika
• 65,730 points
759 views
0 votes
1 answer

Installing Oozie on Linux System

Download Oozie from this link: http://www.apache.org/dyn/closer.lua/oozie/ Extract the files. ...READ MORE

Feb 28, 2019 in Big Data Hadoop by Rajan
3,383 views
0 votes
1 answer

How to install Hadoop on Windows system?

First you need to download Hadoop files. ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,680 views
0 votes
1 answer

Why we need to install "ant -Dhadoopversion=23" ? What is the use of this?

Hi, We install ant to build pig, If the ...READ MORE

Apr 26, 2019 in Big Data Hadoop by Gitika
• 65,730 points
843 views
0 votes
1 answer

Command to establish connection between MySql with linux?

This is the command you can use ...READ MORE

Apr 15, 2019 in Big Data Hadoop by Gitika
• 65,730 points

edited Apr 18, 2019 by Gitika 1,267 views
0 votes
10 answers

What is the difference between Mongodb and Hadoop?

MongoDB is a NoSQL database, whereas Hadoop is ...READ MORE

Jun 20, 2018 in Big Data Hadoop by jenny_code
12,843 views
0 votes
1 answer

Elastisearch Hadoop

I will redirect you to a repository ...READ MORE

Apr 24, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
849 views
–1 vote
1 answer

"main" java.lang.ClassNotFoundException: WordCount

When you are running a jar file ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,180 points
4,876 views
0 votes
1 answer

File formats in Hadoop?

File format is just a way to ...READ MORE

Apr 9, 2019 in Big Data Hadoop by Gitika
• 65,730 points

edited Apr 12, 2019 by Gitika 1,410 views
0 votes
1 answer

Which MySql command will generate all the list of command for MySql prompt?

The command is very simple, you have ...READ MORE

Apr 15, 2019 in Big Data Hadoop by Gitika
• 65,730 points
1,116 views
0 votes
1 answer

How to create table inside database in MySql in Linux?

We can use this command to create ...READ MORE

Apr 16, 2019 in Big Data Hadoop by Gitika
• 65,730 points
1,104 views
0 votes
1 answer

Copy file from HDFS to the local file system

There are two possible ways to copy ...READ MORE

Mar 27, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
17,693 views
0 votes
1 answer

What command is used to install MySql in centos?

You can use this command to install ...READ MORE

Apr 12, 2019 in Big Data Hadoop by Gitika
• 65,730 points
1,222 views
0 votes
1 answer

How to copy file to multiple hdfs directory?

You can use loop to copy the ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
• 69,180 points
4,579 views
0 votes
1 answer

Hadoop: "Caused by: java.lang.ClassNotFoundException" error

Have you placed the jar files in ...READ MORE

Nov 19, 2018 in Big Data Hadoop by Omkar
• 69,180 points
7,424 views
0 votes
1 answer

Sqoop import: import failed error

The problem which you are facing is ...READ MORE

Feb 12, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,735 views
0 votes
1 answer

Sqoop transfer file from MySql to HBase

Sqoop doesn’t permit you to import, all ...READ MORE

Feb 12, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,734 views
0 votes
1 answer

How Sqoop import command works internally?

First when client execute Sqoop import commands through ...READ MORE

Apr 11, 2019 in Big Data Hadoop by Gitika
• 65,730 points
1,177 views
0 votes
0 answers

What are Hadoop daemons? What are their live examples?

First of all why Hadoop daemon are ...READ MORE

Apr 4, 2019 in Big Data Hadoop by rashmi
1,501 views
0 votes
1 answer

Why is HDFS used for the applications with large data sets, and not for the multiple small files?

HDFS is more efficient for a large ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Neha
• 6,300 points
6,060 views
0 votes
1 answer

What can you do with sqoop in Hadoop ecosystem?

Scoop came into scenario because there were tools ...READ MORE

Apr 8, 2019 in Big Data Hadoop by Gitika
• 65,730 points

edited Apr 8, 2019 by Gitika 1,237 views
0 votes
1 answer

Hadoop Hive: ClassNotFoundException: org.apache.hive.jdbc.HiveDriver

You have to use the right dependency <dependency> ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,180 points
6,326 views
0 votes
1 answer

Error creating External Tables in Hive

The path which you have given for ...READ MORE

Feb 9, 2019 in Big Data Hadoop by Omkar
• 69,180 points
3,719 views
0 votes
1 answer

What are the different hdfs dfs commands to perform copy operation?

The different hdfs dfs commands to perform ...READ MORE

Apr 10, 2019 in Big Data Hadoop by Gitika
• 65,730 points
1,167 views
0 votes
1 answer

What are the site-specific configuration files in Hadoop?

There are different site specific configuration to ...READ MORE

Apr 10, 2019 in Big Data Hadoop by Gitika
• 65,730 points
1,158 views
0 votes
1 answer

How to create database in Mysql?

The command you can use is: create table ...READ MORE

Apr 15, 2019 in Big Data Hadoop by Gitika
• 65,730 points
893 views
+1 vote
2 answers

What does hadoop fs -du command gives as output?

du command is used for to see ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Lokesh Singh
6,288 views