Trending questions in Big Data Hadoop

0 votes
0 answers

How Pig programming gets converted into MapReduce jobs?

Could you please give me a brief ...READ MORE

Feb 21, 2019 in Big Data Hadoop by Neha
• 6,300 points
1,191 views
0 votes
1 answer

Change the owner and group of a file in Hadoop.

Hi@akhtar, You can use the Chown command. This ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,460 points
9,163 views
0 votes
1 answer

How to append files from local system to HDFS?

Hi@akhtar, You can use appendToFile in your Hadoop ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,460 points
9,159 views
0 votes
1 answer

How to view contents of file in hadoop hdfs?

Hi@akhtar, You can use the Hadoop filesystem command ...READ MORE

Oct 5, 2020 in Big Data Hadoop by MD
• 95,460 points
8,976 views
0 votes
1 answer

Replace Column names and datatype in Hive

You can replace the column name and ...READ MORE

May 21, 2019 in Big Data Hadoop by John
30,538 views
0 votes
1 answer

How to set replication factor in Hadoop?

Hi@akhtar, You can find setrep command in the ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,460 points
8,596 views
0 votes
0 answers

The following pairs are supposed to have one component that stores data in a distributed fashion and another component that performs computations in a distributed manner.

Choose the incorrect pair HDFS, MapReduce HBase, MapReduce HBase, Spark HDFS, ...READ MORE

Apr 10, 2021 in Big Data Hadoop by anonymous

edited Mar 4 216 views
0 votes
1 answer

Format HDFS Namenode Error: Could not find or load main class ”-Djava.library.path=.home.hadoop.hadoop-3.2.1.lib.native”

Hi@fwood, According to your configuration, you didn't set ...READ MORE

Jun 12, 2020 in Big Data Hadoop by MD
• 95,460 points
13,211 views
0 votes
0 answers

How to Find Specific Column in Hadoop?

First let me say I am super ...READ MORE

Apr 8, 2021 in Big Data Hadoop by Brianne

edited Mar 4 203 views
0 votes
1 answer

error: value update is not a member of scala.collection.immutable.Map[String, Int]

Yes, If you try to update the value of ...READ MORE

Nov 17, 2020 in Big Data Hadoop by Gitika
• 65,730 points
6,227 views
0 votes
1 answer
0 votes
0 answers

Hadoop : command not found

Hello people... I can access hadoop webui ...READ MORE

Mar 11, 2021 in Big Data Hadoop by talal

edited Mar 4 215 views
0 votes
0 answers

hdfs dfs -count -h /user/isdoc/tmcss/all_ttc_custome_list/*

I want to do the same with ...READ MORE

Mar 8, 2021 in Big Data Hadoop by 1 bihari

edited Mar 4 315 views
0 votes
0 answers

hdfs dfs -count -h /user/isdoc/tmcss/all_ttc_custome_list/*

I want to do the same with ...READ MORE

Mar 8, 2021 in Big Data Hadoop by 1 bihari

edited Mar 4 280 views
0 votes
0 answers

hdfs dfs -count -h hdfs://sandbox.hortonworks.com/demo/

I want to do the same with ...READ MORE

Mar 8, 2021 in Big Data Hadoop by 1 bihari

edited Mar 4 192 views
0 votes
13 answers

What is the difference between Hadoop/HDFS & HBase?

HDFS is a distributed file system whereas ...READ MORE

Apr 26, 2019 in Big Data Hadoop by Arihar
• 160 points
36,471 views
0 votes
0 answers

How to provide read-only access to hive views to end users?

I have created some hive tables in ...READ MORE

Feb 18, 2021 in Big Data Hadoop by Jnanaranjan

edited Mar 4 218 views
0 votes
0 answers

What are the pros and cons of parquet format compared to other formats?

Hi Team, I am new to Hadoop I ...READ MORE

Dec 21, 2020 in Big Data Hadoop by akhtar
• 38,260 points
2,654 views
+1 vote
1 answer

http://localhost:50070 not working in HADOOP

There are 2 case possible: 1. If you ...READ MORE

Apr 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
44,689 views
0 votes
1 answer

Installing Zookeeper on Windows

Follow the below-mentioned steps to install Zookeeper ...READ MORE

Feb 22, 2019 in Big Data Hadoop by Omkar
• 69,180 points
31,250 views
0 votes
1 answer

How to remove the directory from HDFS?

Hi@akhtar, You can remove the directory using the ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,460 points
5,328 views
0 votes
1 answer

Is there any way to get the column name along with the output while execute any query in Hive?

If we want to see the column ...READ MORE

Dec 8, 2020 in Big Data Hadoop by Gitika
• 65,730 points
2,840 views
0 votes
1 answer

Name node is in safe mode. Not able to leave

In order to forcefully let the namenode ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,730 points
2,722 views
0 votes
1 answer

User:hdfs not allowed to do 'DECRYPT_EEK' on 'key'.

Hi@Shilpa, I don't think you have given permission ...READ MORE

Nov 20, 2020 in Big Data Hadoop by MD
• 95,460 points
3,111 views
0 votes
2 answers

Unable to start YARN daemons. Error: Could not find or load main class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager

Hi@Akshitha, This seems like a path issue. you ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,460 points
3,361 views
0 votes
0 answers

Hadoop MapReduce - Join of two files and Computation on grouped values

I am fairly new to Hadoop and ...READ MORE

Jan 20, 2021 in Big Data Hadoop by anonymous

edited Mar 4 200 views
0 votes
1 answer

Zookeeper server going down frequently.

Hi@B, There may be several reasons behind this. ...READ MORE

Nov 9, 2020 in Big Data Hadoop by MD
• 95,460 points
3,243 views
0 votes
1 answer

How input splits are done when 2 blocks are spread across different nodes?

Hadoop doesn't copy the blocks to the ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,730 points
2,001 views
+1 vote
1 answer

How to use HDFStore to hold large datasets?

Hi@akhtar, You can store your datasets from pandas ...READ MORE

Dec 17, 2020 in Big Data Hadoop by MD
• 95,460 points
1,506 views
0 votes
1 answer

How to copy files from HDFS to local system?

Hi@akhtar, You can use the put command in ...READ MORE

Oct 1, 2020 in Big Data Hadoop by MD
• 95,460 points
4,877 views
0 votes
1 answer

Copy a directory from one node in the cluster to another in HDFS.

Hi@akhtar, You can copy a directory from one ...READ MORE

Oct 20, 2020 in Big Data Hadoop by MD
• 95,460 points
3,900 views
0 votes
1 answer

mkdir: cannot create directory `/var/run/hadoop': Permission denied.

Hi@akhtar, You need to set the path of ...READ MORE

Oct 14, 2020 in Big Data Hadoop by MD
• 95,460 points
4,023 views
+1 vote
1 answer

How to copy file from Local file system to HDFS?

Hi@akhtar, You can copy files from your local ...READ MORE

Oct 20, 2020 in Big Data Hadoop by MD
• 95,460 points
3,718 views
0 votes
0 answers

Hadoop Datanode runs only once and then does not start again on Windows 10

I was trying to install Hadoop and ...READ MORE

Jan 7, 2021 in Big Data Hadoop by Mueez

edited Mar 4 261 views
0 votes
1 answer

How do I split a string on a delimiter in Bash?

You can set the internal field separator (IFS) variable, ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,730 points
1,523 views
0 votes
1 answer

How to update the existing record in HDFS?

Hi@akhtar, HDFS follows Write Once Read Many times ...READ MORE

Oct 15, 2020 in Big Data Hadoop by MD
• 95,460 points
3,762 views
+1 vote
0 answers

How to export all collections in MongoDB?

Hi Team, I have one database in MongoDB. ...READ MORE

Dec 17, 2020 in Big Data Hadoop by akhtar
• 38,260 points
960 views
+1 vote
1 answer

How does Hadoop process records split across block boundaries?

Interesting question, I spent some time looking ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,730 points
1,198 views
0 votes
1 answer

Where does hive stores its table?

With an external table the data itself ...READ MORE

Dec 7, 2020 in Big Data Hadoop by Gitika
• 65,730 points
1,215 views
0 votes
1 answer

How can I import data from mysql to hive tables with incremental data?

Hi@dharmendra, It is common to perform one-time ingestion ...READ MORE

Nov 23, 2020 in Big Data Hadoop by MD
• 95,460 points
1,677 views
0 votes
1 answer

copyFromLocal: `/home/SANDHYA/downloads/game.csv': No such file or directory

Hi@Namrata, I think you are using the wrong ...READ MORE

Nov 19, 2020 in Big Data Hadoop by MD
• 95,460 points
1,791 views
0 votes
1 answer

How to check the name of the hadoop server?

Hi@akhtar, If you're running a pseudo-distributed setup, you ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,460 points
3,192 views
0 votes
1 answer

org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://localhost:54310/user/hduser/input.

Hi@akhtar, It seems you are providing the wrong ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,460 points
3,138 views
0 votes
1 answer

How to download hadoop jar files for adding eclipse

Hi@Manl, To import jar file in your Eclipse ...READ MORE

Jul 20, 2020 in Big Data Hadoop by MD
• 95,460 points
6,807 views
0 votes
1 answer

How to see the report of Hadoop Cluster from command line?

Hi@akhtar, You can see the report of Hadoop Cluster ...READ MORE

Sep 25, 2020 in Big Data Hadoop by MD
• 95,460 points
3,910 views
+1 vote
1 answer

When to use Hadoop, HBase, Hive and Pig?

MapReduce is just a computing framework. HBase has ...READ MORE

Nov 20, 2020 in Big Data Hadoop by Gitika
• 65,730 points
1,388 views
0 votes
1 answer

How to write a Scala program in script mode?

Open notepad and add the following code ...READ MORE

Nov 16, 2020 in Big Data Hadoop by Gitika
• 65,730 points
1,508 views
0 votes
1 answer

Error: Could not create the Java Virtual Machine in Hadoop.

Hi@akhtar, You can list down all the files ...READ MORE

Oct 16, 2020 in Big Data Hadoop by MD
• 95,460 points
2,803 views
0 votes
1 answer

How to find the number of blocks for a file in Hadoop?

Hi@akhtar, You can use Hadoop file system command to ...READ MORE

Oct 13, 2020 in Big Data Hadoop by MD
• 95,460 points
2,872 views
0 votes
1 answer

How to change block size in Hadoop dynamically?

Hi@akhtar, By default, the block size is 64MB ...READ MORE

Sep 25, 2020 in Big Data Hadoop by akhtar
• 38,260 points
3,580 views