Trending questions in Big Data Hadoop

+1 vote
2 answers

Hadoop Hive: Not recognizing alias named in select part?

You can not use column aliases in ...READ MORE

Nov 26, 2019 in Big Data Hadoop by anonymous
11,282 views
+1 vote
0 answers

Job failed as tasks failed. failedMaps

Hello All, I am new to hadoop, i ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Hemanth
• 250 points

edited Aug 1, 2019 by Omkar 8,164 views
0 votes
1 answer

Sqoop could not load db driver class

Hello, Have you tried to put the both ...READ MORE

Dec 13, 2019 in Big Data Hadoop by Alexandru
• 510 points
3,424 views
+1 vote
1 answer

flume twitter data file not generated in HDFS

Seems like you've missed the source and ...READ MORE

Dec 2, 2019 in Big Data Hadoop by Esha
4,126 views
0 votes
1 answer

How to import data in sqoop as a Parquet file?

Sqoop allows you to import the file ...READ MORE

May 15, 2019 in Big Data Hadoop by Nanda
11,249 views
0 votes
1 answer

java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found.

 Try using the below build.sbt, code.scala and command ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Kishan
7,926 views
0 votes
1 answer

Sqoop: ERROR tool.BaseSqoopTool: Error parsing arguments

There are two mistakes in the command ...READ MORE

Aug 2, 2019 in Big Data Hadoop by Kunal
7,750 views
0 votes
2 answers

Hive update and delete limitations

Vinyl-like crackle sounds. And what is my ...READ MORE

May 3, 2020 in Big Data Hadoop by Carter
• 140 points
6,172 views
+2 votes
5 answers

How to transpose/pivot data in hive?

Below is also a way for Pivot SELECT ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Rahul
20,371 views
0 votes
1 answer

Hive: Assign subquery to variable

Refer to this example: Step1: Check table test1 ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Tina
7,730 views
0 votes
1 answer

Read Parquet file using hdfs dfs -cat command

When you try to read a parquet ...READ MORE

May 24, 2019 in Big Data Hadoop by Calvin
10,615 views
0 votes
2 answers

Function of “hadoop namenode -format” command

Namenode is the node in the Hadoop ...READ MORE

Feb 4, 2019 in Big Data Hadoop by Kanika
21,647 views
0 votes
1 answer

How to create sequential znode in zookeeper?

Hey, To create a Sequential znode, add -s flag as shown ...READ MORE

May 28, 2019 in Big Data Hadoop by Gitika
• 65,770 points
10,450 views
0 votes
1 answer

Converting CSV files to Parquet

--Create Hive external Table for existing data CREATE ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Yogi
7,646 views
+1 vote
0 answers

Hadoop Mapreduce : Null Pointer Exception

While running the below program, I got ...READ MORE

Dec 6, 2019 in Big Data Hadoop by Tarun
• 160 points
1,811 views
0 votes
1 answer

What is "java.sql.SQLException: org.apache.thrift.transport.TTransportException" in Hive?

This particular exception is related to Hive logs. ...READ MORE

Jul 30, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
7,346 views
0 votes
1 answer

How to replace characters in string in hive?

You can do it using regexp_replace. This is ...READ MORE

Nov 30, 2018 in Big Data Hadoop by Omkar
• 69,220 points
17,773 views
0 votes
1 answer

How can we use IN/EXIST operator in Hive?

Hey, Yes, now Hive supports IN or EXIST, ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Gitika
• 65,770 points
8,973 views
+1 vote
1 answer

Namenode v/s Secondary namenode

Name Node is a primary node in ...READ MORE

Sep 9, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
5,334 views
0 votes
1 answer

Namespace in HDFS?

Basically when we say Namespace we mean ...READ MORE

Apr 8, 2019 in Big Data Hadoop by Gitika
• 65,770 points
11,924 views
+1 vote
1 answer

" org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Permissions incorrectly set for dir " problem

This error is caused when hadoop tries ...READ MORE

Sep 9, 2019 in Big Data Hadoop by Kumar
5,223 views
0 votes
3 answers

Spark Scala: How to list all folders in directory

val spark = SparkSession.builder().appName("Demo").getOrCreate() val path = new ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Mark
17,928 views
0 votes
1 answer

Unzip files in hdfs

To unzip a gzipped (or bzipped) file, ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Joe
6,558 views
0 votes
1 answer

How to remove a Znode in Zookeeper?

Hey, Removes a specified znode and recursively all ...READ MORE

May 28, 2019 in Big Data Hadoop by Gitika
• 65,770 points
9,231 views
0 votes
1 answer

How to run mapreduce program in terminal?

You can reference the below steps: Step 1: ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Srishti
14,262 views
0 votes
1 answer

Why is Hive called as Data Warehouse?

Hive is a data warehouse infrastructure tool ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Joshua
6,666 views
+1 vote
1 answer

bash: sbin/hadoop: No such file or directory

The hadoop command is not present in ...READ MORE

Sep 18, 2019 in Big Data Hadoop by Omkar
• 69,220 points
4,216 views
0 votes
1 answer

How to see the version of Zookeeper I am running?

Hey, First, you need to have a running ...READ MORE

May 31, 2019 in Big Data Hadoop by Gitika
• 65,770 points
8,736 views
+2 votes
0 answers
0 votes
3 answers

How to change the delimiter in Sqoop?

--fields-terminated-by <char> READ MORE

Jun 25, 2019 in Big Data Hadoop by anonymous
10,854 views
+1 vote
1 answer

datanode decomissioning

You have set the replication factor to ...READ MORE

Nov 28, 2019 in Big Data Hadoop by Rahul
818 views
0 votes
2 answers

Difference between Hadoop 1 and 2

Hadoop V.1.x Components Apache Hadoop V.1.x has the ...READ MORE

Aug 28, 2018 in Big Data Hadoop by zombie
• 3,790 points
20,311 views
+1 vote
0 answers

Oozie filter all coordinator jobs based on nominalTime

Hi Edureka team. I would like to ...READ MORE

Nov 12, 2019 in Big Data Hadoop by Thayanban
• 130 points
1,265 views
0 votes
1 answer

Failed to start namenode in hadoop

Change your following properties in hdfs-site.xml <property> ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
• 69,220 points
14,323 views
0 votes
2 answers

How can I list NameNode & DataNodes from any machine in the Hadoop cluster?

You can browse hadoop page from any ...READ MORE

Jan 23, 2020 in Big Data Hadoop by MD
• 95,460 points
11,868 views
0 votes
1 answer

Sqoop: ERROR tool.BaseSqoopTool: Unrecognized argument

The command you are executing is slightly ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Sam
5,477 views
0 votes
1 answer

Hadoop hdfs "permission denied" error when I try to make new directory

This is because you dont have enough ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
• 69,220 points
16,171 views
0 votes
2 answers

Hadoop error: Input path does not exist

I was able to fix the issue. ...READ MORE

Jan 13, 2019 in Big Data Hadoop by Ponezhil Ramu
14,813 views
0 votes
1 answer

How setrep command is used and what is the description to this?

Hi, This HDFS command is used to change ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Gitika
• 65,770 points
7,034 views
0 votes
1 answer

Error: Container is running beyond Memory Limits

I had a similar problem while I was working ...READ MORE

Jun 20, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
6,967 views
0 votes
10 answers

Difference between single node & pseudo-distributed mode in Hadoop?

Single node is used for debugging the ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Mahisha
19,581 views
0 votes
1 answer

Sqoop - moving data from DB2 to HDFS ( hive partition table)

sqoop import --driver com.ibm.db2.jcc.DB2Driver --connect jdbc:db2://db2.my.com:50000/databaseName --username ...READ MORE

Aug 9, 2019 in Big Data Hadoop by Payal
4,725 views
0 votes
1 answer

Warning: Unable to load Hadoop Native Library for your platform. [closed]

 I had the same issue. It's solved ...READ MORE

Jun 28, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
6,465 views
0 votes
1 answer

How to resolve corrupted blocks in Hadoop?

You can use hdfs fsck / to ...READ MORE

Jul 5, 2019 in Big Data Hadoop by Nandini
6,043 views
0 votes
1 answer

How to Access Hive via Python?

The easiest way is to use PyHive. To ...READ MORE

Oct 9, 2018 in Big Data Hadoop by Omkar
• 69,220 points
17,547 views
+1 vote
0 answers

Class not found exception in wordcount program in mapreduce

import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.fs.Path; import java.io.IOException; import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat; import org.apache.hadoop.mapreduce.*; import org.apache.hadoop.mapreduce.lib.input.FileInputFormat; import ...READ MORE

Oct 3, 2019 in Big Data Hadoop by Tarun
• 160 points

edited Oct 3, 2019 by Omkar 2,007 views
0 votes
1 answer

Command to see the indexes of a table in Hive?

Hey, The command you can use to see ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
• 65,770 points

edited Jun 26, 2019 by Gitika 6,284 views
0 votes
1 answer

How to import data to hbase database?

There are 3 Ways to Load Data ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Karan Reddy
5,668 views
0 votes
1 answer

Load data into teradata using sqoop export

The general syntax to do this as ...READ MORE

Aug 9, 2019 in Big Data Hadoop by Kunal
4,337 views
0 votes
1 answer

Multiple input for MapReduce job

We use MultipleInputs class which supports MapReduce ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Jim
6,485 views