Trending questions in Big Data Hadoop

0 votes
1 answer

I have to ingest in hadoop cluster large number of files for testing , what is the best way to do it?

Hi@sonali, It depends on what kind of testing ...READ MORE

Jul 8, 2020 in Big Data Hadoop by MD
 • 95,460 points • 2,133 views
0 votes
1 answer

Exception in createBlockOutputStream java.net.SocketTimeoutException: 69000 millis timeout while waiting for channel to be ready for connect.[connection-pending remote=/ xxx:50010]

Hi@akhtar, This type of error indicates a write ...READ MORE

Apr 30, 2020 in Big Data Hadoop by MD
 • 95,460 points • 4,506 views
0 votes
1 answer

How to get the column name printed in a file along with the output in Hive?

Hi @Neethu, Regarding your query, I would suggest ...READ MORE

Jul 2, 2020 in Big Data Hadoop by Gitika
 • 65,730 points • 1,755 views
0 votes
1 answer

getting error: -bash: syntax error near unexpected token `('

hi, you should give space between PigStorage and ...READ MORE

May 9, 2020 in Big Data Hadoop by anonymous
 • 140 points • 4,144 views
0 votes
0 answers

Data import using sqoop to Hive

Hello Everyone, I am trying to import data ...READ MORE

Jul 3, 2020 in Big Data Hadoop by anonymous
 • 120 points • 1,685 views
0 votes
1 answer

Hive complex data types

There are three complex types in hive, arrays: ...READ MORE

Jul 5, 2019 in Big Data Hadoop by Gani
 • 17,309 views
+1 vote
1 answer

starting hive gave me exception

Hi@Hans, You may got this error, if you ...READ MORE

May 20, 2020 in Big Data Hadoop by MD
 • 95,460 points • 3,313 views
0 votes
1 answer

exception:org.apache.hadoop.security.AccessControlException Permission denied: user=test, access=WRITE, inode="/user/hive/warehouse/test"

Hi@akhtar, According to your error, it shows you ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
 • 95,460 points • 4,722 views
0 votes
1 answer

apache.spark.sql.AnalysisException: Text data source does not support int data type.;

Hi@akhtar, I think your output is in different ...READ MORE

Feb 13, 2020 in Big Data Hadoop by MD
 • 95,460 points • 7,297 views
0 votes
1 answer

ERROR [main] client.HConnectionManager$HConnectionImplementation: Can't get connection to ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase ERROR: KeeperErrorCode = ConnectionLoss for /hbase

Hi@akhtar, Before starting Hbase Shell, make sure you ...READ MORE

Apr 30, 2020 in Big Data Hadoop by MD
 • 95,460 points • 3,964 views
0 votes
1 answer

ERROR tool.BaseSqoopTool: Got error creating database manager: java.io.IOException: No manager for connect string

Hi@akhtar, I think your jdbc jars are not ...READ MORE

Apr 24, 2020 in Big Data Hadoop by MD
 • 95,460 points • 4,214 views
0 votes
2 answers

How to get column names from Hive table?

To get all the columns of a ...READ MORE

Jun 4, 2019 in Big Data Hadoop by anonymous
edited Jun 4, 2019 by Omkar • 22,268 views
0 votes
1 answer

How to count lines in a file on hdfs command?

Use the below commands: Total number of files: hadoop ...READ MORE

Aug 10, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 30,990 views
0 votes
1 answer

ERROR org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - ZooKeeper exists failed after 4 attempts

Hi@akhtar, This error shows, Hbase is not able ...READ MORE

Mar 31, 2020 in Big Data Hadoop by MD
 • 95,460 points • 4,859 views
0 votes
0 answers

while iam exporting data from hive to sql iam getting an error like export job failed

Jun 6, 2020 in Big Data Hadoop by anonymous
 • 120 points • 1,861 views
0 votes
2 answers

Limit the maximum number of dynamic partitions in Hive

if you are already on hive shell ...READ MORE

Jul 23, 2020 in Big Data Hadoop by Shantanu
 • 190 points • 8,881 views
0 votes
11 answers

What is the command to start Job history server in Hadoop 2.x & how to get its UI?

mr-jobhistory-daemon. sh start historyserver READ MORE

Jul 24, 2019 in Big Data Hadoop by Lokesh Singh
 • 25,002 views
0 votes
1 answer

Error mapreduce.Job: Task Id : attempt_1475517800829_0009_m_000000_0, Status : FAILED Error: Java heap space

Hi@Hasid, To avoid this error, you have to ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
 • 95,460 points • 3,729 views
0 votes
1 answer

Import JSON file into hive

There are two ways to load json ...READ MORE

Jul 15, 2019 in Big Data Hadoop by Guru
 • 15,674 views
0 votes
5 answers

Hadoop hdfs: list all files in a directory and its subdirectories

Hi, You can try this command: hadoop fs -ls ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Dinish
 • 20,743 views
0 votes
0 answers

I have a file uploaded through ftp. Next I want to upload it to local file system in hadoop

Jan 24, 2019 in Big Data Hadoop by Mohan
 • 140 points
edited Jan 24, 2019 by Omkar • 2,222 views
0 votes
1 answer

INFO hdfs.DFSClient: Could not obtain block blk_-from any node: java.io.IOException: No live nodes contain current block

Hi@akhtar, I think your Datanodes are not in ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
 • 95,460 points • 3,465 views
0 votes
1 answer

main" java.io.IOException: Mkdirs failed to create /user/hadoop/name.

Hi@akhtar,  I think you missed to add below property ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
 • 95,460 points • 3,465 views
0 votes
7 answers

How to run a jar file in hadoop?

I used this command to run my ...READ MORE

Dec 10, 2018 in Big Data Hadoop by Dasinto
 • 30,140 views
0 votes
1 answer

Distcp From Local to HDFS giving error file not found

Hey, @Amey, This is probably because of a ...READ MORE

Apr 29, 2020 in Big Data Hadoop by Gitika
 • 65,730 points • 2,846 views
+1 vote
1 answer

[Error 10096]: Dynamic partition strict mode requires at least one static partition column. To turn this off set hive.exec.dynamic.partition.mode=nonstrict

Hi, Looking into your error I can say ...READ MORE

May 17, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 17,821 views
0 votes
1 answer

java.lang.NoSuchMethodError: java.util.concurrent.ConcurrentHashMap.keySet()Ljava/util/concurrent/ConcurrentHashMap$KeySetView

Hi@akhtar, I think there is a problem in ...READ MORE

Apr 30, 2020 in Big Data Hadoop by MD
 • 95,460 points • 2,663 views
0 votes
1 answer

Difference between put and copyFromLocal

-Put and -copyFromLocal is almost same command ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Neeraj
 • 14,413 views
0 votes
1 answer

What are good big data courses for freshers?

Hi@akhtar, There are lots of Big Data courses ...READ MORE

May 15, 2020 in Big Data Hadoop by MD
 • 95,460 points • 1,802 views
0 votes
1 answer

How do you start and stop region server in HBase?

Hey, You can run multiple region servers from ...READ MORE

May 23, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 17,241 views
0 votes
1 answer

Error: Couldn't properly initialize access to HDFS internals. Please update your WAL Provider to not make use of the 'asyncfs' provider.

Hi@akhtar, I think you are trying to use AsyncFSWAL for HBase-2.x as ...READ MORE

Apr 30, 2020 in Big Data Hadoop by MD
 • 95,460 points • 2,397 views
+1 vote
1 answer

How to change columname in a dataframe

Hi@shanmugam, You can change your column by using ...READ MORE

May 21, 2020 in Big Data Hadoop by MD
 • 95,460 points • 1,398 views
0 votes
1 answer

What skills are required to be a Hadoop developer?

Hi@akhtar, To become a Hadoop developer, you should ...READ MORE

May 15, 2020 in Big Data Hadoop by MD
 • 95,460 points • 1,655 views
0 votes
3 answers

What is Hive? Is Hive a database?

Hive is a data Warehouse infrastructure/system built ...READ MORE

Jul 1, 2019 in Big Data Hadoop by Ved Gupta
 • 25,515 views
0 votes
1 answer

Which is the best online Big Data Hadoop course?

Hi@akhtar, As you are a beginner, you should ...READ MORE

May 15, 2020 in Big Data Hadoop by MD
 • 95,460 points • 1,590 views
0 votes
1 answer

error:org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:456)] HDFS IO error java.io.IOException

Hi@akhtar, There may be problem in firewall, so ...READ MORE

Apr 23, 2020 in Big Data Hadoop by MD
 • 95,460 points • 2,493 views
0 votes
1 answer

ERROR node.Application: A fatal error occurred while running. Exception follows. org.apache.commons.cli.MissingOptionException: Missing required option: n

Hi@akhtar, I think you missed to add the ...READ MORE

Apr 23, 2020 in Big Data Hadoop by MD
 • 95,460 points • 2,415 views
0 votes
3 answers

JDBC connection string for Netezza

HI.. Netezza is one of the widely used ...READ MORE

Oct 30, 2020 in Big Data Hadoop by SRI
 • 5,033 views
0 votes
1 answer

java.io.IOException: File /user/hadoop/ could only be replicated to 0 nodes, instead of 1

Hi@akhtar, To avoid this error, follow the bellow ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
 • 95,460 points • 2,397 views
0 votes
1 answer

kernel: java: page allocation failure. order:4, mode:0x20

Hi@akhtar, You may got this error because of ...READ MORE

Apr 30, 2020 in Big Data Hadoop by MD
 • 95,460 points • 1,807 views
0 votes
1 answer

ERROR 2999: Unexpected internal error. Failed to create DataStorage.

Hi@akhtar, I think you didn't set all the ...READ MORE

Apr 17, 2020 in Big Data Hadoop by MD
 • 95,460 points • 2,258 views
0 votes
1 answer

How to create one job in Sqoop?

Hi@akhtar, You can create one job for future ...READ MORE

Apr 29, 2020 in Big Data Hadoop by MD
 • 95,460 points • 1,728 views
0 votes
2 answers

How to change the location of a table in hive?

Changing location requires 2 steps: 1.) Change location ...READ MORE

Feb 12, 2020 in Big Data Hadoop by Saksham Sehrawet
 • 10,922 views
0 votes
0 answers

Real time access to data in hadoop

We need to store customer billing data ...READ MORE

Apr 30, 2020 in Big Data Hadoop by anonymous
 • 120 points • 1,722 views
+1 vote
2 answers

How to find the database daily refresh time / sync up time

I use this code to get the ...READ MORE

Sep 17, 2019 in Big Data Hadoop by Raman
 • 11,215 views
0 votes
1 answer

What is the difference between S3n, S3a, and S3?

Your doubt is quite an interesting one. Yes, ...READ MORE

Jul 30, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 13,380 views
0 votes
1 answer

ERROR org.apache.hadoop.hbase.regionserver.HRegionServer: ZooKeeper session expired

Hi@akhtar, To avoid this error you have to ...READ MORE

Mar 31, 2020 in Big Data Hadoop by MD
 • 95,460 points • 2,767 views
0 votes
1 answer

how to make an existing hadoop cluster self adaptive?

Hey, @Sanjana, You can't shrink or expand nodes ...READ MORE

Jul 16, 2020 in Big Data Hadoop by Gitika
 • 65,730 points • 1,508 views
0 votes
1 answer

can we add hadoop in docker or online server or cloud

Hi@Rajan, If you are asking, can we configure hadoop ...READ MORE

May 1, 2020 in Big Data Hadoop by MD
 • 95,460 points • 1,383 views
0 votes
1 answer

Impala concatenate string.

Yes, you can concatenate two strings using ...READ MORE

Jun 6, 2019 in Big Data Hadoop by Raghu
 • 15,588 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.