Trending questions in Big Data Hadoop

0 votes
1 answer

What is the difference between Hive internal tables and external tables?

Hive has a relational database on the ...READ MORE

Nov 19, 2018 in Big Data Hadoop by Neha
• 6,300 points
• 4,197 views
–1 vote
1 answer

Who will setup multimode and single node modes?

Cluster management is something that is generally ...READ MORE

Jan 21, 2019 in Big Data Hadoop by Omkar
• 69,180 points
• 1,476 views
0 votes
1 answer

How to securely transfer data from rdms to hdfs using sqoop?

Sqoop stores metadata in a repository and ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,893 views
–1 vote
1 answer

How to restrict nodes that talk to namenode?

Step 1: Create includes file in /home/hadoop ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
• 69,180 points
• 2,182 views
0 votes
1 answer

How are blocks created while written file in hdfs?

Suppose we want to write a 1 ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,756 views
0 votes
1 answer

Hadoop plugin (1.0.3) for eclipse

When you have Hadoop Eclipse plugin installed ...READ MORE

Dec 28, 2018 in Big Data Hadoop by Frankie
• 9,830 points
• 2,482 views
–1 vote
1 answer

Serde query understanding

In the query mentioned in your question, ...READ MORE

Dec 29, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,453 views
0 votes
1 answer

Hadoop sqoop import not working. Error: ERROR manager.SqlManager: Error reading from database

In the command, try mentioning the driver ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 3,403 views
–1 vote
1 answer

Changing map and reduce slots

Follow these steps to set the map ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
• 69,180 points
• 2,141 views
0 votes
1 answer

How to fix corrupt HDFS FIles?

You can use hdfs fsck / to ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Frankie
• 9,830 points
• 5,184 views
+1 vote
1 answer

Hadoop Map Reduce: java.lang.reflect.InvocationTargetException

I executed the same code and it ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,834 views
–1 vote
1 answer

Not able to execute mapreduce code

Follow the below steps to execute the ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,180 points
• 1,997 views
0 votes
1 answer

Transfer data between 2 Tables having issues with Date conversion from string to Date datatype.

This can be solved making use of ...READ MORE

Dec 28, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,369 views
0 votes
1 answer

Sqoop data transfer with SSL or SFtp

Sqoop supports SSL/TLS data transfer with the ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,795 views
0 votes
1 answer

MySql connection problem "Cant connect to local mysql server through socket "var/lib/mysql/mysql.sock" .

First start the mysql server: service mysqld start To ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,447 views
+3 votes
5 answers

Hadoop DistributedCache is deprecated - what is the preferred API?

I had the same problem. And not ...READ MORE

Oct 12, 2018 in Big Data Hadoop by Rohan
• 5,707 views
0 votes
1 answer

Hadoop Spark: __spark_lib.zip does not exist

To find this file, your HADOOP_CONF_DIR env ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 4,180 views
+1 vote
1 answer

Not able to start datanode in Hadoop

Follow these steps: Stop namenode Delete the datanode directory ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,924 views
0 votes
1 answer

Extracting pig log messages

You can use the following commands in ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,180 points
• 1,839 views
0 votes
1 answer

Hadoop regarding input split

Hadoop framework divides a large file into ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,295 views
0 votes
1 answer

Small files and HDFS blocks

Multiple files are not stored in a ...READ MORE

Nov 16, 2018 in Big Data Hadoop by Frankie
• 9,830 points
• 4,057 views
0 votes
1 answer

MapReduce "cannot be resolved to a type" error

One of the reasons could be different ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,670 views
0 votes
1 answer

How to use mountable HDFS on Centos?

Hey. You can use the following commands ...READ MORE

Nov 26, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 3,621 views
0 votes
1 answer

How to execute wordcount in Hadoop?

Follow these steps: Step 1:  Import all these hadoop ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,605 views
–1 vote
1 answer

Can't seem to make hdfs commands to work

Check the ip address mentioned in core-site.xml ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,549 views
0 votes
1 answer

How to write a file in hdfs with Java?

You could pass the URI when getting ...READ MORE

Sep 26, 2018 in Big Data Hadoop by digger
• 26,740 points
• 6,229 views
0 votes
1 answer

What is distributed Cache in MapReduce Framework ?

Distributed Cache is an important feature provided ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Frankie
• 9,830 points
• 3,138 views
0 votes
1 answer

Processing image in hdfs

If your block size is 64 MB, ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,234 views
0 votes
1 answer

Hadoop backup and recovery tool and guidance

There are a few options for backup ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Frankie
• 9,830 points
• 1,921 views
0 votes
3 answers

How to specify KeyValueTextInputFormat Separator in Hadoop-.20 api?

conf.set("key.value.separator.in.input.line", ","); Job job = new ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Rio
• 4,000 views
–1 vote
1 answer

Job History Server edit logs

When the application master fails, each file ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,274 views
0 votes
1 answer

What is the meaning of Write Ahead Log in Hadoop?

Write Ahead Log (WAL) is a file ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Sunil
• 3,785 views
0 votes
1 answer

How do I install cloudera Hadoop without internet connection?

You can do that by selecting the ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Neha
• 6,300 points
• 2,840 views
0 votes
1 answer

Apache Spark vs MapReduce

Both Spark and Hadoop MapReduce are used ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,520 views
0 votes
1 answer

Hive ACID semantics

ACID stands for Atomicity, Consistency, Isolation, and Durability.  Until ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
• 69,180 points
• 1,801 views
–1 vote
1 answer

Serde input and output

Input Processing Hive's execution engine (referred to as ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,173 views
–1 vote
1 answer

Issue with MySql Server connection

Try to restart the mysqld server and then login: sudo ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,180 points
• 1,909 views
–1 vote
1 answer

Where does reduce take place in Hadoop MapReduce?

A MapReduce job usually splits the input data-set into ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,548 views
0 votes
3 answers

Can we run Spark without using Hadoop?

No, you can run spark without hadoop. ...READ MORE

May 7, 2019 in Big Data Hadoop by pradeep
• 5,231 views
0 votes
1 answer

Hadoop: Datanode not starting correctly

You can do the following method, copy to ...READ MORE

Nov 5, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 4,347 views
0 votes
1 answer

How is a file written in hdfs?

When you copy a file from the ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,354 views
0 votes
1 answer

Cant find slave on ResourceManager Web UI

Seems like it is running on default ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 3,074 views
0 votes
1 answer

Not able to start jobtracker in hadoop

There is no jobtracker in hadoop 2.2.0 YARN framework. ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,758 views
–1 vote
1 answer

How to Set cluster Rebalancer threshold

The command you are using is wrong. ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
• 69,180 points
• 1,745 views
–1 vote
1 answer

Copying jar file into hadoop

hdfs dfs -put input_file_name output_location READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,436 views
–1 vote
1 answer

Spark multiple version without major version

Yes. It is not necessary to set ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,076 views
0 votes
1 answer

Pig CLI mode

Pig can be used in two modes: 1) ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
• 69,180 points
• 1,679 views
0 votes
1 answer

How to configure Hosts file for Hadoop Eco-System?

For UBUNTU Hosts File and other configuration for Hadoop ...READ MORE

Sep 25, 2018 in Big Data Hadoop by Frankie
• 9,830 points
• 6,055 views
0 votes
1 answer

How to read Spark elements having multiple lines each?

Try this: val new_records = sc.newAPIHadoopRDD(hadoopConf,classOf[ ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,660 views
0 votes
1 answer

Not able to install hadoop using maven

First make sure you have ant installed ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,180 points
• 2,891 views