Trending questions in Big Data Hadoop

0 votes
1 answer

In Hue, how to to download the script?

You can download the script to your ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,501 views
0 votes
1 answer

How does the number of groups affect the cost of the shuffling phase?

Shuffle happens with key-value pairs. So, when ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,220 points
820 views
0 votes
1 answer

Hive table not able to use row format serde

Try this: create table books(isbn string, book_title string, ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,753 views
0 votes
1 answer

Hadoop: Can not start namenode: Unable to load native-hadoop library for your platform

The entries in your .bashrc file looks ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,874 views
+1 vote
1 answer

Unable to load data in Hbase table from dataset

Try these steps (make necessary changes): First upload ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,270 views
0 votes
1 answer

Sqoop creating new file for import evertime

No, you are not doing anything wrong ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,364 views
0 votes
1 answer

Sqoop import gives error: org.apache.hadoop.security.AccessControlException: Permission denied

Seems like you are not passing the ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,290 views
0 votes
1 answer

Why does one remove or add nodes in a Hadoop cluster frequently?

One of the most attractive features of ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,460 views
0 votes
1 answer

Hadoop Hive: message:Version information not found in metastore. Unable to instantiate

These are the necessary tables required for metastore that are ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,812 views
0 votes
1 answer

How can I access S3/S3n from a local Hadoop 2.6 installation?

For some reason, the jar hadoop-aws-[version].jar which contains the ...READ MORE

Oct 3, 2018 in Big Data Hadoop by digger
• 26,740 points
5,531 views
0 votes
1 answer

Not able to start/stop hadoop daemons

If you were able to start the ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,142 views
–1 vote
1 answer

Jobtracker and tasktracker is nor running.

Hi. You'll need to run start-mapred.sh if you want the ...READ MORE

Jan 19, 2019 in Big Data Hadoop by Omkar
• 69,220 points
924 views
0 votes
1 answer

How to change file format using Sqoop?

For change in the file format, you ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,261 views
0 votes
1 answer

mongo-hadoop connector:how to query data?

You can add more parameters in the ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Frankie
• 9,830 points
1,326 views
–1 vote
1 answer

How to change the default HUE logs path?

You can change/replace the LOG_DIR variable to ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,373 views
–1 vote
1 answer

Hive partition tables

Yes, you can create manual partition. Here's ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,495 views
0 votes
1 answer

Hadoop mapreduce error: apache.hadoop.mapred.FileAlreadyExistsException: Output directory

Seems like the output file already exists. ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,744 views
0 votes
1 answer

What are SUCCESS and part-r-00000 files in Hadoop?

Yes, both the files i.e. SUCCESS and ...READ MORE

Apr 12, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
12,934 views
0 votes
1 answer

How to connect hive to tableau?

We Can not connect hive to tableau ...READ MORE

Dec 28, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,720 views
–1 vote
1 answer

How we can run spark SQL over hive tables in our cluster?

Open spark-shell. scala> import org.apache.spark.sql.hive._ scala> val hc = ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,806 views
0 votes
1 answer

Hadoop Mapreduce: Class Not Found Exception

Try adding this Job job = new Job(conf, ...READ MORE

Oct 29, 2018 in Big Data Hadoop by Omkar
• 69,220 points
4,271 views
0 votes
1 answer

"Cant connect to local mysql server through socket "var/lib/mysql/mysql.sock" .

Seems like mysql.sock does not exist in the ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,748 views
+4 votes
3 answers

Unable to find file error- while Streaming Hadoop

Is python installed running on the slaves that ...READ MORE

Oct 16, 2018 in Big Data Hadoop by Vinith
4,591 views
0 votes
1 answer

Not able to create Hive table from HDFS file

You dont have to specify the file name ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,622 views
–1 vote
1 answer

Beeline and Hive Query Editor in Embedded mode

Running Hive client tools with embedded servers ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,536 views
–1 vote
1 answer

Beeline vs Hive Query Editor

Hive CLI connects to a remote HiveServer1 ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,536 views
0 votes
1 answer

How to find the running namenodes and secondary name nodes in hadoop?

Name nodes: hdfs getconf -namenodes Secondary name nodes: hdfs getconf ...READ MORE

Nov 26, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,001 views
0 votes
1 answer

Script storage in Hue

You can follow these steps to find ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,168 views
0 votes
1 answer

Cant access the Hadoop Namenode from browser

As mentioned in the error, the nodes ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,938 views
0 votes
1 answer

How do I join 2 tables in PIG using 2 fields?

Here, we have two tables: Tab1 having columns ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,236 views
–1 vote
1 answer

Cant open spark-shell webconsole

Seems like you have installed Spark2 but ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,620 views
–1 vote
1 answer

Who will setup multimode and single node modes?

Cluster management is something that is generally ...READ MORE

Jan 21, 2019 in Big Data Hadoop by Omkar
• 69,220 points
518 views
0 votes
1 answer

How to extract only few lines of data from HDFS?

Here also in case of Hadoop, it is ...READ MORE

May 2, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
11,851 views
0 votes
1 answer

Apache Spark gives "Failed to load native-hadoop with error"

Seems like hadoop path is missing in java.library.path. ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,999 views
–1 vote
1 answer

Serde query understanding

In the query mentioned in your question, ...READ MORE

Dec 29, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,434 views
+1 vote
1 answer

Hadoop Map Reduce: java.lang.reflect.InvocationTargetException

I executed the same code and it ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,818 views
0 votes
1 answer

Hadoop: java.io.IOException: File could only be replicated to 0 nodes instead of minReplication (=1)

Try this, first stop all the daemons, ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,630 views
0 votes
1 answer

How can anyone recover deleted HDFS data?

Yes, there is a trash policy in ...READ MORE

May 16, 2018 in Big Data Hadoop by Shubham
• 13,490 points
11,160 views
0 votes
1 answer

What is the difference between Hive internal tables and external tables?

Hive has a relational database on the ...READ MORE

Nov 19, 2018 in Big Data Hadoop by Neha
• 6,300 points
3,024 views
–1 vote
1 answer

How to access Hadoop counter values using API?

You can use the job object to access the ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,240 views
–1 vote
1 answer

Changing map and reduce slots

Follow these steps to set the map ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,061 views
0 votes
1 answer

How are blocks created while written file in hdfs?

Suppose we want to write a 1 ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,614 views
0 votes
1 answer

Sqoop data transfer with SSL or SFtp

Sqoop supports SSL/TLS data transfer with the ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,729 views
0 votes
1 answer

MySql connection problem "Cant connect to local mysql server through socket "var/lib/mysql/mysql.sock" .

First start the mysql server: service mysqld start To ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,384 views
0 votes
1 answer

MapReduce "cannot be resolved to a type" error

One of the reasons could be different ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,706 views
–1 vote
1 answer

Not able to execute mapreduce code

Follow the below steps to execute the ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,220 points
884 views
–1 vote
1 answer

Getting error when writing to HDFS. Unable to load native-hadoop library for your platform

Try this: sudo service hadoop-master restart After that try ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,220 points
1,687 views
0 votes
1 answer

Hadoop Mapreduce: Error: Could not find or load main class com.sun.tools.javac.Main

You have to add HADOOP_CLASSPATH environment parameter: expor ...READ MORE

Oct 30, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,814 views
0 votes
1 answer

Hadoop sqoop import not working. Error: ERROR manager.SqlManager: Error reading from database

In the command, try mentioning the driver ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,220 points
2,246 views
0 votes
1 answer

Hadoop plugin (1.0.3) for eclipse

When you have Hadoop Eclipse plugin installed ...READ MORE

Dec 28, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,290 views