How to import PIG data into HBase

Question

Hi. I am new to HBase. I have some data in Pig and now I want to import it in HBase. How can I do it?

Answer 1

Follow the below steps to do it:

# Enter into HBase shell

[training@localhost ~]$ hbase shell

# Create a table ‘customers’ with column family ‘customers_data’

hbase(main):001:0> create 'customers', 'customers_data'

# List the tables


hbase(main):002:0> list

# Exit from HBase shell


hbase(main):003:0> exit

Step 2: Write the following PIG script to load data into the ‘customers’ table in HBase


-- Name your script Load_HBase_Customers.pig

-- Load dataset 'customers' from HDFS location


raw_data = LOAD 'hdfs:/user/training/customers' USING PigStorage(',') AS (

           custno:chararray,

           firstname:chararray,

           lastname:chararray,

           age:int,

           profession:chararray

);


-- To dump the data from PIG Storage to stdout

/* dump raw_data; */


-- Use HBase storage handler to map data from PIG to HBase

--NOTE: In this case, custno (first unique column) will be considered as row key.


STORE raw_data INTO 'hbase://customers' USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(

'customers_data:firstname

 customers_data:lastname

 customers_data:age

 customers_data:profession'

);