How to decrease load on HBase while importing Sqoop

Question

Hi. I am trying to import data using sqoop import to a table in HBase. I am using the below command to do this:

$ sqoop import <all parameters you are using> --hbase-table <table name>

The problem is that the process is taking too much time and when I researched the reason for this, I found that it could be because there can be more load on HBase. My question is, how can I decrease this load on HBase?

Answer 1

Sqoop by default serializes all the input to HBase. I think the load is due to direct writes being made on HBase. But fortunately, sqoop allows us to handle bulk data while import data to HBase. To decrease the load on HBase, use the following command:

$ sqoop import <all parameters you are using> --hbase-table <table name> --hbase-bulkload