Creating a Parquet or Avro file

Question

How we can create Parquet file or AVro format in hadoop? Can we directly export it using the extension of the format we want?

Answer 1

In hadoop, we do not create different file formats. Instead, we can process different file formats. 

You can create a table that can store data in parquet format and view as well. Example:

Creating a table in hive to store parquet format:

We cannot load text file directly into parquet table, we should first create an alternate table to store the text file and use insert overwrite command to write the data in parquet format.

We will create a table to store text data

Load the data into the table 

Check the data

Here the text data is already converted into parquet file inside table present in hive. 

Exporting the table with desired format extension will not work.