Error reading avro dataset in spark

Question

I'm trying to read an avro file using spark data frame. but getting below error:

var df = sqc.read.avro("sqoop/order")
:28: error: value avro is not a member of org.apache.spark.sql.DataFrameReader
var df = sqc.read.avro("sqoop/order")
^

scala> import com.
amazonaws cloudera esotericsoftware fasterxml google jcraft microsoft oracle sun twitter yammer 
clearspring codahale facebook github jamesmurty jolbox ning squareup thoughtworks univocity 

scala> import com.databrics.spark.com
:25: error: object databrics is not a member of package com
import com.databrics.spark.com

Answer 1

For avro, you need to download and include spark-avro provided by databricks in packages list. You can use this version:

com.databricks:spark-avro_2.11:3.2.0

After including use the code as shown below.

val df=spark.read.format("com.databricks.spark.avro").option("header","true").load("file")