How to convert Spark data into CSV

Question

I have a Spark Sql. I wanted to know how to convert this to a csv data. Or maybe export the Spark sql into a csv file. How can I do this?

Answer 1

You can use this:

df.write
  .option("header", "true")
  .csv("<path to the directory>/out.csv")

You can also convert the whole data frame like this:

df.coalesce(1).write
    .format("com.databricks.spark.csv")
    .option("header", "true")
    .save("<path to the directory>/out.csv")

Comments

I am getting a huge error when I use this. Are there any libraries to be imported?

df.write
  .option("header", "true")
  .csv("<path to the directory>/out.csv")

---

Can you share your error? It will help to solve the problem.