Minor Description
When data is read, "path" option is treated differently depending on how dataframe is created:
scala> Seq(1).toDF.write.mode("overwrite").parquet("/tmp/test") scala> spark.read.option("path", "/tmp/test").format("parquet").load("/tmp/test").show +-----+ |value| +-----+ | 1| +-----+ scala> spark.read.option("path", "/tmp/test").parquet("/tmp/test").show +-----+ |value| +-----+ | 1| | 1| +-----+
