[SPARK-19905] Dataset.inputFiles is broken for Hive SerDe tables

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.2.0
• Fix Version/s: 2.2.0
• Component/s: SQL
• Target Version/s: 2.2.0
• Assignee: Cheng Lian
• Reporter: Cheng Lian
• Created: 10/Mar/17 19:09
• Updated: 10/Mar/17 23:19
• Resolved: 10/Mar/17 23:19

Description

The following snippet reproduces this issue:

spark.range(10).createOrReplaceTempView("t")
spark.sql("CREATE TABLE u STORED AS RCFILE AS SELECT * FROM t")
spark.table("u").inputFiles.foreach(println)

In Spark 2.2, it prints nothing, while in Spark 2.1, it prints something like

file:/Users/lian/local/var/lib/hive/warehouse_1.2.1/u

on my laptop.

Issue Links

• links to: [Github] Pull Request #17247 (liancheng)