[SPARK-16605] Spark2.0 cannot "select" data from a table stored as an orc file which has been created by hive while hive or spark1.6 supports

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0, 2.1.2, 2.2.0
• Fix Version/s: 2.2.1, 2.3.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: marymwu
• Created: 18/Jul/16 12:15
• Updated: 09/Nov/17 20:14
• Resolved: 10/Nov/16 08:52

Description

Spark2.0 cannot "select" data from a table stored as an orc file which has been created by hive while hive or spark1.6 supports

Steps:
1. Use hive to create a table "tbtxt" stored as txt and load data into it.
2. Use hive to create a table "tborc" stored as orc and insert the data from table "tbtxt" . Example, "create table tborc stored as orc as select * from tbtxt"
3. Use spark2.0 to "select * from tborc;".-->error occurs,java.lang.IllegalArgumentException: Field "nid" does not exist.

Issue Links

• duplicates: SPARK-14387 Enable Hive-1.x ORC compatibility with spark.sql.hive.convertMetastoreOrc