[SPARK-25993] Add test cases for CREATE EXTERNAL TABLE with subdirectories

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.2
• Fix Version/s: 3.0.0
• Component/s: SQL, Tests
• Assignee: kevin yu
• Reporter: Xiao Li
• Created: 09/Nov/18 18:05
• Updated: 18/Jan/20 01:18
• Resolved: 18/Jan/20 01:17

Description

Add a test case based on the following example. The behavior was changed in 2.3 release. We also need to upgrade the migration guide.

val someDF1 = Seq(
  (1, 1, "blah"),
  (1, 2, "blahblah")
).toDF("folder", "number", "word").repartition(1)

someDF1.write.orc("/tmp/orctab1/dir1/")
someDF1.write.orc("/mnt/orctab1/dir2/")

create external table tab1(folder int,number int,word string) STORED AS ORC LOCATION '/tmp/orctab1/");
select * from tab1;

create external table tab2(folder int,number int,word string) STORED AS ORC LOCATION '/tmp/orctab1/*");
select * from tab2;

Issue Links

• links to: [Github] Pull Request #23108 (kevinyu98)
• links to: GitHub Pull Request #27130