[HIVE-22013] "Show table extended" query fails with Wrong FS error for partition in customized location

• Type: Bug
• Status: Patch Available
• Priority: Minor
• Resolution: Unresolved
• Component/s: Hive
• Labels: pull-request-available
• Assignee: Ganesha Shreedhara
• Reporter: Rajesh Balamohan
• Created: 21/Jul/19 02:30
• Updated: 23/Sep/22 00:29

Description

In some of the `show table extended` statements, following codepath is invoked

https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/TextMetaDataFormatter.java#L421

https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/TextMetaDataFormatter.java#L449

https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/TextMetaDataFormatter.java#L468

1. Not sure why this invokes stats computation. This should be removed?
2. Even if #1 is needed, it would be broken when tblPath and partitionPaths are different (i.e when both of them of them are in different fs or configured via router etc).

Caused by: java.lang.IllegalArgumentException: Wrong FS: hdfs://xyz/blah/tables/location/, expected: hdfs://zzz..
	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:657)
	at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:194)
	at org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:698)
	at org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:106)
	at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:763)
	at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:759)
	at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
	at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:759)
	at org.apache.hadoop.hive.ql.metadata.formatting.TextMetaDataFormatter.writeFileSystemStats(TextMetaDataFormatter.java

Issue Links

• links to: GitHub Pull Request #3231