[IMPALA-11834] Iceberg LOAD DATA hdfsDelete can crash JVM

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 4.3.0
• Fix Version/s: Impala 4.3.0
• Component/s: Backend, Frontend
• Labels: iceberg
• Epic Color: ghx-label-2
• Assignee: Tamas Mate
• Reporter: Riddhi jain
• Created: 10/Jan/23 10:38
• Updated: 23/Feb/23 07:54
• Resolved: 23/Feb/23 07:54

Description

It is probably caused by the incorrectly initialising the hdfsFS object before executing the delete. 

hdfsDelete(path=s3a://bucket-external/path/to/table/icebergtable1/.tmp_8cd3828f-27dd-4d49-be7a-4453207ecfb7, recursive=1): FileSystem#delete error:IllegalArgumentException: Wrong FS s3a://bucket-external//path/to/table/icebergtable1/.tmp_8cd3828f-27dd-4d49-be7a-4453207ecfb7 -expected s3a://bucket-managed    at org.apache.hadoop.fs.s3native.S3xLoginHelper.checkPath(S3xLoginHelper.java:224)    at org.apache.hadoop.fs.s3a.S3AFileSystem.checkPath(S3AFileSystem.java:1375)    at org.apache.hadoop.fs.FileSystem.makeQualified(FileSystem.java:647)    at org.apache.hadoop.fs.s3a.S3AFileSystem.makeQualified(S3AFileSystem.java:1337)    at org.apache.hadoop.fs.s3a.S3AFileSystem.qualify(S3AFileSystem.java:1363)    at org.apache.hadoop.fs.s3a.S3AFileSystem.delete(S3AFileSystem.java:3132)