[HIVE-27438] Audit leader election event failed in non-appendable filesystems

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-beta-1
• Component/s: Standalone Metastore
• Labels: pull-request-available
• Assignee: Zhihua Deng Assign to me
• Reporter: Zhihua Deng
• Created: 14/Jun/23 06:25
• Updated: 15/Aug/23 06:33
• Resolved: 11/Jul/23 06:14

Description

If the underlying file system of the warehouse is S3 or others based which cannot support append operation, then auditing the leader info to the remote file could be failed. For example:

org.apache.hadoop.hive.metastore.HiveMetaStore: [Leader-Watcher-housekeeping1]: Error while writing the leader info, path: s3a://.../leader_housekeeping.json

java.lang.UnsupportedOperationException: Append is not supported by S3AFileSystem

As a result, the audit logs would be missing and the user cannot be able to see the history changes of leader any more.

Issue Links

• relates to: HIVE-26509 Introduce dynamic leader election in HMS
• links to: GitHub Pull Request #4416