[KUDU-3201] Support gzipped HMS notifications (GzipJSONMessageEncoder)

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.13.0
• Fix Version/s: 1.14.0
• Component/s: hms
• Assignee: Grant Henke
• Reporter: Grant Henke
• Created: 07/Oct/20 15:09
• Updated: 09/Oct/20 21:23
• Resolved: 09/Oct/20 21:23

Description

In HIVE-20679 a new message encoder was added to Hive that gzips and based64 encodes notification messages. In HIVE-21307 the default encoder was changed to use the gzip encoder, GzipJSONMessageEncoder.

Though Hive 4 is not released, failures as a result of this new message format were reported in IMPALA-8751. We should add support for the gzip format to prevent future HMS sync issues.

Issue Links

• relates to: IMPALA-8751 Kudu tables cannot be found after created
• relates to: HIVE-20679 DDL operations on hive might create large messages for DBNotification
• relates to: HIVE-21307 Need to set GzipJSONMessageEncoder as default config for EVENT_MESSAGE_FACTORY.