[HIVE-20679] DDL operations on hive might create large messages for DBNotification - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: 3.1.0
Fix Version/s: 4.0.0-alpha-1
Component/s: None
Labels:
- pull-request-available

Description

Certain type of ddl operations might create large messages as part of DBNoitification, this might lead to the rdbms throwing an error when storing the message since its size is to large. It will also increase the footprint of the rdbms space usage.

We should try store compressed messages to allow handling these situations.

Edit: For notification_log table the message column for all supported databases can store messages from 2GB to 4GB

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

a.sql
03/Oct/18 08:50
7 kB
Anishek Agarwal
b.sql
03/Oct/18 08:50
33 kB
Anishek Agarwal
HIVE-20679.1.patch
04/Oct/18 08:00
233 kB
Anishek Agarwal
HIVE-20679.2.patch
05/Oct/18 09:35
234 kB
Anishek Agarwal
HIVE-20679.3.patch
08/Oct/18 05:33
236 kB
Anishek Agarwal
HIVE-20679.4.patch
12/Oct/18 08:18
237 kB
Anishek Agarwal
HIVE-20679.5.patch
15/Oct/18 06:03
242 kB
Anishek Agarwal
HIVE-20679.6.patch
17/Oct/18 09:21
242 kB
Anishek Agarwal
HIVE-20679.8.patch
18/Oct/18 08:06
242 kB
Anishek Agarwal
HIVE-20679.9.patch
22/Oct/18 04:52
242 kB
Anishek Agarwal

Issue Links

causes

IMPALA-8751 Kudu tables cannot be found after created

Resolved

is related to

KUDU-3201 Support gzipped HMS notifications (GzipJSONMessageEncoder)

Resolved

links to

GitHub Pull Request #446

GitHub Pull Request #449

Activity

People

Assignee:: Anishek Agarwal

Reporter:: Anishek Agarwal

Votes:: 1 Vote for this issue

Watchers:: 6 Start watching this issue

Dates

Created:: 03/Oct/18 08:29

Updated:: 17/Nov/22 08:54

Resolved:: 22/Oct/18 08:22

Time Tracking

Estimated:

Not Specified

Remaining:

Logged:

20m