[FLINK-25330] Flink SQL doesn't retract all versions of Hbase data - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Resolved
Affects Version/s: None
Fix Version/s: None
Component/s: Connectors / HBase
Labels:
- pull-request-available

Language:
- Java

Description

Background

When we use CDC to synchronize mysql data to HBase, we find that HBase deletes only the last version of the specified rowkey when deleting mysql data. The data of the old version still exists. You end up using the wrong data. And I think its a bug of HBase connector.

The following figure shows Hbase data changes before and after mysql data is deleted.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

bundle_data.zip
21/Dec/21 12:05
3 kB
Bruce Wong
bundle_data1.zip
24/Dec/21 09:24
8 kB
Bruce Wong
Flink-SQL-Test.zip
21/Dec/21 12:03
21 kB
Bruce Wong
image-2021-12-15-20-05-18-236.png
15/Dec/21 12:05
974 kB
Bruce Wong
test_res_1.png
21/Dec/21 12:14
581 kB
Bruce Wong
test_res.png
21/Dec/21 12:08
610 kB
Bruce Wong
test_res2.png
24/Dec/21 09:24
999 kB
Bruce Wong

Issue Links

is duplicated by

FLINK-25560 Add "sink.delete.mode" in HBase sql connector for retracting the latest version or all versions in changelog mode

In Progress

is fixed by

FLINK-25560 Add "sink.delete.mode" in HBase sql connector for retracting the latest version or all versions in changelog mode

In Progress

links to

GitHub Pull Request #18120

Activity

People

Assignee:: Jing Ge

Reporter:: Bruce Wong

Votes:: 0 Vote for this issue

Watchers:: 4 Start watching this issue

Dates

Created:: 15/Dec/21 12:04

Updated:: 11/Jan/22 09:26

Resolved:: 11/Jan/22 09:26