[FLINK-20576] Flink Temporal Join Hive Dim Error

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.12.0
• Component/s: Connectors / Hive, Table SQL / Ecosystem
• Labels: auto-deprioritized-major auto-unassigned
• Assignee: Unassigned
• Reporter: HideOnBush
• Created: 11/Dec/20 10:30
• Updated: 23/Aug/23 10:35

Description

 

KAFKA DDL

CREATE TABLE hive_catalog.flink_db_test.kfk_master_test (
    master Row<reportDate String, groupID int, shopID String, shopName String, action int, orderStatus int, orderKey String, actionTime bigint, areaName String, paidAmount double, foodAmount double, startTime String, person double, orderSubType int, checkoutTime String>,
    proctime as PROCTIME()
) WITH (properties ..)

 

FLINK client query sql

SELECT * FROM hive_catalog.flink_db_test.kfk_master_test AS kafk_tbl 
  JOIN hive_catalog.gauss.dim_extend_shop_info /*+ OPTIONS('streaming-source.enable'='true', 'streaming-source.partition.include' = 'latest', 
   'streaming-source.monitor-interval' = '12 h','streaming-source.partition-order' = 'partition-name') */ FOR SYSTEM_TIME AS OF kafk_tbl.proctime AS dim 
   ON kafk_tbl.groupID = dim.group_id where kafk_tbl.groupID is not null;

When I execute the above statement, these stack error messages are returned

Caused by: java.lang.NullPointerException: bufferCaused by: java.lang.NullPointerException: buffer at org.apache.flink.core.memory.MemorySegment.<init>(MemorySegment.java:161) ~[flink-dist_2.11-1.12.0.jar:1.12.0] at org.apache.flink.core.memory.HybridMemorySegment.<init>(HybridMemorySegment.java:86) ~[flink-dist_2.11-1.12.0.jar:1.12.0] at org.apache.flink.core.memory.MemorySegmentFactory.wrap(MemorySegmentFactory.java:55) ~[flink-dist_2.11-1.12.0.jar:1.12.0] at org.apache.flink.table.data.binary.BinaryStringData.fromBytes(BinaryStringData.java:98) ~[flink-table_2.11-1.12.0.jar:1.12.0]

 

Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to load table into cache after 3 retriesCaused by: org.apache.flink.util.FlinkRuntimeException: Failed to load table into cache after 3 retries at org.apache.flink.table.filesystem.FileSystemLookupFunction.checkCacheReload(FileSystemLookupFunction.java:143) ~[flink-table-blink_2.11-1.12.0.jar:1.12.0] at org.apache.flink.table.filesystem.FileSystemLookupFunction.eval(FileSystemLookupFunction.java:103) ~[flink-table-blink_2.11-1.12.0.jar:1.12.0] at LookupFunction$1577.flatMap(Unknown Source) ~[?:?] at org.apache.flink.table.runtime.operators.join.lookup.LookupJoinRunner.processElement(LookupJoinRunner.java:82) ~[flink-table-blink_2.11-1.12.0.jar:1.12.0] at org.apache.flink.table.runtime.operators.join.lookup.LookupJoinRunner.processElement(LookupJoinRunner.java:36) ~[flink-table-blink_2.11-1.12.0.jar:1.12.0] at org.apache.flink.streaming.api.operators.ProcessOperator.processElement(ProcessOperator.java:66) ~[flink-dist_2.11-1.12.0.jar:1.12.0]

Issue Links

• duplicates: FLINK-20577 Flink Temporal Join Hive Dim Error
• relates to: FLINK-21557 An error was reported when temp join hive.