Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-20576

Flink Temporal Join Hive Dim Error

    XMLWordPrintableJSON

    Details

      Description

       

      KAFKA DDL

      CREATE TABLE hive_catalog.flink_db_test.kfk_master_test (
          master Row<reportDate String, groupID int, shopID String, shopName String, action int, orderStatus int, orderKey String, actionTime bigint, areaName String, paidAmount double, foodAmount double, startTime String, person double, orderSubType int, checkoutTime String>,
          proctime as PROCTIME()
      ) WITH (properties ..)

       

      FLINK client query sql

      SELECT * FROM hive_catalog.flink_db_test.kfk_master_test AS kafk_tbl 
        JOIN hive_catalog.gauss.dim_extend_shop_info /*+ OPTIONS('streaming-source.enable'='true', 'streaming-source.partition.include' = 'latest', 
         'streaming-source.monitor-interval' = '12 h','streaming-source.partition-order' = 'partition-name') */ FOR SYSTEM_TIME AS OF kafk_tbl.proctime AS dim 
         ON kafk_tbl.groupID = dim.group_id where kafk_tbl.groupID is not null;

      When I execute the above statement, these stack error messages are returned

      Caused by: java.lang.NullPointerException: bufferCaused by: java.lang.NullPointerException: buffer at org.apache.flink.core.memory.MemorySegment.<init>(MemorySegment.java:161) ~[flink-dist_2.11-1.12.0.jar:1.12.0] at org.apache.flink.core.memory.HybridMemorySegment.<init>(HybridMemorySegment.java:86) ~[flink-dist_2.11-1.12.0.jar:1.12.0] at org.apache.flink.core.memory.MemorySegmentFactory.wrap(MemorySegmentFactory.java:55) ~[flink-dist_2.11-1.12.0.jar:1.12.0] at org.apache.flink.table.data.binary.BinaryStringData.fromBytes(BinaryStringData.java:98) ~[flink-table_2.11-1.12.0.jar:1.12.0]

       

      Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to load table into cache after 3 retriesCaused by: org.apache.flink.util.FlinkRuntimeException: Failed to load table into cache after 3 retries at org.apache.flink.table.filesystem.FileSystemLookupFunction.checkCacheReload(FileSystemLookupFunction.java:143) ~[flink-table-blink_2.11-1.12.0.jar:1.12.0] at org.apache.flink.table.filesystem.FileSystemLookupFunction.eval(FileSystemLookupFunction.java:103) ~[flink-table-blink_2.11-1.12.0.jar:1.12.0] at LookupFunction$1577.flatMap(Unknown Source) ~[?:?] at org.apache.flink.table.runtime.operators.join.lookup.LookupJoinRunner.processElement(LookupJoinRunner.java:82) ~[flink-table-blink_2.11-1.12.0.jar:1.12.0] at org.apache.flink.table.runtime.operators.join.lookup.LookupJoinRunner.processElement(LookupJoinRunner.java:36) ~[flink-table-blink_2.11-1.12.0.jar:1.12.0] at org.apache.flink.streaming.api.operators.ProcessOperator.processElement(ProcessOperator.java:66) ~[flink-dist_2.11-1.12.0.jar:1.12.0]

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Leonard Xu Leonard Xu
                Reporter:
                HideOnBush HideOnBush
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated: