Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-36676

Flink CDC SQL Server Connector Missing Data

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Flink CDC
    • None
    • flink version:vvr-8.0.9-flink-1.17

      flink-cdc connector version:

       

    • Hide

      BEGIN STATEMENT SET;
      insert into holo.edw_holo.`ods.ods_history`
      select '1' as country_code,
              *
      from `vvp`.`default`.`ods_1_history`
      ;
      insert into holo.edw_holo.`ods.ods_history`
      select '2' as country_code,
              *
      from `vvp`.`default`.`ods_2_history`
      ;
      insert into holo.edw_holo.`ods.ods_history`
      select '2' as country_code,
              *
      from `vvp`.`default`.`ods_3_history`
      ;
      END;
      Show
      BEGIN STATEMENT SET; insert into holo.edw_holo.`ods.ods_history` select '1' as country_code,         * from `vvp`.`default`.`ods_1_history` ; insert into holo.edw_holo.`ods.ods_history` select '2' as country_code,         * from `vvp`.`default`.`ods_2_history` ; insert into holo.edw_holo.`ods.ods_history` select '2' as country_code,         * from `vvp`.`default`.`ods_3_history` ; END;

    Description

      When I was using FLINKCDC to collect streaming data from SQL Server, I found that data at a certain point in time was missing, but the task did not go wrong.
      I have checked my source table, the CDC table of the source table, and the result table, and found it may own to FLINKCDC ,as it my ods table do not obtain this data.


      ods_history,

      ct table from sqlserver  ,

      Attachments

        1. flink-sqlserver-cdc-3.1.0(2).zip
          32.10 MB
          Chance
        2. image-2024-11-08-16-49-46-313.png
          874 kB
          Chance
        3. image-2024-11-08-16-50-38-706.png
          16 kB
          Chance
        4. image-2024-11-08-16-52-24-578.png
          12 kB
          Chance

        Activity

          People

            Unassigned Unassigned
            chance1929 Chance
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: