Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-18992

CDC: Use single partition topic for metadata updates

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • extensions

    Description

      In order to read data with guaranteed order, metadata topic must have only one partition. To achieve this we should:

      • Write binary types and marshaller mappings only to a single partition in IgniteToKafkaCdcStreamer#onMappings and #onTypes.
      • Print warnings into logs, when topic has more than one partition.

      Attachments

        Issue Links

          is fixed by

          Bug - A problem which impairs or prevents the functions of the product. IGNITE-19369 Metadata topic offset must be stored only after commit

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. IGNITE-18209 Reduce binary metadata synchronization time for CDC through Kafka

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Task - A task that needs to be done. IGNITE-18515 CDC: add documentation about metadata replication

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              shishkovilja Ilya Shishkov
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: