Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-6955

Fail the delta streamer pipeline on re-ordering of columns

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • None
    • None
    • deltastreamer
    • None

    Description

      Re-ordering of columns are not supported in delta streamer code path. We need to detect and fail the pipeline processing. Currently it will continue ingestion and fail during read side. We should be proactive and fail during ingestion.

      Parent PR related to this issue -  https://github.com/apache/hudi/pull/9743

      Attachments

        Issue Links

          is a child of

          Improvement - An improvement or enhancement to an existing feature or task. HUDI-6872 Simplify Out Of Box Schema Evolution Functionality

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              linlok Lokesh Lingarajan
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: