Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-5704

Col drop config is not honored when schema validation is disabled

    XMLWordPrintableJSON

Details

    Description

      https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_apis/build/builds/14920/logs/38

       

      looks like col drop flag is tightly coupled w/ schema validation flag. only if schema validation is enabled, col drop flag is honored. if not, it may succeed. 

       

      for eg, 

      if table schema is col1, col2, col3

      and new incoming schema is col1, col2

      col drop config is set to false (which means col drop should not be supported), and schema validation is set to false, commit will succeed. Expectation is, commit should fail for this new batch. 

       

       

       

      Attachments

        Activity

          People

            shivnarayan sivabalan narayanan
            shivnarayan sivabalan narayanan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: