Uploaded image for project: 'ORC'
  1. ORC
  2. ORC-54

Evolve schemas based on field name rather than index

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.2.0
    • None
    • None

    Description

      Schema evolution as it stands today allows adding fields to the end of schemas or removing them from the end. However, because it is based on the index of the column, you can only ever add or remove – not both.

      ORC files have the full schema information of their contents, so there's actually enough metadata to support changing columns anywhere in the schema.

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-13974 ORC Schema Evolution doesn't support add columns to non-last STRUCT columns

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HIVE-4243 Fix column names in FileSinkOperator

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #40

          Web Link GitHub Pull Request #55

          Activity

            People

              mwagner Mark Wagner
              mwagner Mark Wagner
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: