Uploaded image for project: 'ORC'
  1. ORC
  2. ORC-54

Evolve schemas based on field name rather than index

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.2.0
    • Component/s: None
    • Labels:
      None

      Description

      Schema evolution as it stands today allows adding fields to the end of schemas or removing them from the end. However, because it is based on the index of the column, you can only ever add or remove – not both.

      ORC files have the full schema information of their contents, so there's actually enough metadata to support changing columns anywhere in the schema.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                mwagner Mark Wagner
                Reporter:
                mwagner Mark Wagner
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: