Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13974

ORC Schema Evolution doesn't support add columns to non-last STRUCT columns

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Duplicate
    • 1.3.0, 2.1.0, 2.2.0
    • None
    • Hive, ORC, Transactions
    • None

    Description

      Currently, the included columns are based on the fileSchema and not the readerSchema which doesn't work for adding columns to non-last STRUCT data type columns.

      Attachments

        1. HIVE-13974.098.patch
          1.63 MB
          Matt McCline
        2. HIVE-13974.097.patch
          1.79 MB
          Matt McCline
        3. HIVE-13974.096.patch
          1.06 MB
          Matt McCline
        4. HIVE-13974.095.patch
          187 kB
          Matt McCline
        5. HIVE-13974.094.patch
          187 kB
          Matt McCline
        6. HIVE-13974.093.patch
          191 kB
          Matt McCline
        7. HIVE-13974.092.patch
          189 kB
          Matt McCline
        8. HIVE-13974.091.patch
          219 kB
          Matt McCline
        9. HIVE-13974.09.patch
          57 kB
          Matt McCline
        10. HIVE-13974.08.patch
          53 kB
          Matt McCline
        11. HIVE-13974.07.patch
          51 kB
          Matt McCline
        12. HIVE-13974.06.patch
          51 kB
          Matt McCline
        13. HIVE-13974.05.WIP.patch
          211 kB
          Matt McCline
        14. HIVE-13974.04.patch
          208 kB
          Matt McCline
        15. HIVE-13974.03.patch
          208 kB
          Matt McCline
        16. HIVE-13974.02.patch
          208 kB
          Matt McCline
        17. HIVE-13974.01.patch
          203 kB
          Matt McCline

        Issue Links

        relates to

        Improvement - An improvement or enhancement to an existing feature or task. ORC-54 Evolve schemas based on field name rather than index

        • Major - Major loss of function.
        • Closed
        links to

        Web Link RB #48443

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            mmccline Matt McCline Assign to me
            mmccline Matt McCline
            Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment