Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13974

ORC Schema Evolution doesn't support add columns to non-last STRUCT columns

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Duplicate
    • 1.3.0, 2.1.0, 2.2.0
    • None
    • Hive, ORC, Transactions
    • None

    Description

      Currently, the included columns are based on the fileSchema and not the readerSchema which doesn't work for adding columns to non-last STRUCT data type columns.

      Attachments

        1. HIVE-13974.01.patch
          203 kB
          Matt McCline
        2. HIVE-13974.02.patch
          208 kB
          Matt McCline
        3. HIVE-13974.03.patch
          208 kB
          Matt McCline
        4. HIVE-13974.04.patch
          208 kB
          Matt McCline
        5. HIVE-13974.05.WIP.patch
          211 kB
          Matt McCline
        6. HIVE-13974.06.patch
          51 kB
          Matt McCline
        7. HIVE-13974.07.patch
          51 kB
          Matt McCline
        8. HIVE-13974.08.patch
          53 kB
          Matt McCline
        9. HIVE-13974.09.patch
          57 kB
          Matt McCline
        10. HIVE-13974.091.patch
          219 kB
          Matt McCline
        11. HIVE-13974.092.patch
          189 kB
          Matt McCline
        12. HIVE-13974.093.patch
          191 kB
          Matt McCline
        13. HIVE-13974.094.patch
          187 kB
          Matt McCline
        14. HIVE-13974.095.patch
          187 kB
          Matt McCline
        15. HIVE-13974.096.patch
          1.06 MB
          Matt McCline
        16. HIVE-13974.097.patch
          1.79 MB
          Matt McCline
        17. HIVE-13974.098.patch
          1.63 MB
          Matt McCline

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. ORC-54 Evolve schemas based on field name rather than index

          • Major - Major loss of function.
          • Closed
          links to

          Web Link RB #48443

          Activity

            People

              mmccline Matt McCline
              mmccline Matt McCline
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: