Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13178

Enhance ORC Schema Evolution to handle more standard data type conversions

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.1.0
    • Component/s: Hive, ORC
    • Labels:
      None

      Description

      Currently, SHORT -> INT -> BIGINT is supported.

      Handle ORC data type conversions permitted by Implicit conversion allowed by TypeIntoUtils.implicitConvertible method.

      • STRING_GROUP -> DOUBLE
      • STRING_GROUP -> DECIMAL
      • DATE_GROUP -> STRING
      • NUMERIC_GROUP -> STRING
      • STRING_GROUP -> STRING_GROUP
        *
      • // Upward from "lower" type to "higher" numeric type:
      • BYTE -> SHORT -> INT -> BIGINT -> FLOAT -> DOUBLE -> DECIMAL

        Attachments

        1. HIVE-13178.01.patch
          2.63 MB
          Matt McCline
        2. HIVE-13178.02.patch
          10.66 MB
          Matt McCline
        3. HIVE-13178.03.patch
          14.44 MB
          Matt McCline
        4. HIVE-13178.04.patch
          14.44 MB
          Matt McCline
        5. HIVE-13178.05.patch
          11.81 MB
          Matt McCline
        6. HIVE-13178.06.patch
          11.81 MB
          Matt McCline
        7. HIVE-13178.07.patch
          11.44 MB
          Matt McCline
        8. HIVE-13178.08.patch
          11.19 MB
          Matt McCline
        9. HIVE-13178.09.patch
          11.29 MB
          Matt McCline
        10. HIVE-13178.091.patch
          11.11 MB
          Matt McCline
        11. HIVE-13178.092.patch
          9.70 MB
          Matt McCline
        12. HIVE-13178.093.patch
          9.70 MB
          Matt McCline
        13. HIVE-13178.094.patch
          7.64 MB
          Matt McCline

          Issue Links

            Activity

              People

              • Assignee:
                mmccline Matt McCline
                Reporter:
                mmccline Matt McCline
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: