Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12728

Apply DDL restrictions for ORC schema evolution

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 2.0.0, 2.1.0
    • 2.0.0
    • None
    • None

    Description

      HIVE-11981 added schema evolution for ORC. However, it does not enforce any restrictions in DDL that can break schema evolution. Following changes have to be enforced in DDL to support the assumptions in schema evolution (that columns will only be added).

      1) Restrict changing the file format of the table
      2) Restrict changing the serde of the table
      3) Restrict replacing columns to not drop columns or do unsupported type widening
      4) Restrict reordering columns
      5) Restrict unsupported type promotions

      Attachments

        1. HIVE-12728.1.patch
          19 kB
          Prasanth Jayachandran
        2. HIVE-12728.2.patch
          36 kB
          Prasanth Jayachandran
        3. HIVE-12728.3.patch
          81 kB
          Prasanth Jayachandran

        Issue Links

          Activity

            People

              prasanth_j Prasanth Jayachandran
              prasanth_j Prasanth Jayachandran
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: