Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12728

Apply DDL restrictions for ORC schema evolution

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 2.0.0, 2.1.0
    • 2.0.0
    • None
    • None

    Description

      HIVE-11981 added schema evolution for ORC. However, it does not enforce any restrictions in DDL that can break schema evolution. Following changes have to be enforced in DDL to support the assumptions in schema evolution (that columns will only be added).

      1) Restrict changing the file format of the table
      2) Restrict changing the serde of the table
      3) Restrict replacing columns to not drop columns or do unsupported type widening
      4) Restrict reordering columns
      5) Restrict unsupported type promotions

      Attachments

        1. HIVE-12728.1.patch
          19 kB
          Prasanth Jayachandran
        2. HIVE-12728.2.patch
          36 kB
          Prasanth Jayachandran
        3. HIVE-12728.3.patch
          81 kB
          Prasanth Jayachandran

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            prasanth_j Prasanth Jayachandran Assign to me
            prasanth_j Prasanth Jayachandran
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment