Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-23553

Upgrade ORC version to 1.6.7

    XMLWordPrintableJSON

Details

    Description

       Apache Hive is currently on 1.5.X version and in order to take advantage of the latest ORC improvements such as column encryption we have to bump to 1.6.X.

      https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12343288&styleName=&projectId=12318320&Create=Create&atl_token=A5KQ-2QAV-T4JA-FDED_4ae78f19321c7fb1e7f337fba1dd90af751d8810_lin

      Even though ORC reader could work out of the box, HIVE LLAP is heavily depending on internal ORC APIs e.g., to retrieve and store File Footers, Tails, streams – un/compress RG data etc. As there ware many internal changes from 1.5 to 1.6 (Input stream offsets, relative BufferChunks etc.) the upgrade is not straightforward.

      This Umbrella Jira tracks this upgrade effort.

      Attachments

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-22731 MJ probe decode with row-level filtering

          • Major - Major loss of function.
          • Patch Available
          causes

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-24721 Align CacheWriter bufferSize with Llap max alloc

          • Major - Major loss of function.
          • Open
          is duplicated by

          New Feature - A new feature of the product, which has yet to be developed. HIVE-24536 Upgrade ORC to 1.6.6

          • Major - Major loss of function.
          • Resolved
          is fixed by

          Bug - A problem which impairs or prevents the functions of the product. HIVE-28202 Incorrect projected column size after ORC upgrade to v1.6.7

          • Critical - Crashes, loss of data, severe memory leak.
          • Patch Available
          relates to

          New Feature - A new feature of the product, which has yet to be developed. HIVE-24735 Implement TIMESTAMP WITH LOCAL TIME ZONE integration with ORC

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-24631 Move to ChronoLocalDate and day of epoch instead of java's sql Date

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-24703 LLAP move RowGroup reading to StrippePlanner

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Open
          links to

          Web Link GitHub Pull Request #1823

          There are no Sub-Tasks for this issue.

          Activity

            People

              pgaref Panagiotis Garefalakis
              pgaref Panagiotis Garefalakis
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 13h
                  13h