Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7231

Improve ORC padding

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.14.0
    • 0.14.0
    • File Formats
    • Reviewed
    • HIVE-7231 : Improve ORC padding (Prasanth J, reviewed by Gopal V)

    Description

      Current ORC padding is not optimal because of fixed stripe sizes within block. The padding overhead will be significant in some cases. Also padding percentage relative to stripe size is not configurable.

      Attachments

        1. HIVE-7231.1.patch
          7 kB
          Prasanth Jayachandran
        2. HIVE-7231.2.patch
          12 kB
          Prasanth Jayachandran
        3. HIVE-7231.3.patch
          16 kB
          Prasanth Jayachandran
        4. HIVE-7231.4.patch
          16 kB
          Gopal Vijayaraghavan
        5. HIVE-7231.5.patch
          17 kB
          Gopal Vijayaraghavan
        6. HIVE-7231.6.patch
          16 kB
          Gopal Vijayaraghavan
        7. HIVE-7231.7.patch
          16 kB
          Gopal Vijayaraghavan
        8. HIVE-7231.8.patch
          16 kB
          Gopal Vijayaraghavan

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-7243 Print padding information in ORC file dump

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-7490 Revert ORC stripe size

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-5425 Provide a configuration option to control the default stripe size for ORC

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-7243 Print padding information in ORC file dump

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          links to

          Web Link Review Board

          Activity

            People

              prasanth_j Prasanth Jayachandran
              prasanth_j Prasanth Jayachandran
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: