Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-11595

refactor ORC footer reading to make it usable from outside

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • None
    • None

    Description

      If ORC footer is read from cache, we want to parse it without having the reader, opening a file, etc. I thought it would be as simple as protobuf parseFrom bytes, but apparently there's bunch of stuff going on there. It needs to be accessible via something like parseFrom(ByteBuffer), or similar.

      Attachments

        1. HIVE-11595.04.patch
          19 kB
          Sergey Shelukhin
        2. HIVE-11595.03.patch
          18 kB
          Sergey Shelukhin
        3. HIVE-11595.02.patch
          16 kB
          Sergey Shelukhin
        4. HIVE-11595.01.patch
          16 kB
          Sergey Shelukhin
        5. HIVE-10595.patch
          13 kB
          Sergey Shelukhin

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. HIVE-11553 use basic file metadata cache in ETLSplitStrategy-related paths

          • Major - Major loss of function.
          • Closed
          is part of

          Sub-task - The sub-task of the issue HIVE-11500 implement file footer / splits cache in HBase metastore

          • Major - Major loss of function.
          • Open

          Activity

            People

              sershe Sergey Shelukhin
              sershe Sergey Shelukhin
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: