Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14453

refactor physical writing of ORC data and metadata to FS from the logical writers

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.2.0
    • None
    • None

    Description

      ORC data doesn't have to go directly into an HDFS stream via buffers, it can go somewhere else (e.g. a write-thru cache, or an addressable system that doesn't require the stream blocks to be held in memory before writing them all together).
      To that effect, it would be nice to abstract the data block/metadata structure creating from the physical file concerns.

      Attachments

        1. HIVE-14453.01.patch
          64 kB
          Sergey Shelukhin
        2. HIVE-14453.02.patch
          64 kB
          Sergey Shelukhin
        3. HIVE-14453.03.patch
          65 kB
          Sergey Shelukhin
        4. HIVE-14453.patch
          60 kB
          Sergey Shelukhin

        Issue Links

          blocks

          New Feature - A new feature of the product, which has yet to be developed. HIVE-15147 LLAP: use LLAP cache for non-columnar formats in a somewhat general way

          • Major - Major loss of function.
          • Closed
          relates to

          New Feature - A new feature of the product, which has yet to be developed. HIVE-15147 LLAP: use LLAP cache for non-columnar formats in a somewhat general way

          • Major - Major loss of function.
          • Closed
          links to

          Web Link RB

          Activity

            People

              sershe Sergey Shelukhin
              sershe Sergey Shelukhin
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: