Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7926 long-lived daemons for query fragment execution, I/O and caching
  3. HIVE-9420

LLAP: separate decoding thread from read/uncompress thread

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • llap
    • None

    Description

      Right now reader is a callable that is dumped into threadpool, and all the data loading for one request happens on one thread (in parallel with operator pipeline).
      We might want to separate reading from HDFS/decompressing data, from decoding data and low-level row-level SARGs (that, and high level cache which is AWOL now, were the reasons for encoded data production separation from final VRB production)

      Attachments

        1. HIVE-9420.WIP.patch
          14 kB
          Sergey Shelukhin

        Activity

          People

            sershe Sergey Shelukhin
            sershe Sergey Shelukhin
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: