Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-15664

LLAP text cache: improve first query perf I

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.2.0
    • None

    Description

      1) Don't use ORC dictionary.
      2) Use VectorDeserialize.
      3) Don't parse the columns that are not included (cannot avoid reading them).
      4) Send VRB to the pipeline and write ORC in parallel (in background). HIVE-15672

      Also add an option to disable the encoding pipeline server-side.

      Attachments

        1. HIVE-15664.patch
          51 kB
          Sergey Shelukhin
        2. HIVE-15664.04.patch
          50 kB
          Sergey Shelukhin

        Issue Links

          is cloned by

          Bug - A problem which impairs or prevents the functions of the product. HIVE-15672 LLAP text cache: improve first query perf II

          • Major - Major loss of function.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-21123 LLAP text cache : same sql and TPCDS data occurs different results using textfile fileformat

          • Major - Major loss of function.
          • Open
          links to

          Web Link RB

          Activity

            People

              sershe Sergey Shelukhin
              sershe Sergey Shelukhin
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: