Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12220

LLAP: Usability issues with hive.llap.io.cache.orc.size

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • llap
    • None

    Description

      In the llap-daemon site you need to set, among other things,

      llap.daemon.memory.per.instance.mb
      and
      hive.llap.io.cache.orc.size

      The use of hive.llap.io.cache.orc.size caused me some unnecessary problems, initially I entered the value in MB rather than in bytes. Operator error you could say but I look at this as a fraction of the other value which is in mb.

      Second, is this really tied to ORC? E.g. when we have the vectorized text reader will this data be cached as well? Or might it be in the future?

      I would like to propose instead using hive.llap.io.cache.size.mb for this setting.

      Attachments

        1. HIVE-12220.03.patch
          28 kB
          Sergey Shelukhin
        2. HIVE-12220.02.patch
          28 kB
          Sergey Shelukhin
        3. HIVE-12220.tmp.patch
          23 kB
          Sergey Shelukhin
        4. HIVE-12220.01.patch
          25 kB
          Sergey Shelukhin
        5. HIVE-12220.patch
          25 kB
          Sergey Shelukhin

        Issue Links

          Activity

            People

              sershe Sergey Shelukhin
              cartershanklin Carter Shanklin
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: