Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7292 Hive on Spark
  3. HIVE-10052

HiveInputFormat implementations getsplits may lead to memory leak.[Spark Branch]

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Spark
    • None

    Description

      HiveInputFormat::init would cache MapWork/ReduceWork in ThreadLocal map, we need to clear the cache after getSplits from HiveInputFormat(or its implementations), or just not cache MapWork/ReduceWork during generation.

      Attachments

        Issue Links

          relates to

          Sub-task - The sub-task of the issue HIVE-10006 RSC has memory leak while execute multi queries.[Spark Branch]

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              Unassigned Unassigned
              chengxiang li Chengxiang Li
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: