Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13176 OutOfMemoryError : GC overhead limit exceeded
  3. HIVE-14428

HadoopMetrics2Reporter leaks memory if the metrics sink is not configured correctly

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • None
    • 2.1.1, 2.2.0
    • HiveServer2
    • None

    Description

      About 80MB held after 7 hours of running. Metrics2Collector aggregates only when it's invoked by the Hadoop sink.

      Options - the first one is better IMO.
      1. Fix Metrics2Collector to aggregate more often, and fix the dependency in Hive accordingly
      2. Don't setup the metrics sub-system if a sink is not configured.

      Attachments

        1. HIVE-14428.1.patch
          0.6 kB
          Thejas Nair

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. HIVE-14456 HS2 memory leak if hadoop2 metrics sink is not configured properly

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              thejas Thejas Nair
              sseth Siddharth Seth
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: