Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-22753

Fix gradual mem leak: Operationlog related appenders should be cleared up on errors

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.0.0
    • Component/s: HiveServer2
    • Labels:
      None

      Description

      In case of exception in SQLOperation, operational log does not get cleared up. This causes gradual build up of HushableRandomAccessFileAppender causing HS2 to OOM after some time.

       

      Allocation tree

       

      Prod instance mem

       

      Each HushableRandomAccessFileAppender holds internal ref to RandomAccessFileAppender which holds a 256 KB bytebuffer, causing the mem leak.

      Related ticket: HIVE-18820

        Attachments

        1. HIVE-22753.4.patch
          3 kB
          Rajesh Balamohan
        2. HIVE-22753.3.patch
          3 kB
          Rajesh Balamohan
        3. HIVE-22753.2.patch
          3 kB
          Rajesh Balamohan
        4. HIVE-22753.1.patch
          0.7 kB
          Rajesh Balamohan
        5. image-2020-01-21-11-18-37-294.png
          600 kB
          Rajesh Balamohan
        6. image-2020-01-21-11-17-59-279.png
          396 kB
          Rajesh Balamohan
        7. image-2020-01-21-11-14-37-911.png
          776 kB
          Rajesh Balamohan

          Issue Links

            Activity

              People

              • Assignee:
                rajesh.balamohan Rajesh Balamohan
                Reporter:
                rajesh.balamohan Rajesh Balamohan
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: