Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-8484

HashJoinPOP memory leak is caused by an oom exception when read data from Stream with container

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.21.1
    • 1.21.2
    • Server
    • None

    Description

      Describe the bug
      An oom exception occurred When read data from Stream with container ,resulting in hashJoinPOP memory leak 

      To Reproduce
      prepare data for tpch 1s

      1. 30 concurrent for tpch sql8
      2. set direct memory 5g
      3. when it had OutOfMemoryException , stopped all sql.
      4. finding memory leak

      leak  info 

         Allocator(frag:5:0) 5000000/1000000/31067136/40041943040 (res/actual/peak/limit)
            child allocators: 1
              Allocator(op:5:0:1:HashJoinPOP) 1000000/16384/22822912/41943040 (res/actual/peak/limit)
                child allocators: 0
                ledgers: 2
                  ledger[1882757] allocator: op:5:0:1:HashJoinPOP), isOwning: true, size: 8192, references: 2, life: 16936270178816167..0, allocatorManager: [1703465, life: 16936270178813617..0] holds 4 buffers.
                      DrillBuf[2041995], udle: [1703441 0..957]
       

      Attachments

        Activity

          People

            Unassigned Unassigned
            shihuafeng shihuafeng
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: