Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-2847

DrillBufs from the RPC layer are being leaked

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      I've created a patch that demonstrates this. In the patch, code is added to UnsafeDirectLittleEndian to track all the instances of that class that are created (which happens when buffers are allocated inside TopLevelAllocator). release() is overridden to remove these from the tracked list when they are released. An @After action is added to TestTpchDistributed which checks on the count of outstanding buffers. If the test is run, every case fails, and each failure shows a progressively larger and larger number of outstanding buffers. There are no complaints from the allocator.

      Attachments

        1. DRILL-2847-bug.2.patch.txt
          5 kB
          Chris Westin
        2. DRILL-2847-bug.patch.txt
          4 kB
          Chris Westin
        3. drill-mem.log
          6.84 MB
          Chris Westin

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jnadeau Jacques Nadeau
            cwestin Chris Westin
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment