Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-16052 OOM in Kafka test suite
  3. KAFKA-16063

Fix leaked ApplicationShutdownHooks in EndToEndAuthorizationTests

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.8.0
    • None
    • None

    Description

      All test extending `EndToEndAuthorizationTest` are leaking DefaultDirectoryService objects.

      This can be observed using the heap dump at https://www.dropbox.com/scl/fi/4jaq8rowkmijaoj7ec1nm/GradleWorkerMain_10311_27_12_2023_13_37_08_Leak_Suspects.zip?rlkey=minkbvopb0c65m5wryqw234xb&dl=0 (unzip this and you will find a hprof which can be opened with your favourite heap analyzer)

      The stack trace looks like this:

       

      I suspect that the reason is because DefaultDirectoryService#startup() registers a shutdownhook which is somehow messed up by QuorumTestHarness#teardown().

      We need to investigate why this is leaking and fix it.

      Attachments

        1. Screenshot 2024-01-01 at 10.51.03 PM-1.png
          394 kB
          Arpit Goyal
        2. Screenshot 2024-01-01 at 10.51.03 PM.png
          394 kB
          Arpit Goyal
        3. Screenshot 2023-12-31 at 7.19.25 AM.png
          442 kB
          Arpit Goyal
        4. Screenshot 2023-12-29 at 12.38.29.png
          107 kB
          Divij Vaidya

        Issue Links

          links to

          Web Link GitHub Pull Request #15104

          Activity

            People

              goyarpit Arpit Goyal
              divijvaidya Divij Vaidya
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: