Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-12350

MVCC activated and causing memory leak (OOM) despite no mvccEnabled caches

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.7.5
    • 2.9
    • mvcc
    • None
    • Docs Required, Release Notes Required

    Description

      We have a critical memory leak where mvccCoordinator is still selected and mvcc is still 'activated' despite having no mvccEnabled caches, this is causing constant OOM crashes and issues on both server and client nodes.

      All client CacheAtomicityModes are of type ATOMIC, and for server config persistence is false, TCPDiscoverySpi used and PeerClassLoadingEnabled=true.

      There are two server JVM instances on two separate nodes. One of the servers consistently get an OOM error, as well as all clients, due to the same recoveryBallotBoxes HashMap constantly increasing in size and unable to be Garbage Collected.

      Attached is Eclipse Memory Analyzer Tool screenshot on the heap dump close to one of the server JVM OOM crashes. The same heap analysis result is apparent for all clients as well.

      Attachments

        1. MATheap.jpg
          118 kB
          Ming Vuong
        2. proxy-memory-leak.png
          282 kB
          Jurijs Grabovskis
        3. proxy-oom-2.png
          145 kB
          Jurijs Grabovskis

        Issue Links

          Activity

            People

              v.pyatkov Vladislav Pyatkov
              mingvuong Ming Vuong
              Igor Seliverstov Igor Seliverstov
              Votes:
              2 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m