Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: timelineserver
    • Labels:
      None

      Description

      It is observed that in production cluster, though app-cache-size is set to minimal i.e less than 5, ATS server is going down with OOM. The entity-group-fs-store.cache-store-class is configured with MemoryTimelineStore which is by default. The heap size configured for ATS daemon is 8GB.

      This is because ATS parse the entity log file per domain and caches it. If the domain has lot of entity information, then in memory cache store loads all the entity information which is causing OOM. After restart, again it caches same domain and goes OOM.

      There are possible way handle it are

      1. threshold the number of entities loaded into in memory cache. This still can lead to OOM if data size is huge.
      2. Based on the data size in the store.

      We faced 1st issue where number of entities are very huge.

        Attachments

        1. Screen Shot - suspect-1.png
          474 kB
          Rohith Sharma K S
        2. Screen Shot - suspect-2.png
          460 kB
          Rohith Sharma K S

          Issue Links

            Activity

              People

              • Assignee:
                rohithsharma Rohith Sharma K S
                Reporter:
                rohithsharma Rohith Sharma K S
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: