Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7601

Incorrect container states recovered as LevelDB uses alphabetical order

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      LevelDB stores key-value pairs in the alphabetical order. Container id concatenated by its state is used as key. So, even if container goes through any states in its life cycle, the order of states for following values retrieved from LevelDB is always going to be as below`:

      LAUNCHED
      PAUSED
      QUEUED

      For eg: If a container is LAUNCHED then PAUSED and LAUNCHED again, the recovered container state is PAUSED currently instead of LAUNCHED.
      We propose to store the timestamp as the value while making call to

      storeContainerLaunched
      storeContainerPaused
      storeContainerQueued

      so that correct container state is recovered based on timestamps.

      Attachments

        1. YARN-7601.001.patch
          9 kB
          Sampada Dehankar
        2. YARN-7601.002.patch
          9 kB
          Sampada Dehankar

        Activity

          People

            sampada15 Sampada Dehankar
            sampada15 Sampada Dehankar
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: