Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5547

NMLeveldbStateStore should be more tolerant of unknown keys

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.6.0
    • Fix Version/s: 2.9.0, 3.0.0-alpha4, 2.8.2
    • Component/s: nodemanager
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Whenever new keys are added to the NM state store it will break rolling downgrades because the code will throw if it encounters an unrecognized key. If instead it skipped unrecognized keys it could be simpler to continue supporting rolling downgrades. We need to define the semantics of unrecognized keys when containers and apps are cleaned up, e.g.: we may want to delete all keys underneath an app or container directory when it is being removed from the state store to prevent leaking unrecognized keys.

        Attachments

        1. YARN-5547-branch-2.8.2.001.patch
          11 kB
          Vrushali C
        2. YARN-5547.05.branch-2.patch
          11 kB
          Ajith S
        3. YARN-5547.05.patch
          11 kB
          Ajith S
        4. YARN-5547.04.patch
          11 kB
          Ajith S
        5. YARN-5547.03.patch
          10 kB
          Ajith S
        6. YARN-5547.02.patch
          10 kB
          Ajith S
        7. YARN-5547.01.patch
          5 kB
          Ajith S

        Issue Links

          Activity

            People

            • Assignee:
              ajithshetty Ajith S
              Reporter:
              jlowe Jason Darrell Lowe

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment