Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6531

Check appStateData size before saving to Zookeeper

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      Application with large size Application submission context could cause store to Zookeeper failure due to znode size limit. Zookeeper znode limit exception thrown org.apache.zookeeper.KeeperException$ConnectionLossException. ZkStateStore will retry for configured times and will throw ConnectionLossException after configured limit.
      Which could cause Resource manager to switch from active To StandBy and other application submitted not getting save to ZK.
      Solution ApplicationStateData size to be validated before saving and reject application so that ResourceManager is not impacted.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            bibinchundatt Bibin Chundatt
            bibinchundatt Bibin Chundatt
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment