Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14741

Refactor curator based ZooKeeper communication into common library

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-beta1
    • None
    • None
    • Reviewed

    Description

      Currently we have ZooKeeper based store implementations for multiple state stores like RM, YARN Federation, HDFS router-based federation, RM queue configs etc. This jira proposes to unify the curator based ZK communication to eliminate redundancies.

      Attachments

        1. HADOOP-14741-000.patch
          28 kB
          Íñigo Goiri
        2. HADOOP-14741-001.patch
          33 kB
          Íñigo Goiri
        3. HADOOP-14741-002.patch
          35 kB
          Íñigo Goiri
        4. HADOOP-14741-003.patch
          36 kB
          Íñigo Goiri
        5. HADOOP-14741-004.patch
          43 kB
          Íñigo Goiri
        6. HADOOP-14741-005.patch
          43 kB
          Íñigo Goiri
        7. HADOOP-14741-branch-2.patch
          43 kB
          Íñigo Goiri
        8. HADOOP-14741-branch-2-001.patch
          43 kB
          Íñigo Goiri
        9. HADOOP-14741-branch-2-002.patch
          43 kB
          Íñigo Goiri

        Issue Links

        breaks

        Bug - A problem which impairs or prevents the functions of the product. TEZ-3874 NPE in TezClientUtils when "yarn.resourcemanager.zk-address" is present in Configuration

        • Blocker - Blocks development and/or testing work, production could not run
        • Closed
        is depended upon by

        Sub-task - The sub-task of the issue HDFS-10631 Federation State Store ZooKeeper implementation

        • Major - Major loss of function.
        • Resolved

        Sub-task - The sub-task of the issue YARN-6840 Implement zookeeper based store for scheduler configuration updates

        • Major - Major loss of function.
        • Resolved

        Sub-task - The sub-task of the issue YARN-6900 ZooKeeper based implementation of the FederationStateStore

        • Major - Major loss of function.
        • Resolved
        is related to

        Bug - A problem which impairs or prevents the functions of the product. HADOOP-15093 Deprecation of yarn.resourcemanager.zk-address is undocumented

        • Major - Major loss of function.
        • Resolved
        relates to

        Bug - A problem which impairs or prevents the functions of the product. HADOOP-14773 Extend ZKCuratorManager API for more reusability

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. YARN-8405 RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-13533 RBF: Configuration for RBF in namenode/datanode

        • Major - Major loss of function.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. YARN-7053 Move curator transaction support to ZKCuratorManager

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. YARN-8568 Replace the deprecated zk-address property in the HA config example in ResourceManagerHA.md

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. YARN-10246 Enable YARN Router to have a dedicated Zookeeper

        • Major - Major loss of function.
        • Patch Available

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            elgoiri Íñigo Goiri
            subru Subramaniam Krishnan
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment