Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14741

Refactor curator based ZooKeeper communication into common library

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-beta1
    • None
    • None
    • Reviewed

    Description

      Currently we have ZooKeeper based store implementations for multiple state stores like RM, YARN Federation, HDFS router-based federation, RM queue configs etc. This jira proposes to unify the curator based ZK communication to eliminate redundancies.

      Attachments

        1. HADOOP-14741-000.patch
          28 kB
          Íñigo Goiri
        2. HADOOP-14741-001.patch
          33 kB
          Íñigo Goiri
        3. HADOOP-14741-002.patch
          35 kB
          Íñigo Goiri
        4. HADOOP-14741-003.patch
          36 kB
          Íñigo Goiri
        5. HADOOP-14741-004.patch
          43 kB
          Íñigo Goiri
        6. HADOOP-14741-005.patch
          43 kB
          Íñigo Goiri
        7. HADOOP-14741-branch-2.patch
          43 kB
          Íñigo Goiri
        8. HADOOP-14741-branch-2-001.patch
          43 kB
          Íñigo Goiri
        9. HADOOP-14741-branch-2-002.patch
          43 kB
          Íñigo Goiri

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. TEZ-3874 NPE in TezClientUtils when "yarn.resourcemanager.zk-address" is present in Configuration

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          is depended upon by

          Sub-task - The sub-task of the issue HDFS-10631 Federation State Store ZooKeeper implementation

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-6840 Implement zookeeper based store for scheduler configuration updates

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-6900 ZooKeeper based implementation of the FederationStateStore

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-15093 Deprecation of yarn.resourcemanager.zk-address is undocumented

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-14773 Extend ZKCuratorManager API for more reusability

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. YARN-8405 RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-13533 RBF: Configuration for RBF in namenode/datanode

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. YARN-7053 Move curator transaction support to ZKCuratorManager

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. YARN-8568 Replace the deprecated zk-address property in the HA config example in ResourceManagerHA.md

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. YARN-10246 Enable YARN Router to have a dedicated Zookeeper

          • Major - Major loss of function.
          • Patch Available

          Activity

            People

              elgoiri Íñigo Goiri
              subru Subramaniam Krishnan
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: