Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-913 Umbrella: Add a way to register long-lived services in a YARN cluster
  3. YARN-2571

RM to support YARN registry

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 2.7.3
    • Fix Version/s: None
    • Component/s: resourcemanager
    • Labels:
    • Target Version/s:

      Description

      The RM needs to (optionally) integrate with the YARN registry:

      1. startup: create the /services and /users paths with system ACLs (yarn, hdfs principals)
      2. app-launch: create the user directory /users/$username with the relevant permissions (CRD) for them to create subnodes.
      3. attempt, container, app completion: remove service records with the matching persistence and ID

        Attachments

        1. YARN-2571-001.patch
          49 kB
          Steve Loughran
        2. YARN-2571-002.patch
          40 kB
          Steve Loughran
        3. YARN-2571-003.patch
          43 kB
          Steve Loughran
        4. YARN-2571-005.patch
          48 kB
          Steve Loughran
        5. YARN-2571-007.patch
          48 kB
          Steve Loughran
        6. YARN-2571-008.patch
          48 kB
          Steve Loughran
        7. YARN-2571-009.patch
          53 kB
          Steve Loughran
        8. YARN-2571-010.patch
          52 kB
          Steve Loughran
        9. YARN-2571-012.patch
          52 kB
          Steve Loughran
        10. YARN-2571-013.patch
          136 kB
          Steve Loughran
        11. YARN-2571-015.patch
          176 kB
          Steve Loughran
        12. YARN-2571-016.patch
          202 kB
          Steve Loughran
        13. YARN-2571-017.patch
          201 kB
          Steve Loughran

          Issue Links

          causes

          Sub-task - The sub-task of the issue YARN-6136 YARN registry service should avoid scanning whole ZK tree for every container/application finish

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          depends upon

          Sub-task - The sub-task of the issue YARN-2652 add hadoop-yarn-registry package under hadoop-yarn

          • Major - Major loss of function.
          • Closed
          is depended upon by

          Sub-task - The sub-task of the issue SLIDER-552 remove root registry path setup in AM

          • Critical - Crashes, loss of data, severe memory leak.
          • Open

          Sub-task - The sub-task of the issue YARN-2646 distributed shell & tests to use registry

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. SLIDER-149 Support a YARN service registry

          • Major - Major loss of function.
          • Resolved
          is duplicated by

          Sub-task - The sub-task of the issue YARN-6903 Yarn-native-service framework core rewrite

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. YARN-8845 hadoop.registry.rm.enabled is not used

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #66

            Activity

              People

              • Assignee:
                stevel@apache.org Steve Loughran
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                19 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: