Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-913 Umbrella: Add a way to register long-lived services in a YARN cluster
  3. YARN-2571

RM to support YARN registry

          Details

          • Type: Sub-task
          • Status: Resolved
          • Priority: Major
          • Resolution: Won't Fix
          • Affects Version/s: 2.7.3
          • Fix Version/s: None
          • Component/s: resourcemanager
          • Labels:
          • Target Version/s:

            Description

            The RM needs to (optionally) integrate with the YARN registry:

            1. startup: create the /services and /users paths with system ACLs (yarn, hdfs principals)
            2. app-launch: create the user directory /users/$username with the relevant permissions (CRD) for them to create subnodes.
            3. attempt, container, app completion: remove service records with the matching persistence and ID

              Attachments

              1. YARN-2571-001.patch
                49 kB
                Steve Loughran
              2. YARN-2571-002.patch
                40 kB
                Steve Loughran
              3. YARN-2571-003.patch
                43 kB
                Steve Loughran
              4. YARN-2571-005.patch
                48 kB
                Steve Loughran
              5. YARN-2571-007.patch
                48 kB
                Steve Loughran
              6. YARN-2571-008.patch
                48 kB
                Steve Loughran
              7. YARN-2571-009.patch
                53 kB
                Steve Loughran
              8. YARN-2571-010.patch
                52 kB
                Steve Loughran
              9. YARN-2571-012.patch
                52 kB
                Steve Loughran
              10. YARN-2571-013.patch
                136 kB
                Steve Loughran
              11. YARN-2571-015.patch
                176 kB
                Steve Loughran
              12. YARN-2571-016.patch
                202 kB
                Steve Loughran
              13. YARN-2571-017.patch
                201 kB
                Steve Loughran

                Issue Links

                causes

                Sub-task - The sub-task of the issue YARN-6136 YARN registry service should avoid scanning whole ZK tree for every container/application finish

                • Critical - Crashes, loss of data, severe memory leak.
                • Resolved
                depends upon

                Sub-task - The sub-task of the issue YARN-2652 add hadoop-yarn-registry package under hadoop-yarn

                • Major - Major loss of function.
                • Closed
                is depended upon by

                Sub-task - The sub-task of the issue SLIDER-552 remove root registry path setup in AM

                • Critical - Crashes, loss of data, severe memory leak.
                • Open

                Sub-task - The sub-task of the issue YARN-2646 distributed shell & tests to use registry

                • Major - Major loss of function.
                • Open

                New Feature - A new feature of the product, which has yet to be developed. SLIDER-149 Support a YARN service registry

                • Major - Major loss of function.
                • Resolved
                is duplicated by

                Sub-task - The sub-task of the issue YARN-6903 Yarn-native-service framework core rewrite

                • Major - Major loss of function.
                • Resolved
                links to

                Web Link GitHub Pull Request #66

                  Activity

                    People

                    • Assignee:
                      stevel@apache.org Steve Loughran
                      Reporter:
                      stevel@apache.org Steve Loughran
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      19 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: