Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2492 (Clone of YARN-796) Allow for (admin) labels on nodes and resource-requests
  3. YARN-2729

Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: nodemanager
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup .

      Miscellaneous Issues :

      1. In configurationNodeLabelsProvider instead of taking multiple labels from single configuration, we need to support exclusive configuration for partition (single label).
      2. Proper logging when registration of Node Fails
      3. Classloader was not getting reset from custom class loader in TestConfigurationNodeLabelsProvider.java which could make test cases fail in certain conditions
      4. In ResourceTrackerService we need to consider distributed configuration only when node labels are enabled. leads to lots of logs in certain conditions
      5. NodeLabelsProvider needs to be a interface rather than abstract class

        Attachments

        1. YARN-2729.20141023-1.patch
          13 kB
          Naganarasimha G R
        2. YARN-2729.20141024-1.patch
          15 kB
          Naganarasimha G R
        3. YARN-2729.20141031-1.patch
          18 kB
          Naganarasimha G R
        4. YARN-2729.20141120-1.patch
          18 kB
          Naganarasimha G R
        5. YARN-2729.20141210-1.patch
          18 kB
          Naganarasimha G R
        6. YARN-2729.20150309-1.patch
          24 kB
          Naganarasimha G R
        7. YARN-2729.20150322-1.patch
          24 kB
          Naganarasimha G R
        8. YARN-2729.20150401-1.patch
          7 kB
          Naganarasimha G R
        9. YARN-2729.20150402-1.patch
          26 kB
          Naganarasimha G R
        10. YARN-2729.20150404-1.patch
          41 kB
          Naganarasimha G R
        11. YARN-2729.20150517-1.patch
          19 kB
          Naganarasimha G R
        12. YARN-2729.20150830-1.patch
          22 kB
          Naganarasimha G R
        13. YARN-2729.20150925-1.patch
          32 kB
          Naganarasimha G R
        14. YARN-2729.20151310-1.patch
          35 kB
          Naganarasimha G R
        15. YARN-2729.20151310-2.patch
          36 kB
          Naganarasimha G R
        16. YARN-2729.20151015-1.patch
          40 kB
          Naganarasimha G R
        17. YARN-2729.20151019.patch
          39 kB
          Naganarasimha G R
        18. YARN-2729.20151023-1.patch
          40 kB
          Naganarasimha G R

          Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. YARN-4300 [JDK8] Fix javadoc errors caused by wrong tags

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          depends upon

          Sub-task - The sub-task of the issue YARN-2495 Allow admin specify labels from each NM (Distributed configuration)

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-2923 Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup

          • Major - Major loss of function.
          • Resolved

            Activity

              People

              • Assignee:
                Naganarasimha Naganarasimha G R
                Reporter:
                Naganarasimha Naganarasimha G R
              • Votes:
                0 Vote for this issue
                Watchers:
                11 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: