Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1954

Add waitFor to AMRMClient(Async)

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.4.0, 3.0.0-alpha1
    • Fix Version/s: 2.6.0
    • Component/s: client
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Recently, I saw some use cases of AMRMClient(Async). The painful thing is that the main non-daemon thread has to sit in a dummy loop to prevent AM process exiting before all the tasks are done, while unregistration is triggered on a separate another daemon thread by callback methods (in particular when using AMRMClientAsync). IMHO, it should be beneficial to add a waitFor method to AMRMClient(Async) to block the AM until unregistration or user supplied check point, such that users don't need to write the loop themselves.

        Attachments

        1. YARN-1954.1.patch
          9 kB
          Tsuyoshi Ozawa
        2. YARN-1954.2.patch
          8 kB
          Tsuyoshi Ozawa
        3. YARN-1954.3.patch
          13 kB
          Tsuyoshi Ozawa
        4. YARN-1954.4.patch
          15 kB
          Tsuyoshi Ozawa
        5. YARN-1954.4.patch
          15 kB
          Tsuyoshi Ozawa
        6. YARN-1954.5.patch
          16 kB
          Tsuyoshi Ozawa
        7. YARN-1954.6.patch
          15 kB
          Tsuyoshi Ozawa
        8. YARN-1954.7.patch
          14 kB
          Tsuyoshi Ozawa
        9. YARN-1954.8.patch
          14 kB
          Zhijie Shen

          Issue Links

            Activity

              People

              • Assignee:
                ozawa Tsuyoshi Ozawa
                Reporter:
                zjshen Zhijie Shen
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: