Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1954

Add waitFor to AMRMClient(Async)

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.4.0, 3.0.0-alpha1
    • 2.6.0
    • client
    • None
    • Reviewed

    Description

      Recently, I saw some use cases of AMRMClient(Async). The painful thing is that the main non-daemon thread has to sit in a dummy loop to prevent AM process exiting before all the tasks are done, while unregistration is triggered on a separate another daemon thread by callback methods (in particular when using AMRMClientAsync). IMHO, it should be beneficial to add a waitFor method to AMRMClient(Async) to block the AM until unregistration or user supplied check point, such that users don't need to write the loop themselves.

      Attachments

        1. YARN-1954.1.patch
          9 kB
          Tsuyoshi Ozawa
        2. YARN-1954.2.patch
          8 kB
          Tsuyoshi Ozawa
        3. YARN-1954.3.patch
          13 kB
          Tsuyoshi Ozawa
        4. YARN-1954.4.patch
          15 kB
          Tsuyoshi Ozawa
        5. YARN-1954.4.patch
          15 kB
          Tsuyoshi Ozawa
        6. YARN-1954.5.patch
          16 kB
          Tsuyoshi Ozawa
        7. YARN-1954.6.patch
          15 kB
          Tsuyoshi Ozawa
        8. YARN-1954.7.patch
          14 kB
          Tsuyoshi Ozawa
        9. YARN-1954.8.patch
          14 kB
          Zhijie Shen

        Issue Links

          Activity

            People

              ozawa Tsuyoshi Ozawa
              zjshen Zhijie Shen
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: