Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4552

NM ResourceLocalizationService should check and initialize local filecache dir (and log dir) even if NM recover is enabled.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • None
    • None
    • nodemanager
    • None

    Description

      In some cases, user are cleanup localized file cache for debugging/trouble shooting purpose during NM down time. However, after bring back NM (with recovery enabled), the job submission could be failed for exception like below:

      Diagnostics: java.io.FileNotFoundException: File /disk/12/yarn/local/filecache does not exist.
      

      This is due to we only create filecache dir when recover is not enabled during ResourceLocalizationService get initialized/started.

      Attachments

        1. YARN-4552.patch
          4 kB
          Junping Du
        2. YARN-4552-v2.patch
          13 kB
          Junping Du

        Activity

          People

            junping_du Junping Du
            junping_du Junping Du
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated: