Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2701

Potential race condition in startLocalizer when using LinuxContainerExecutor

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.6.0
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      When using LinuxContainerExecutor do startLocalizer, we are using native code container-executor.c.

           if (stat(npath, &sb) != 0) {
             if (mkdir(npath, perm) != 0) {
      

      We are using check and create method to create the appDir under /usercache. But if there are two containers trying to do this at the same time, race condition may happen.

        Attachments

        1. YARN-2701.1.patch
          12 kB
          Xuan Gong
        2. YARN-2701.2.patch
          13 kB
          Xuan Gong
        3. YARN-2701.3.patch
          13 kB
          Xuan Gong
        4. YARN-2701.4.patch
          13 kB
          Xuan Gong
        5. YARN-2701.5.patch
          13 kB
          Xuan Gong
        6. YARN-2701.6.patch
          12 kB
          Xuan Gong
        7. YARN-2701.addendum.1.patch
          4 kB
          Xuan Gong
        8. YARN-2701.addendum.2.patch
          4 kB
          Xuan Gong
        9. YARN-2701.addendum.3.patch
          4 kB
          Xuan Gong
        10. YARN-2701.addendum.4.patch
          5 kB
          Xuan Gong

          Issue Links

            Activity

              People

              • Assignee:
                xgong Xuan Gong
                Reporter:
                xgong Xuan Gong
              • Votes:
                0 Vote for this issue
                Watchers:
                12 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: