Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2701

Potential race condition in startLocalizer when using LinuxContainerExecutor

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • None
    • 2.6.0
    • None
    • None
    • Reviewed

    Description

      When using LinuxContainerExecutor do startLocalizer, we are using native code container-executor.c. 

           if (stat(npath, &sb) != 0) {
       if (mkdir(npath, perm) != 0) {

      We are using check and create method to create the appDir under /usercache. But if there are two containers trying to do this at the same time, race condition may happen.

      Attachments

        1. YARN-2701.1.patch
          12 kB
          Xuan Gong
        2. YARN-2701.2.patch
          13 kB
          Xuan Gong
        3. YARN-2701.3.patch
          13 kB
          Xuan Gong
        4. YARN-2701.4.patch
          13 kB
          Xuan Gong
        5. YARN-2701.5.patch
          13 kB
          Xuan Gong
        6. YARN-2701.6.patch
          12 kB
          Xuan Gong
        7. YARN-2701.addendum.1.patch
          4 kB
          Xuan Gong
        8. YARN-2701.addendum.2.patch
          4 kB
          Xuan Gong
        9. YARN-2701.addendum.3.patch
          4 kB
          Xuan Gong
        10. YARN-2701.addendum.4.patch
          5 kB
          Xuan Gong

        Issue Links

          is broken by

          Bug - A problem which impairs or prevents the functions of the product. YARN-2161 Fix build on macosx: YARN parts

          • Major - Major loss of function.
          • Closed

          Activity

            People

              xgong Xuan Gong
              xgong Xuan Gong
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: