Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4260

Use JobObject to spawn tasks on Windows

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Currently, the Windows version spawns the task as a normal cmd shell from which other downstream exe's are spawned. However, this is not bullet proof because if an intermediate process exits before its child exits, then the parent child process tree relationship cannot be constructed. Windows has a concept of JobObject that is similar to the setsid behavior used in Linux. The initial spawned task could be launched within its JobObject. Thereafter, process termination, memory management etc could be operated on the JobObject.

        Attachments

        1. MAPREDUCE-4260.branch-1-win.1.patch
          37 kB
          Bikas Saha
        2. MAPREDUCE-4260.branch-1-win.2.patch
          37 kB
          Bikas Saha
        3. MAPREDUCE-4260.branch-1-win.patch
          38 kB
          Bikas Saha
        4. MAPREDUCE-4260.patch
          7 kB
          Bikas Saha
        5. test.cpp
          12 kB
          Bikas Saha

          Issue Links

            Activity

              People

              • Assignee:
                bikassaha Bikas Saha
                Reporter:
                bikassaha Bikas Saha
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: