Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2268

With JVM reuse, JvmManager doesn't delete last workdir properly

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 0.22.1
    • Component/s: tasktracker
    • Labels:
      None

      Description

      In JvmManager, when a Jvm exits, it tries to delete the workdir for initalContext.task which is null, hence throwing NPE. Currently this NPE is swallowed into the abyss.

      We should catch exceptions out of the JvmRunner thread, add a test case that verifies this functionality, and fix this code to properly grab the last task.

        Activity

        Hide
        Todd Lipcon added a comment -

        nope, no plans to work on this given the impl is different in 0.23

        Show
        Todd Lipcon added a comment - nope, no plans to work on this given the impl is different in 0.23
        Hide
        Konstantin Shvachko added a comment -

        Agree with Milind.
        Todd, let me know if you plan to fix it soon.
        Unblocking for now.

        Show
        Konstantin Shvachko added a comment - Agree with Milind. Todd, let me know if you plan to fix it soon. Unblocking for now.
        Hide
        Milind Bhandarkar added a comment -

        jvm reuse has very limited use in practice, especially on a multi-tenant cluster. Also, with security enabled, jvm reuse tends to get used even more rarely. In the 0.22 release notes, we should make a note of this, and should make this jira not-a-blocker. Thoughts ?

        Show
        Milind Bhandarkar added a comment - jvm reuse has very limited use in practice, especially on a multi-tenant cluster. Also, with security enabled, jvm reuse tends to get used even more rarely. In the 0.22 release notes, we should make a note of this, and should make this jira not-a-blocker. Thoughts ?

          People

          • Assignee:
            Unassigned
            Reporter:
            Todd Lipcon
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:

              Development