Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2268

With JVM reuse, JvmManager doesn't delete last workdir properly

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: tasktracker
    • Labels:
      None

      Description

      In JvmManager, when a Jvm exits, it tries to delete the workdir for initalContext.task which is null, hence throwing NPE. Currently this NPE is swallowed into the abyss.

      We should catch exceptions out of the JvmRunner thread, add a test case that verifies this functionality, and fix this code to properly grab the last task.

        Activity

        Todd Lipcon created issue -
        Hide
        Milind Bhandarkar added a comment -

        jvm reuse has very limited use in practice, especially on a multi-tenant cluster. Also, with security enabled, jvm reuse tends to get used even more rarely. In the 0.22 release notes, we should make a note of this, and should make this jira not-a-blocker. Thoughts ?

        Show
        Milind Bhandarkar added a comment - jvm reuse has very limited use in practice, especially on a multi-tenant cluster. Also, with security enabled, jvm reuse tends to get used even more rarely. In the 0.22 release notes, we should make a note of this, and should make this jira not-a-blocker. Thoughts ?
        Hide
        Konstantin Shvachko added a comment -

        Agree with Milind.
        Todd, let me know if you plan to fix it soon.
        Unblocking for now.

        Show
        Konstantin Shvachko added a comment - Agree with Milind. Todd, let me know if you plan to fix it soon. Unblocking for now.
        Konstantin Shvachko made changes -
        Field Original Value New Value
        Priority Blocker [ 1 ] Major [ 3 ]
        Hide
        Todd Lipcon added a comment -

        nope, no plans to work on this given the impl is different in 0.23

        Show
        Todd Lipcon added a comment - nope, no plans to work on this given the impl is different in 0.23
        Todd Lipcon made changes -
        Assignee Todd Lipcon [ tlipcon ]
        Konstantin Shvachko made changes -
        Fix Version/s 0.22.1 [ 12319242 ]
        Fix Version/s 0.22.0 [ 12314184 ]
        Allen Wittenauer made changes -
        Fix Version/s 0.22.1 [ 12319242 ]
        Allen Wittenauer made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Won't Fix [ 2 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Resolved Resolved
        1515d 1h 33m 1 Allen Wittenauer 10/Mar/15 03:11

          People

          • Assignee:
            Unassigned
            Reporter:
            Todd Lipcon
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development