Pig
  1. Pig
  2. PIG-3984

PigServer.shutdown remove the tez resource folder

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.14.0
    • Component/s: tez
    • Labels:
      None

      Description

      PIG-3978 make tez resource folder live across sessions. However, if PigServer.shutdown is called, tez resource folder will be removed and following job will fail. Bunch of tez unit test fail due to this.

      1. PIG-3984-3.patch
        8 kB
        Rohini Palaniswamy
      2. PIG-3984-2.patch
        6 kB
        Daniel Dai
      3. PIG-3984-1.patch
        3 kB
        Daniel Dai

        Activity

        Daniel Dai created issue -
        Daniel Dai made changes -
        Field Original Value New Value
        Attachment PIG-3984-1.patch [ 12648071 ]
        Hide
        Daniel Dai added a comment -

        bump

        Show
        Daniel Dai added a comment - bump
        Hide
        Rohini Palaniswamy added a comment -

        Shouldn't we clean the resource path up when exiting the grunt shell,end of execution of pig script and termination due to Ctrl+C(ShutdownHook) ?

        Show
        Rohini Palaniswamy added a comment - Shouldn't we clean the resource path up when exiting the grunt shell,end of execution of pig script and termination due to Ctrl+C(ShutdownHook) ?
        Hide
        Daniel Dai added a comment -

        Addressing Rohini's review comments.

        Show
        Daniel Dai added a comment - Addressing Rohini's review comments.
        Daniel Dai made changes -
        Attachment PIG-3984-2.patch [ 12652457 ]
        Hide
        Rohini Palaniswamy added a comment -

        +1. I was trying to get all tez unit tests to passing before uploading patch for PIG-3935. So went ahead and committed to trunk. Thanks Daniel.

        I made two minor changes to the patch before committing. Moved FileLocalizer.deleteTempResourceFiles(); inside if(deleteTempFiles) and changed if (resourcePath != null) to if (resourcePath.get() != null) . Uploaded the final patch as PIG-3984-3.patch

        Show
        Rohini Palaniswamy added a comment - +1. I was trying to get all tez unit tests to passing before uploading patch for PIG-3935 . So went ahead and committed to trunk. Thanks Daniel. I made two minor changes to the patch before committing. Moved FileLocalizer.deleteTempResourceFiles(); inside if(deleteTempFiles) and changed if (resourcePath != null) to if (resourcePath.get() != null) . Uploaded the final patch as PIG-3984 -3.patch
        Rohini Palaniswamy made changes -
        Attachment PIG-3984-3.patch [ 12654231 ]
        Rohini Palaniswamy made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Daniel Dai made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Resolved Resolved
        33d 19h 11m 1 Rohini Palaniswamy 06/Jul/14 21:58
        Resolved Resolved Closed Closed
        137d 9h 1 Daniel Dai 21/Nov/14 05:58

          People

          • Assignee:
            Daniel Dai
            Reporter:
            Daniel Dai
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development