Sqoop
  1. Sqoop
  2. SQOOP-852

Sqoop2: Mapreduce submission engine is not closing opened JobClient object

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.99.1
    • Fix Version/s: 1.99.2
    • Component/s: None
    • Labels:
      None

      Description

      Our current implementation of Mapreduce Submission engine is opening one JobClient instance for entire lifecycle of the server, but it's not closing it down properly during shutdown.

      1. bugSQOOP-852.patch
        2 kB
        Jarek Jarcec Cecho

        Issue Links

          Activity

          Jarek Jarcec Cecho created issue -
          Jarek Jarcec Cecho made changes -
          Field Original Value New Value
          Assignee Jarek Jarcec Cecho [ jarcec ]
          Jarek Jarcec Cecho made changes -
          Remote Link This issue links to "Review board (Web Link)" [ 11990 ]
          Jarek Jarcec Cecho made changes -
          Attachment bugSQOOP-852.patch [ 12566429 ]
          Jarek Jarcec Cecho made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Cheolsoo Park added a comment -

          +1. LGTM. Will commit it after running tests.

          Show
          Cheolsoo Park added a comment - +1. LGTM. Will commit it after running tests.
          Hide
          Cheolsoo Park added a comment -

          Committed to sqoop2. Thanks Jarcec!

          Show
          Cheolsoo Park added a comment - Committed to sqoop2. Thanks Jarcec!
          Cheolsoo Park made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Hide
          Hudson added a comment -

          Integrated in Sqoop2-hadoop200 #171 (See https://builds.apache.org/job/Sqoop2-hadoop200/171/)
          SQOOP-852: Mapreduce submission engine is not closing opened JobClient object (Revision 42b7979f5e2c325ba8b02e1a309f0d1d60550c59)

          Result = SUCCESS
          cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=42b7979f5e2c325ba8b02e1a309f0d1d60550c59
          Files :

          • submission/mapreduce/src/main/java/org/apache/sqoop/submission/mapreduce/MapreduceSubmissionEngine.java
          • submission/mapreduce/src/main/java/org/apache/sqoop/submission/mapreduce/MapreduceSubmissionError.java
          Show
          Hudson added a comment - Integrated in Sqoop2-hadoop200 #171 (See https://builds.apache.org/job/Sqoop2-hadoop200/171/ ) SQOOP-852 : Mapreduce submission engine is not closing opened JobClient object (Revision 42b7979f5e2c325ba8b02e1a309f0d1d60550c59) Result = SUCCESS cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=42b7979f5e2c325ba8b02e1a309f0d1d60550c59 Files : submission/mapreduce/src/main/java/org/apache/sqoop/submission/mapreduce/MapreduceSubmissionEngine.java submission/mapreduce/src/main/java/org/apache/sqoop/submission/mapreduce/MapreduceSubmissionError.java
          Hide
          Hudson added a comment -

          Integrated in Sqoop2-hadoop100 #157 (See https://builds.apache.org/job/Sqoop2-hadoop100/157/)
          SQOOP-852: Mapreduce submission engine is not closing opened JobClient object (Revision 42b7979f5e2c325ba8b02e1a309f0d1d60550c59)

          Result = SUCCESS
          cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=42b7979f5e2c325ba8b02e1a309f0d1d60550c59
          Files :

          • submission/mapreduce/src/main/java/org/apache/sqoop/submission/mapreduce/MapreduceSubmissionEngine.java
          • submission/mapreduce/src/main/java/org/apache/sqoop/submission/mapreduce/MapreduceSubmissionError.java
          Show
          Hudson added a comment - Integrated in Sqoop2-hadoop100 #157 (See https://builds.apache.org/job/Sqoop2-hadoop100/157/ ) SQOOP-852 : Mapreduce submission engine is not closing opened JobClient object (Revision 42b7979f5e2c325ba8b02e1a309f0d1d60550c59) Result = SUCCESS cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=42b7979f5e2c325ba8b02e1a309f0d1d60550c59 Files : submission/mapreduce/src/main/java/org/apache/sqoop/submission/mapreduce/MapreduceSubmissionEngine.java submission/mapreduce/src/main/java/org/apache/sqoop/submission/mapreduce/MapreduceSubmissionError.java
          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Patch Available Patch Available
          15m 34s 1 Jarek Jarcec Cecho 25/Jan/13 01:36
          Patch Available Patch Available Resolved Resolved
          5d 22h 12m 1 Cheolsoo Park 30/Jan/13 23:49

            People

            • Assignee:
              Jarek Jarcec Cecho
              Reporter:
              Jarek Jarcec Cecho
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development