Hive
  1. Hive
  2. HIVE-5198

WebHCat returns exitcode 143 (w/o an explanation)

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.11.0
    • Fix Version/s: 0.12.0
    • Component/s: WebHCat
    • Labels:
      None

      Description

      The message might look like this:
      {"statement":"use default; show table extended like xyz;","error":"unable to show table: xyz","exec":{"stdout":"","stderr":"","exitcode":143}}

      WebHCat has a templeton.exec.timeout property which kills an HCat request (i.e. something like a DDL statement that gets routed to HCat CLI) if it takes longer than this timeout.

      Since WebHCat does a fork/exec to 'hcat' script, the timeout is implemented as SIGTERM sent to the subprocess. SIGTERM value is 15. So it's reported as 128 + 15 = 143.

      Error logging/reporting should be improved in this case.

      1. HIVE-5198.patch
        1 kB
        Eugene Koifman

        Activity

        Ashutosh Chauhan made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Hide
        Ashutosh Chauhan added a comment -

        This issue has been fixed and released as part of 0.12 release. If you find further issues, please create a new jira and link it to this one.

        Show
        Ashutosh Chauhan added a comment - This issue has been fixed and released as part of 0.12 release. If you find further issues, please create a new jira and link it to this one.
        Hide
        Hudson added a comment -

        FAILURE: Integrated in Hive-trunk-hadoop1-ptest #173 (See https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/173/)
        HIVE-5198: WebHCat returns exitcode 143 (w/o an explanation) (Eugene Koifman via Thejas Nair) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1524617)

        • /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/ExecServiceImpl.java
        Show
        Hudson added a comment - FAILURE: Integrated in Hive-trunk-hadoop1-ptest #173 (See https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/173/ ) HIVE-5198 : WebHCat returns exitcode 143 (w/o an explanation) (Eugene Koifman via Thejas Nair) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1524617 ) /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/ExecServiceImpl.java
        Hide
        Hudson added a comment -

        FAILURE: Integrated in Hive-trunk-hadoop2-ptest #106 (See https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/106/)
        HIVE-5198: WebHCat returns exitcode 143 (w/o an explanation) (Eugene Koifman via Thejas Nair) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1524617)

        • /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/ExecServiceImpl.java
        Show
        Hudson added a comment - FAILURE: Integrated in Hive-trunk-hadoop2-ptest #106 (See https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/106/ ) HIVE-5198 : WebHCat returns exitcode 143 (w/o an explanation) (Eugene Koifman via Thejas Nair) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1524617 ) /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/ExecServiceImpl.java
        Hide
        Hudson added a comment -

        FAILURE: Integrated in Hive-trunk-h0.21 #2341 (See https://builds.apache.org/job/Hive-trunk-h0.21/2341/)
        HIVE-5198: WebHCat returns exitcode 143 (w/o an explanation) (Eugene Koifman via Thejas Nair) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1524617)

        • /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/ExecServiceImpl.java
        Show
        Hudson added a comment - FAILURE: Integrated in Hive-trunk-h0.21 #2341 (See https://builds.apache.org/job/Hive-trunk-h0.21/2341/ ) HIVE-5198 : WebHCat returns exitcode 143 (w/o an explanation) (Eugene Koifman via Thejas Nair) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1524617 ) /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/ExecServiceImpl.java
        Hide
        Hudson added a comment -

        FAILURE: Integrated in Hive-trunk-hadoop2 #440 (See https://builds.apache.org/job/Hive-trunk-hadoop2/440/)
        HIVE-5198: WebHCat returns exitcode 143 (w/o an explanation) (Eugene Koifman via Thejas Nair) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1524617)

        • /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/ExecServiceImpl.java
        Show
        Hudson added a comment - FAILURE: Integrated in Hive-trunk-hadoop2 #440 (See https://builds.apache.org/job/Hive-trunk-hadoop2/440/ ) HIVE-5198 : WebHCat returns exitcode 143 (w/o an explanation) (Eugene Koifman via Thejas Nair) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1524617 ) /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/ExecServiceImpl.java
        Thejas M Nair made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Hide
        Thejas M Nair added a comment -

        Patch committed to trunk and 0.12 branch. Thanks Eugene for the contribution!

        Show
        Thejas M Nair added a comment - Patch committed to trunk and 0.12 branch. Thanks Eugene for the contribution!
        Thejas M Nair made changes -
        Fix Version/s 0.13.0 [ 12324986 ]
        Hide
        Hive QA added a comment -

        Overall: +1 all checks pass

        Here are the results of testing the latest attachment:
        https://issues.apache.org/jira/secure/attachment/12603733/HIVE-5198.patch

        SUCCESS: +1 3126 tests passed

        Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/793/testReport
        Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/793/console

        Messages:

        Executing org.apache.hive.ptest.execution.PrepPhase
        Executing org.apache.hive.ptest.execution.ExecutionPhase
        Executing org.apache.hive.ptest.execution.ReportingPhase
        

        This message is automatically generated.

        Show
        Hive QA added a comment - Overall : +1 all checks pass Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12603733/HIVE-5198.patch SUCCESS: +1 3126 tests passed Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/793/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/793/console Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase This message is automatically generated.
        Eugene Koifman made changes -
        Fix Version/s 0.12.0 [ 12324312 ]
        Hide
        Thejas M Nair added a comment -

        +1

        Show
        Thejas M Nair added a comment - +1
        Eugene Koifman made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Eugene Koifman made changes -
        Attachment HIVE-5198.patch [ 12603733 ]
        Hide
        Eugene Koifman added a comment -

        added a check to see if the request timed out and a log statement to that effect

        Show
        Eugene Koifman added a comment - added a check to see if the request timed out and a log statement to that effect
        Eugene Koifman made changes -
        Description Filing this bug mostly to help anyone trying to decipher 143 error code which does not appear in the source code. In 0.12 error reporting was improved and this reports a stacktrace.

        This error code means that Metastore client could not connect to the metastore.
        This is likely a config issue with hive.metastore.uris not being set.

        The message might look like this:
        {"statement":"use default; show table extended like xyz;","error":"unable to show table: xyz","exec":{"stdout":"","stderr":"","exitcode":143}}
        The message might look like this:
        {"statement":"use default; show table extended like xyz;","error":"unable to show table: xyz","exec":{"stdout":"","stderr":"","exitcode":143}}

        WebHCat has a templeton.exec.timeout property which kills an HCat request (i.e. something like a DDL statement that gets routed to HCat CLI) if it takes longer than this timeout.

        Since WebHCat does a fork/exec to 'hcat' script, the timeout is implemented as SIGTERM sent to the subprocess. SIGTERM value is 15. So it's reported as 128 + 15 = 143.

        Error logging/reporting should be improved in this case.

        Eugene Koifman made changes -
        Fix Version/s 0.13.0 [ 12324986 ]
        Affects Version/s 0.13.0 [ 12324986 ]
        Eugene Koifman made changes -
        Affects Version/s 0.13.0 [ 12324986 ]
        Eugene Koifman made changes -
        Field Original Value New Value
        Assignee Eugene Koifman [ ekoifman ]
        Eugene Koifman created issue -

          People

          • Assignee:
            Eugene Koifman
            Reporter:
            Eugene Koifman
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development