Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8881

Receiving json "{"error":"Could not find job job_1415748506143_0002"}" when web client tries to fetch all jobs from webhcat where HDFS does not have the data.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.14.0
    • Fix Version/s: 1.1.0
    • Component/s: WebHCat
    • Labels:
      None

      Description

      when a job is deleted from HDFS and the curl call is executed
      http://localhost:50111/templeton/v1/jobs?user.name=hcat\&showall=true\&fields=*'

      Occasionally receiving json like this

      {"error":"Could not find job job_1415748506143_0002"}
      

      this is an intermittent issue that happens when Hadoop for some reason can't find the details for a given job id.

      This REST call should be more flexible since it is designed to return information about many jobs at once. It should just skip over "bad" IDs and produce as much output as it can.

      1. HIVE-8881.patch
        0.7 kB
        Eugene Koifman

        Activity

        Hide
        thejas Thejas M Nair added a comment -

        Eugene Koifman Can you explain how the change to extend Exception instead of throwable fixes this issue ?

        Show
        thejas Thejas M Nair added a comment - Eugene Koifman Can you explain how the change to extend Exception instead of throwable fixes this issue ?
        Hide
        ekoifman Eugene Koifman added a comment -

        Server.showJobList() handles Exception but not Throwable. I think catching Throwables are usually a bad idea.

        Show
        ekoifman Eugene Koifman added a comment - Server.showJobList() handles Exception but not Throwable. I think catching Throwables are usually a bad idea.
        Hide
        thejas Thejas M Nair added a comment -

        +1

        Show
        thejas Thejas M Nair added a comment - +1
        Hide
        hiveqa Hive QA added a comment -

        Overall: -1 at least one tests failed

        Here are the results of testing the latest attachment:
        https://issues.apache.org/jira/secure/attachment/12681665/HIVE-8881.patch

        ERROR: -1 due to 1 failed/errored test(s), 6647 tests executed
        Failed tests:

        org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
        

        Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1823/testReport
        Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1823/console
        Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1823/

        Messages:

        Executing org.apache.hive.ptest.execution.PrepPhase
        Executing org.apache.hive.ptest.execution.ExecutionPhase
        Executing org.apache.hive.ptest.execution.ReportingPhase
        Tests exited with: TestsFailedException: 1 tests failed
        

        This message is automatically generated.

        ATTACHMENT ID: 12681665 - PreCommit-HIVE-TRUNK-Build

        Show
        hiveqa Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12681665/HIVE-8881.patch ERROR: -1 due to 1 failed/errored test(s), 6647 tests executed Failed tests: org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1823/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1823/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1823/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed This message is automatically generated. ATTACHMENT ID: 12681665 - PreCommit-HIVE-TRUNK-Build
        Hide
        ekoifman Eugene Koifman added a comment -

        The change is a WebHCat only changes and above test failure is not related.
        Committed to trunk. Thanks Thejas M Nair for the review.

        Show
        ekoifman Eugene Koifman added a comment - The change is a WebHCat only changes and above test failure is not related. Committed to trunk. Thanks Thejas M Nair for the review.

          People

          • Assignee:
            ekoifman Eugene Koifman
            Reporter:
            ekoifman Eugene Koifman
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development