Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1663

streaming returning 0 when submitJob fails with Exception

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.13.1
    • 0.14.0
    • None
    • None

    Description

      In streaming, if I pass an input filename that doesn't exist,

      bash-3.00$ hadoop jar hadoop-streaming.jar -mapper "/bin/cat" -reducer "/bin/cat" -input "inputfoo" -output "output"
      ...
      07/07/28 07:37:18 ERROR streaming.StreamJob: Error Launching job : Input path doesnt exist : /user/knoguchi/inputfoo
      bash-3.00$ echo $?
      0

      =================
      Copy&Pasting Milind's comment.

      its a hadoop streaming problem. See the code
      below:

      }catch( IOException ioe)

      { LOG.error("Error Launching job : " + ioe.getMessage()); }

      finally {
      if (error && (running_ != null))

      { LOG.info("killJob..."); running_.killJob(); }

      jc_.close();

      Note that it catches exception, and does not rethrow it !!!
      =================

      Attachments

        1. h-1663-streamexception-simpletestcase.patch
          4 kB
          Lohit Vijaya Renu
        2. h-1663-streamexception-mod.patch
          3 kB
          Koji Noguchi
        3. h-1663-streamexception-as-returncode.patch
          6 kB
          Lohit Vijaya Renu
        4. h-1663-streamexception-as-returncode.patch
          6 kB
          Lohit Vijaya Renu
        5. h-1663-streamexception.patch
          1.0 kB
          Koji Noguchi

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            knoguchi Koji Noguchi
            knoguchi Koji Noguchi
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment