Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-476

Streaming should check for correctness of the task

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.12.0
    • None
    • None

    Description

      Currently, if anythin is wrong with streaming job, it dies without any explanation.

      Before creating and running actual MapReduce job, Streaming should check if:

      – the executables (or scripts) for -mapper and -reducer are available and have right permissions
      – the input fragments exist

      Attachments

        1. Hadoop-476_1.patch
          20 kB
          Sanjay Dahiya
        2. Hadoop-476.patch
          18 kB
          Sanjay Dahiya
        3. Hadoop-476.patch
          18 kB
          Sanjay Dahiya

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            acmurthy Arun Murthy Assign to me
            arkady arkady borkovsky
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment