Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3244

Make nodes fail/succeed based on return codes (regardless of pending data)

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      If I were to run a MR job with a script like 'head -n10' for some reason, each node would execute head -n10 (good), and output 10 rows (good) and then the 'head' program would return success and quit (good), and all the nodes would fail (bad) because there's a ton of pending data (irrelevant).

      For purposes of streaming data through programs, Hadoop should trust the program's return code.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              akramer Adam Kramer
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: