Hadoop Common
  1. Hadoop Common
  2. HADOOP-278

a missing map/reduce input directory does not produce a user-visible error message

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.3.1
    • Fix Version/s: 0.4.0
    • Component/s: None
    • Labels:
      None

      Description

      If map/reduce's input directory is in DFS and does not exist, the user has to find the problem in the jobtracker logs rather than either the launching program or the webapp.

        Activity

        Hide
        Doug Cutting added a comment -

        I just committed this. Thanks, Owen!

        Show
        Doug Cutting added a comment - I just committed this. Thanks, Owen!
        Hide
        Owen O'Malley added a comment -

        This patch adds a method for InputFormat that checks to see if a list of input paths is valid. InputFormatBase implements the simple check to make sure that each path represents a directory. JobClient checks the validity of each path and stops the job submission with a message to the user if any directories are invalid.

        Show
        Owen O'Malley added a comment - This patch adds a method for InputFormat that checks to see if a list of input paths is valid. InputFormatBase implements the simple check to make sure that each path represents a directory. JobClient checks the validity of each path and stops the job submission with a message to the user if any directories are invalid.

          People

          • Assignee:
            Owen O'Malley
            Reporter:
            Owen O'Malley
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development