Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-7263

Remove obsolete validateTargetPath() from FrameworkUploader

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.2.1
    • 3.3.0
    • mrv2
    • None
    • Reviewed

    Description

      The following piece of code has been in the FrameworkUploader class for a while:

        private void validateTargetPath() throws UploaderException {
          if (!target.startsWith("hdfs:/") &&
              !target.startsWith("file:/")) {
            throw new UploaderException("Target path is not hdfs or local " + target);
          }
        }
      

      As parts of MR and YARN has evolved, you can run YARN with OzoneFS as storage for instance - so HDFS (or local) is not a requirement anymore. Also it does not make sense to add other suitable filesystems when they're tested against the MR framework, so I'm suggesting to remove the check.

      Attachments

        1. MAPREDUCE-7263.001.patch
          2 kB
          Hudáky Márton Gyula

        Activity

          People

            mhudaky Hudáky Márton Gyula
            adam.antal Adam Antal
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: