Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4002

MultiFileWordCount job fails if the input path is not from default file system

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.23.3, 2.0.0-alpha
    • 2.0.2-alpha
    • examples
    • None
    • Reviewed

    Description

      In the MultiFileWordCount#CombineFileLineRecordReader, filesystem object has been initialized in the following way

      fs = FileSystem.get(context.getConfiguration());

      This causes, fs to be initialized with default filesystem. Therefore fs searchs for the input files on the default file system, which fails if the input path is from different source.

      Attachments

        1. MAPREDUCE-4002.patch
          0.9 kB
          Bhallamudi Venkata Siva Kamesh

        Activity

          People

            kam_iitkgp Bhallamudi Venkata Siva Kamesh
            kam_iitkgp Bhallamudi Venkata Siva Kamesh
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: