Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6486

File{Input|Output}Format counters not updated when using viewfs

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • mrv2, task
    • None

    Description

      MapReduce tasks rely on filesystem stats to update FileInputFormatCounter and FileOutputFormatCounter bytes counters.

      But if the filesystem is viewfs, stats are not updated and counters are zero. However the resolved filesystem for the input and output paths have their stats updated, and should be used by the framework (which could be done by resolving the path first).

      Attachments

        Activity

          People

            Unassigned Unassigned
            laurent Laurent Goujon
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated: