Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6280

Reject directory vs file path conflict resolution in FileOutputCommitter

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.6.0
    • Fix Version/s: None
    • Component/s: mrv2
    • Labels:
      None

      Description

      If one task commits a directory foo, and then another task commits file foo, the directory foo with potentially many files will be wiped out. While this is a very unlikely scenario, due to tasks being homogeneous in nature, it's so much more important to alert the user by failing the commit. This came up in Jason Lowe's review for MAPREDUCE-6275 and seems to be the behavior in branch-1 as well.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                jira.shegalov Gera Shegalov
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated: