Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-496

If mapred.local.dir is configured on top of dfs.data.dir, hadoop should refuse to start rather than deleting the contents of local.dir

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      I just managed to blow away a DFS by accidentally misconfiguring dfs.data.dir and mapred.local.dir to contain several directories in common. On startup, the task tracker clears out mapred.local.dir, which obviously screws over the datanode.

      This should be a reasonably easy check to put in place to make hadoop more idiot proof (or in my case lack-of-sleep proof)

      Attachments

        Activity

          People

            Unassigned Unassigned
            tlipcon Todd Lipcon
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - 1h
                1h
                Remaining:
                Remaining Estimate - 1h
                1h
                Logged:
                Time Spent - Not Specified
                Not Specified