Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-46

mapred/local/jobTracker is not cleanup correctly

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Cannot Reproduce
    • None
    • None
    • None
    • None

    Description

      Jobtracker store 1.jar file and 1 .xml per job in /srv/hadoop/var/mapred/local/jobTracker.

      They seems to be correctly delete in most cases BUT not when a job is launch with
      Map total: 0 and Reduce total: 0
      This happen when the job doesn't find any input file to process.

      After few months, lots of disk space is lost because of that.

      This issue is different from HADOOP-2427 since it's on the jobtracker, not on the nodes, but it may be related in some way in the code (my 2 cents).

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              francisoud Benjamin Francisoud
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: