Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1972

TestUserLogCleanup test cant clean up the toBeDeleted

    Details

      Description

      All the hudson patch test builds are failing as the Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs has a folder created by the following test which doesnt seem to have read permission.

      Running org.apache.hadoop.mapred.TestUserLogCleanup
      [exec] [junit] 2010-07-14 22:24:54,027 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(174)) - Adding job_test_0001 for user-log deletion with retainTimeStamp:7200000
      ...........

      [exec] [junit] 2010-07-14 22:24:54,373 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-24-54.372_6 on /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs with original name job_20100714203911410_0002
      [exec] [junit] 2010-07-14 22:24:54,374 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-24-54.373_7 on /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs with original name job_test_0003
      [exec] [junit] 2010-07-14 22:24:54,391 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-24-54.372_6 on /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs with original name /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs/toBeDeleted/2010-07-14_22-24-54.372_6
      [exec] [junit] 2010-07-14 22:24:54,405 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(174)) - Adding job_test_0001 for user-log deletion with retainTimeStamp:7200000
      ..............
      [exec] [junit] 2010-07-14 22:24:54,441 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-2

      1. TestUserLogCleanup.log
        9 kB
        Amareshwari Sriramadasu
      2. TestCompressedEmptyMapOutputs.log
        597 kB
        Amareshwari Sriramadasu

        Issue Links

          Activity

          Hide
          Nigel Daley added a comment -

          Closing as a duplicate of the more recent MAPREDUCE-2238

          Show
          Nigel Daley added a comment - Closing as a duplicate of the more recent MAPREDUCE-2238
          Hide
          Todd Lipcon added a comment -

          Seems this is the same issue as MAPREDUCE-2238

          Show
          Todd Lipcon added a comment - Seems this is the same issue as MAPREDUCE-2238
          Hide
          Giridharan Kesavan added a comment -

          This is the permission that I see for the dir that gets created and ant clean is not able to delete this directory and fails all the builds.
          d-wx-x-x 2 <user> <group> 4.0K 2010-07-30 08:04 attempt_20100730080321169_0003_m_000003_0

          Show
          Giridharan Kesavan added a comment - This is the permission that I see for the dir that gets created and ant clean is not able to delete this directory and fails all the builds. d-wx- x -x 2 <user> <group> 4.0K 2010-07-30 08:04 attempt_20100730080321169_0003_m_000003_0
          Hide
          Giridharan Kesavan added a comment -

          updating the priority as this lets all the patch test builds fail.

          Show
          Giridharan Kesavan added a comment - updating the priority as this lets all the patch test builds fail.
          Hide
          Amareshwari Sriramadasu added a comment -

          Test log which created the non-deletable user-log directory

          Show
          Amareshwari Sriramadasu added a comment - Test log which created the non-deletable user-log directory
          Hide
          Amareshwari Sriramadasu added a comment -

          Attaching complete log for TestUserLogCleanup from the console output.

          Show
          Amareshwari Sriramadasu added a comment - Attaching complete log for TestUserLogCleanup from the console output.

            People

            • Assignee:
              Unassigned
              Reporter:
              Giridharan Kesavan
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development