Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15789

DistCp does not clean staging folder if class extends DistCp

    Details

    • Type: Bug
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: tools/distcp
    • Labels:
      None

      Description

      My code extends Distcp class and for some reason if distcp fails staging folder is not delete and this staging folder piles up occupying space on hdfs.

      After checking the code i found that cleanup() function is private. Making the cleanup() method as public, user should be able to invoke the cleanup if job fails.

      This works fine with command line argument. But fails only if we extend Distcp class.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                lawpremkumar Lawrence Andrews
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated: