Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14839

DistCp log output should contain copied and deleted files and directories

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.7.1
    • 2.9.0, 3.0.0-beta1
    • tools/distcp
    • None
    • Reviewed

    Description

      DistCp log output (specified via -log command line option) currently contains only skipped and failed (when failures are ignored via -i) files.

      It will be more useful if it also contains copied and deleted files and created directories.

      This should be fixed in https://github.com/apache/hadoop/blob/branch-2.7.1/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyMapper.java

      Attachments

        1. HADOOP-14839.006.patch
          20 kB
          Yiqun Lin
        2. HADOOP-14839-branch-2.001.patch
          20 kB
          Yiqun Lin
        3. HADOOP-14839-branch-2.002.patch
          22 kB
          Yiqun Lin
        4. HDFS-10234.001.patch
          1 kB
          Yiqun Lin
        5. HDFS-10234.002.patch
          3 kB
          Yiqun Lin
        6. HDFS-10234.003.patch
          14 kB
          Yiqun Lin
        7. HDFS-10234.004.patch
          19 kB
          Yiqun Lin
        8. HDFS-10234.005.patch
          19 kB
          Yiqun Lin

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-16946 Distcp print wrong log info when use -log

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Patch Available

          Activity

            People

              linyiqun Yiqun Lin
              k.shaposhnikov@gmail.com Konstantin Shaposhnikov
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: