Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14839

DistCp log output should contain copied and deleted files and directories

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.1
    • Fix Version/s: 2.9.0, 3.0.0-beta1
    • Component/s: tools/distcp
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      DistCp log output (specified via -log command line option) currently contains only skipped and failed (when failures are ignored via -i) files.

      It will be more useful if it also contains copied and deleted files and created directories.

      This should be fixed in https://github.com/apache/hadoop/blob/branch-2.7.1/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyMapper.java

        Attachments

        1. HDFS-10234.005.patch
          19 kB
          Yiqun Lin
        2. HDFS-10234.004.patch
          19 kB
          Yiqun Lin
        3. HDFS-10234.003.patch
          14 kB
          Yiqun Lin
        4. HDFS-10234.002.patch
          3 kB
          Yiqun Lin
        5. HDFS-10234.001.patch
          1 kB
          Yiqun Lin
        6. HADOOP-14839-branch-2.002.patch
          22 kB
          Yiqun Lin
        7. HADOOP-14839-branch-2.001.patch
          20 kB
          Yiqun Lin
        8. HADOOP-14839.006.patch
          20 kB
          Yiqun Lin

          Activity

            People

            • Assignee:
              linyiqun Yiqun Lin
              Reporter:
              k.shaposhnikov@gmail.com Konstantin Shaposhnikov
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: