Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14839

DistCp log output should contain copied and deleted files and directories

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.1
    • Fix Version/s: 2.9.0, 3.0.0-beta1
    • Component/s: tools/distcp
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      DistCp log output (specified via -log command line option) currently contains only skipped and failed (when failures are ignored via -i) files.

      It will be more useful if it also contains copied and deleted files and created directories.

      This should be fixed in https://github.com/apache/hadoop/blob/branch-2.7.1/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyMapper.java

        Attachments

        1. HDFS-10234.001.patch
          1 kB
          Yiqun Lin
        2. HDFS-10234.002.patch
          3 kB
          Yiqun Lin
        3. HDFS-10234.003.patch
          14 kB
          Yiqun Lin
        4. HDFS-10234.004.patch
          19 kB
          Yiqun Lin
        5. HDFS-10234.005.patch
          19 kB
          Yiqun Lin
        6. HADOOP-14839.006.patch
          20 kB
          Yiqun Lin
        7. HADOOP-14839-branch-2.001.patch
          20 kB
          Yiqun Lin
        8. HADOOP-14839-branch-2.002.patch
          22 kB
          Yiqun Lin

          Issue Links

            Activity

              People

              • Assignee:
                linyiqun Yiqun Lin
                Reporter:
                k.shaposhnikov@gmail.com Konstantin Shaposhnikov
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: