Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6734

Add option to distcp to preserve file path structure of source files at the destination

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.0.0-alpha2
    • Fix Version/s: None
    • Component/s: distcp
    • Labels:
    • Environment:

      Software platform

    • Target Version/s:
    • Tags:
      distcp
    • Flags:
      Patch

      Description

      When copying files using distcp with globbed source files, all the matched files in the glob are copied in a single flat directory. This causes problems when the file structure at the source is important. It also is an issue when there are two files matched in the glob with the same name because it causes a duplicate file error at the target. I'd like to have an option to preserve the file structure of the source files when globbing inputs.

        Attachments

        1. MAPREDUCE-6734.3.0.0-alpha2.patch
          27 kB
          Frederick Tucker
        2. MAPREDUCE-6734.3.0.0-alpha2.patch
          26 kB
          Frederick Tucker

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              fctucker Frederick Tucker
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - 24h
                24h
                Remaining:
                Remaining Estimate - 24h
                24h
                Logged:
                Time Spent - Not Specified
                Not Specified