Details

    • Type: Improvement Improvement
    • Status: Reopened
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: util
    • Labels:
      None

      Description

      There should be a way to ignore specific paths (eg: those that have already been copied over under the current srcPath).

        Activity

        Hide
        Laurent Edel added a comment -

        Event if this should have been implemented in https://issues.apache.org/jira/browse/MAPREDUCE-5014, it's apparently not.

        This would be very useful, for example not trying to copy Flume files that are not flushed yet (i.e. exclude .tmp files)

        Show
        Laurent Edel added a comment - Event if this should have been implemented in https://issues.apache.org/jira/browse/MAPREDUCE-5014 , it's apparently not. This would be very useful, for example not trying to copy Flume files that are not flushed yet (i.e. exclude .tmp files)
        Hide
        Tsz Wo Nicholas Sze added a comment -

        Yes, we already have "-update". I think this is a stale issue. Closing this as "won't fix". Free feel to re-open it if this is a need.

        Show
        Tsz Wo Nicholas Sze added a comment - Yes, we already have "-update". I think this is a stale issue. Closing this as "won't fix". Free feel to re-open it if this is a need.
        Hide
        Ravi Gummadi added a comment -

        Isn't -update option good enough for doing "ignore those that have already been copied over under the current srcPath" ?

        Show
        Ravi Gummadi added a comment - Isn't -update option good enough for doing "ignore those that have already been copied over under the current srcPath" ?

          People

          • Assignee:
            Unassigned
            Reporter:
            Senthil Subramanian
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:

              Development