Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13622

`-atomic` should not be supported while using `distcp` command in object file system

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 2.7.3
    • None
    • fs/s3
    • None

    Description

      After discussing with Steve Loughran in HADOOP-13593, I get the point that none of the object stores support atomic renames. So I file a new jira and ready to provide a patch to disable `distcp -atomic` in object file system.

      Attachments

        Issue Links

        relates to

        Sub-task - The sub-task of the issue HADOOP-13655 document object store use with fs shell and distcp

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HADOOP-13593 `hadoop distcp -atomic` invokes improper host check while copying data from HDFS to Swift

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-15281 Distcp to add no-rename copy option

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            yuanbo Yuanbo Liu
            yuanbo Yuanbo Liu
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:

              Slack

                Issue deployment