Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-931

Make writes to S3FileSystem world visible only on completion

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • fs
    • None

    Description

      Currently files written to S3 are visible to other processes as soon as the first block has been written. This is different to DFS which only makes files world visible after the stream writing to the file has closed (see FSNamesystem.completeFile).

      We could implement this by having a piece of inode metadata that indicates the visibility of the file.

      Attachments

        Activity

          People

            Unassigned Unassigned
            tomwhite Thomas White
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: