Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-609

Create a file with the append flag does not work in HDFS

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.21.0, 0.22.0
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      HADOOP-5438 introduced a create API with flags. There are a couple of issues when the flag is set to be APPEND.
      1. The APPEND flag does not work in HDFS. Append is not as simple as changing a FileINode to be a FileINodeUnderConstruction. It also need to reopen the last block for applend if last block is not full and handle crc when the last crc chunk is not full.
      2. The API is not well thought. It has parameters like replication factor and blockSize. Those parameters do not make any sense if APPEND flag is set. But they give an application user a wrong impression that append could change a file's block size and replication factor.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                tomwhite Tom White
                Reporter:
                hairong Hairong Kuang
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: