Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-609

Create a file with the append flag does not work in HDFS

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.21.0, 0.22.0
    • 0.21.0
    • None
    • None
    • Reviewed

    Description

      HADOOP-5438 introduced a create API with flags. There are a couple of issues when the flag is set to be APPEND.
      1. The APPEND flag does not work in HDFS. Append is not as simple as changing a FileINode to be a FileINodeUnderConstruction. It also need to reopen the last block for applend if last block is not full and handle crc when the last crc chunk is not full.
      2. The API is not well thought. It has parameters like replication factor and blockSize. Those parameters do not make any sense if APPEND flag is set. But they give an application user a wrong impression that append could change a file's block size and replication factor.

      Attachments

        1. HDFS-609.patch
          8 kB
          Thomas White

        Issue Links

          Activity

            People

              tomwhite Thomas White
              hairong Hairong Kuang
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: