Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-265 Revisit append
  3. HDFS-543

Break FSDatasetInterface#writeToBlock() into writeToTemporary, writeToRBW, and append

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: Append Branch
    • Fix Version/s: Append Branch
    • Component/s: datanode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      FSDatasetInterface#writeToBlock() currently allows to create/recover a temporary replica, create/recover a RBW replica, or append to a replica. The implementation of the method in FSDataset is very complicated and error prone. I'd like to break this method into 3:
      1. writeToTemporary allows to create a Temporary replica or recover from a packet error for a Tempoary replica;
      2. writeToRBW allows to create a RBW replica or recover from a packet error for a RBW replica;
      3. append allows to append to an existing Finalized replica.

        Attachments

        1. writeToReplica.patch
          41 kB
          Hairong Kuang
        2. writeToReplica1.patch
          31 kB
          Hairong Kuang
        3. writeToReplica2.patch
          44 kB
          Hairong Kuang
        4. writeToReplica3.patch
          46 kB
          Hairong Kuang

          Activity

            People

            • Assignee:
              hairong Hairong Kuang
              Reporter:
              hairong Hairong Kuang
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: