Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-8195

Erasure coding: Fix file quota change when we complete/commit the striped blocks

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • HDFS-7285
    • HDFS-7285
    • None
    • None
    • Reviewed

    Description

      Fix file quota change when converting a file with striped blocks from complete/under-construction to under-construction/complete state. When we add a new block (FSDirectory#addBlock) we update the quota using the full block size (since we do not know how much data the user will write to
      the new block), and when we complete/commit the block, the quota is updated based on the block's real size (FSNamesystem#commitOrCompleteLastBlock). Currently these two places only support contiguous blocks (using INodeFile#getPreferredBlockSize as the full block size). We should update them for striped blocks.

      Attachments

        1. HDFS-8195-HDFS-7285.3.patch
          10 kB
          Takuya Fukudome
        2. HDFS-8195-HDFS-7285.2.patch
          10 kB
          Zhe Zhang
        3. HDFS-8195.1.patch
          10 kB
          Takuya Fukudome

        Activity

          People

            tfukudom Takuya Fukudome
            tfukudom Takuya Fukudome
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: