Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15359

EC: Allow closing a file with committed blocks

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.4.0
    • Component/s: erasure-coding
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Presently, dfs.namenode.file.close.num-committed-allowed is ignored in case of EC blocks. But in case of heavy loads, IBR's from Datanode may get delayed and cause the file write to fail. So, can allow EC files to close with blocks in committed state as REP files

        Attachments

        1. HDFS-15359-05.patch
          8 kB
          Ayush Saxena
        2. HDFS-15359-04.patch
          7 kB
          Ayush Saxena
        3. HDFS-15359-03.patch
          5 kB
          Ayush Saxena
        4. HDFS-15359-02.patch
          3 kB
          Ayush Saxena
        5. HDFS-15359-01.patch
          5 kB
          Ayush Saxena

          Issue Links

            Activity

              People

              • Assignee:
                ayushtkn Ayush Saxena
                Reporter:
                ayushtkn Ayush Saxena
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: