Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7210

Avoid two separate RPC's namenode.append() and namenode.getFileInfo() for an append call from DFSClient

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.7.0
    • Component/s: hdfs-client, namenode
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed

      Description

      Currently DFSClient does 2 RPCs to namenode for an append operation.

      append() for re-opening the file and getting the last block,
      getFileInfo() Another on to get HdfsFileState

      If we can combine result of these 2 calls and make one RPC, then it can reduce load on NameNode.

      For the backward compatibility we need to keep existing append() call as is

        Attachments

        1. HDFS-7210-001.patch
          18 kB
          Vinayakumar B
        2. HDFS-7210-002.patch
          21 kB
          Vinayakumar B
        3. HDFS-7210-003.patch
          21 kB
          Vinayakumar B
        4. HDFS-7210-004.patch
          22 kB
          Vinayakumar B
        5. HDFS-7210-005.patch
          19 kB
          Vinayakumar B
        6. HDFS-7210-006.patch
          19 kB
          Uma Maheswara Rao G

          Issue Links

            Activity

              People

              • Assignee:
                vinayakumarb Vinayakumar B
                Reporter:
                vinayakumarb Vinayakumar B
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: