Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4942

Add retry cache support in Namenode

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.1.0-beta
    • ha, namenode
    • None

    Description

      In current HA mechanism with FailoverProxyProvider and non HA setups with RetryProxy retry a request from the RPC layer. If the retried request has already been processed at the namenode, the subsequent attempts fail for non-idempotent operations such as create, append, delete, rename etc. This will cause application failures during HA failover, network issues etc.

      This jira proposes adding retry cache at the namenode to handle these failures. More details in the comments.

      Attachments

        1. HDFSRetryCache.pdf
          86 kB
          Suresh Srinivas

        Issue Links

          Activity

            People

              sureshms Suresh Srinivas
              sureshms Suresh Srinivas
              Votes:
              0 Vote for this issue
              Watchers:
              20 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: