Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10702

Add a Client API and Proxy Provider to enable stale read from Standby

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Currently, clients must always talk to the active NameNode when performing any metadata operation, which means active NameNode could be a bottleneck for scalability. One way to solve this problem is to send read-only operations to Standby NameNode. The disadvantage is that it might be a stale read.

      Here, I'm thinking of adding a Client API to enable/disable stale read from Standby which gives Client the power to set the staleness restriction.

        Attachments

        1. HDFS-10702.001.patch
          73 kB
          Jiayi Zhou
        2. HDFS-10702.002.patch
          73 kB
          Jiayi Zhou
        3. HDFS-10702.003.patch
          71 kB
          Jiayi Zhou
        4. HDFS-10702.004.patch
          74 kB
          Jiayi Zhou
        5. HDFS-10702.005.patch
          74 kB
          Jiayi Zhou
        6. HDFS-10702.006.patch
          70 kB
          Sean Mackrory
        7. HDFS-10702.007.patch
          73 kB
          Sean Mackrory
        8. HDFS-10702.008.patch
          72 kB
          Sean Mackrory
        9. StaleReadfromStandbyNN.pdf
          131 kB
          Jiayi Zhou

          Issue Links

            Activity

              People

              • Assignee:
                mackrorysd Sean Mackrory
                Reporter:
                clouderajiayi Jiayi Zhou
              • Votes:
                0 Vote for this issue
                Watchers:
                22 Start watching this issue

                Dates

                • Created:
                  Updated: