Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14032 [libhdfs++] Phase 2 improvements
  3. HDFS-11437

libhdfs++: Handler for FileSystem async connect can be invoked before successful communication with active NN

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: hdfs-client
    • Labels:
      None

      Description

      The handler provided to FileSystem::Connect can be invoked as soon as the FS makes a connection to the standby NN rather than waiting until it connects to the active NN. This allows RPC requests to be enqueued before a real connection is made and if the active NN isn't reachable for some reason the only way to cancel is to delete the FS from another thread which kills all pending requests.

      The underlying issue is that currently the only thing that must happen for the connect handler to be invoked is a successful handshake with a NN. Connecting to the standby NN and receiving a StandbyException satisfies this requirement but it should wait until it is able to get a handshake from the active NN.

        Attachments

          Activity

            People

            • Assignee:
              James C James Clampffer
              Reporter:
              James C James Clampffer
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: