Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14032 [libhdfs++] Phase 2 improvements
  3. HDFS-11437

libhdfs++: Handler for FileSystem async connect can be invoked before successful communication with active NN

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • hdfs-client
    • None

    Description

      The handler provided to FileSystem::Connect can be invoked as soon as the FS makes a connection to the standby NN rather than waiting until it connects to the active NN. This allows RPC requests to be enqueued before a real connection is made and if the active NN isn't reachable for some reason the only way to cancel is to delete the FS from another thread which kills all pending requests.

      The underlying issue is that currently the only thing that must happen for the connect handler to be invoked is a successful handshake with a NN. Connecting to the standby NN and receiving a StandbyException satisfies this requirement but it should wait until it is able to get a handshake from the active NN.

      Attachments

        Activity

          People

            James C James Clampffer
            James C James Clampffer
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: