Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-3140 Support multiple network interfaces
  3. HDFS-3149

The client should blacklist failed local/remote network interface pairs

    Details

    • Type: Sub-task Sub-task
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: hdfs-client
    • Labels:
      None

      Description

      If a client or worker can not connect to a given remote address, eg due to network or interface failure, then it should blacklist the local/remote interface pair. Only the pair is blacklisted in case the remote interface is routable via another local interface. The pair is black listed for a configurable period of time and another local/remote interface pair is tried. For full fault tolerance, the host interfaces need to be connected to different switches.

        Activity

        Eli Collins created issue -
        Eli Collins made changes -
        Field Original Value New Value
        Target Version/s 0.23.3 [ 12320052 ] Multiple interfaces (HDFS-3140) [ 12320556 ]
        Eli Collins made changes -
        Assignee Eli Collins [ eli2 ] Eli Collins [ eli ]

          People

          • Assignee:
            Eli Collins
            Reporter:
            Eli Collins
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:

              Development