Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-4495

Allow client-side lease renewal to be retried beyond soft-limit

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.3-alpha, 0.23.5
    • Fix Version/s: 0.23.7, 2.1.0-beta
    • Component/s: hdfs-client
    • Labels:
      None

      Description

      The current lease renewal code in DFSClient gives up after several retries, if the soft limit exceeds. This causes the client to abort. Without this self destruction behavior, lease renewal can be retried infinitely due to unrelated low-level issue and prevent DFSClient and associated Connection from getting garbage collected.

      However, giving up at passage of the soft limit has been shown to be too fragile; A long GC on namenode or transient network outage can make clients fail. We need the self-destruct behavior, but clients should be allowed to retry for longer period of time.

      1. hdfs-4495.patch
        3 kB
        Kihwal Lee
      2. hdfs-4495.b023.patch
        3 kB
        Kihwal Lee
      3. hdfs-4495.patch
        3 kB
        Kihwal Lee

        Activity

          People

          • Assignee:
            Kihwal Lee
            Reporter:
            Kihwal Lee
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development