Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4495

Allow client-side lease renewal to be retried beyond soft-limit

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.3-alpha, 0.23.5
    • Fix Version/s: 0.23.7, 2.1.0-beta
    • Component/s: hdfs-client
    • Labels:
      None

      Description

      The current lease renewal code in DFSClient gives up after several retries, if the soft limit exceeds. This causes the client to abort. Without this self destruction behavior, lease renewal can be retried infinitely due to unrelated low-level issue and prevent DFSClient and associated Connection from getting garbage collected.

      However, giving up at passage of the soft limit has been shown to be too fragile; A long GC on namenode or transient network outage can make clients fail. We need the self-destruct behavior, but clients should be allowed to retry for longer period of time.

        Attachments

        1. hdfs-4495.patch
          3 kB
          Kihwal Lee
        2. hdfs-4495.patch
          3 kB
          Kihwal Lee
        3. hdfs-4495.b023.patch
          3 kB
          Kihwal Lee

          Activity

            People

            • Assignee:
              kihwal Kihwal Lee
              Reporter:
              kihwal Kihwal Lee
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: