Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8270

create() always retried with hardcoded timeout when file already exists with open lease

    Details

    • Hadoop Flags:
      Reviewed
    • Release Note:
      Proxy level retries will not be done on AlreadyBeingCreatedExeption for create() op.

      Description

      In Hbase we stumbled on unexpected behaviour, which could
      break things.
      HDFS-6478 fixed wrong exception
      translation, but that apparently led to unexpected bahaviour:
      clients trying to create file without override=true will be forced
      to retry hardcoded amount of time (60 seconds).
      That could break or slowdown systems, that use filesystem
      for locks (like hbase fsck did, and we got it broken HBASE-13574).

      We should make this behaviour configurable, do client really need
      to wait lease timeout to be sure that file doesn't exists, or it it should
      be enough to fail fast.

        Attachments

        1. HDFS-8270.1.patch
          6 kB
          J.Andreina
        2. HDFS-8270.2.patch
          8 kB
          J.Andreina
        3. HDFS-8270.3.patch
          9 kB
          J.Andreina
        4. HDFS-8270-branch-2.7-03.patch
          5 kB
          Vinayakumar B
        5. HDFS-8270-branch-2.6-v3.patch
          3 kB
          Chris Trezzo

          Issue Links

            Activity

              People

              • Assignee:
                andreina J.Andreina
                Reporter:
                octo47 Andrey Stepachev
              • Votes:
                1 Vote for this issue
                Watchers:
                15 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: