Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8270

create() always retried with hardcoded timeout when file already exists with open lease

    XMLWordPrintableJSON

Details

    • Reviewed
    • Proxy level retries will not be done on AlreadyBeingCreatedExeption for create() op.

    Description

      In Hbase we stumbled on unexpected behaviour, which could
      break things.
      HDFS-6478 fixed wrong exception
      translation, but that apparently led to unexpected bahaviour:
      clients trying to create file without override=true will be forced
      to retry hardcoded amount of time (60 seconds).
      That could break or slowdown systems, that use filesystem
      for locks (like hbase fsck did, and we got it broken HBASE-13574).

      We should make this behaviour configurable, do client really need
      to wait lease timeout to be sure that file doesn't exists, or it it should
      be enough to fail fast.

      Attachments

        1. HDFS-8270-branch-2.7-03.patch
          5 kB
          Vinayakumar B
        2. HDFS-8270-branch-2.6-v3.patch
          3 kB
          Chris Trezzo
        3. HDFS-8270.3.patch
          9 kB
          J.Andreina
        4. HDFS-8270.2.patch
          8 kB
          J.Andreina
        5. HDFS-8270.1.patch
          6 kB
          J.Andreina

        Issue Links

          Activity

            People

              andreina J.Andreina
              octo47 Andrey Stepachev
              Votes:
              1 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: