Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-17736 Über-JIRA: abfs phase III: Hadoop 3.3.2 features & fixes
  3. HADOOP-17590

ABFS: Introduce Lease Operations with Append to provide single writer semantics

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None

      Description

      The lease operations will be introduced as part of Append, Flush to ensure the single writer semantics.

       

      Details:

      Acquire Lease will be introduced in Create, Auto-Renew, Acquire will be added to Append & Release, Auto-Renew, Acquire in Flush.

       

      Duration the creation of the file the lease will be acquired, as part of appends the lease will be auto-renewed & the lease can be released as part of flush.

       

      By default the lease duration will be of 60 seconds.

      "fs.azure.write.enforcelease" & "fs.azure.write.lease.duration" two configs will be introduced.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                snehavarma Sneha Varma
                Reporter:
                sneha_varma Sneha Varma
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3h 10m
                  3h 10m