Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-17736 Über-JIRA: abfs phase III: Hadoop 3.3.2 features & fixes
  3. HADOOP-17691

Abfs directory delete times out on large directory tree: OperationTimedOut

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.3.0
    • Fix Version/s: None
    • Component/s: fs/azure
    • Labels:
      None

      Description

      Timeouts surfacing on abfs when a delete of a large directory tree is invoked.

      StatusDescription=Operation could not be completed within the specified time.
      ErrorCode=OperationTimedOut
      ErrorMessage=Operation could not be completed within the specified time.
      

      This has surfaced in v1 FileOutputCommitter cleanups, implying the directories created there (many many dirs, no files remaining after the job commit) is sufficient to create the problem.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated: