Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14552 Über-jira: WASB client phase II: performance and testing
  3. HADOOP-14547

[WASB] the configured retry policy is not used for all storage operations.

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.9.0, 3.0.0-alpha4
    • Fix Version/s: 2.9.0, 3.0.0-alpha4
    • Component/s: fs/azure
    • Labels:
      None

      Description

      There are a few places where the WASB retry policy was not used, and instead the Azure Storage SDK default retry policy was used. These places include some calls to blob.exist(), container.exists(), blob.delete(), and operations with secure mode enabled (fs.azure.secure.mode = true).

      You can set a break point on com.microsoft.azure.storage.core.ExecutionEngine.executeWithRetry in the Azure Storage SDK and see that the WASB configured retry policy (DEFAULT_MAX_RETRY_ATTEMPTS, etc.) is not used.

        Attachments

        1. HADOOP-14547.001.patch
          9 kB
          Thomas Marqardt

          Issue Links

            Activity

              People

              • Assignee:
                tmarquardt Thomas Marqardt
                Reporter:
                tmarquardt Thomas Marqardt
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: