Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15763 Über-JIRA: abfs phase II: Hadoop 3.3 features & fixes
  3. HADOOP-16612

Track Azure Blob File System client-perceived latency

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.2.2, 3.2
    • Fix Version/s: 3.2.2, 3.2
    • Component/s: fs/azure, hdfs-client
    • Labels:
      None
    • Docs Text:
      Hide
      Add instrumentation code to time the Azure Blob File System API performance
      Add a feature switch to optionally enable this feature
      Add unit tests for correctness and performance
      Show
      Add instrumentation code to time the Azure Blob File System API performance Add a feature switch to optionally enable this feature Add unit tests for correctness and performance

      Description

      Track the end-to-end performance of ADLS Gen 2 REST APIs by measuring latency in the Hadoop ABFS driver.

      The latency information is sent back to the ADLS Gen 2 REST API endpoints in the subsequent requests.

      Here's the PR: https://github.com/apache/hadoop/pull/1611

        Attachments

        1. HADOOP-16612.001.patch
          365 kB
          Jeetesh Mangwani
        2. HADOOP-16612.002.patch
          108 kB
          Jeetesh Mangwani
        3. HADOOP-16612.003.patch
          108 kB
          Jeetesh Mangwani
        4. HADOOP-16612.004.patch
          108 kB
          Jeetesh Mangwani

          Activity

            People

            • Assignee:
              jeeteshm Jeetesh Mangwani
              Reporter:
              jeeteshm Jeetesh Mangwani
            • Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: