Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14552 Über-jira: WASB client phase II: performance and testing
  3. HADOOP-14518

Customize User-Agent header sent in HTTP/HTTPS requests by WASB.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.0-beta1
    • 2.9.0, 3.0.0-beta1
    • fs/azure
    • None
    • Hide
      WASB now includes the current Apache Hadoop version in the User-Agent string passed to Azure Blob service. Users also may include optional additional information to identify their application. See the documentation of configuration property fs.wasb.user.agent.id for further details.
      Show
      WASB now includes the current Apache Hadoop version in the User-Agent string passed to Azure Blob service. Users also may include optional additional information to identify their application. See the documentation of configuration property fs.wasb.user.agent.id for further details.
    • Patch

    Description

      WASB passes a User-Agent header to the Azure back-end. Right now, it uses the default value set by the Azure Client SDK, so Hadoop traffic doesn't appear any different from general Blob traffic. If we customize the User-Agent header, then it will enable better troubleshooting and analysis by Azure service.

      The following configuration
      <property>
      <name>fs.azure.user.agent.prefix</name>
      <value>MSFT</value>
      </property>

      set the user agent to
      User-Agent: WASB/3.0.0-alpha4-SNAPSHOT (MSFT) Azure-Storage/4.2.0 (JavaJRE 1.8.0_131; WindowsServer2012R2 6.3)

      Test Results :
      Tests run: 703, Failures: 0, Errors: 0, Skipped: 119

      Attachments

        1. HADOOP-14518-01.patch
          4 kB
          Georgi Chalakov
        2. HADOOP-14518-01-test.txt
          10 kB
          Georgi Chalakov
        3. HADOOP-14518-02.patch
          6 kB
          Georgi Chalakov
        4. HADOOP-14518-03.patch
          7 kB
          Georgi Chalakov
        5. HADOOP-14518-04.patch
          6 kB
          Georgi Chalakov
        6. HADOOP-14518-05.patch
          25 kB
          Georgi Chalakov
        7. HADOOP-14518-06.patch
          25 kB
          Georgi Chalakov
        8. HADOOP-14518-branch-2.01.patch
          27 kB
          Jitendra Nath Pandey

        Issue Links

          Activity

            People

              Georgi Georgi Chalakov
              Georgi Georgi Chalakov
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: