Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14552 Über-jira: WASB client phase II: performance and testing
  3. HADOOP-14518

Customize User-Agent header sent in HTTP/HTTPS requests by WASB.

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.0-beta1
    • 2.9.0, 3.0.0-beta1
    • fs/azure
    • None
    • Hide
      WASB now includes the current Apache Hadoop version in the User-Agent string passed to Azure Blob service. Users also may include optional additional information to identify their application. See the documentation of configuration property fs.wasb.user.agent.id for further details.
      Show
      WASB now includes the current Apache Hadoop version in the User-Agent string passed to Azure Blob service. Users also may include optional additional information to identify their application. See the documentation of configuration property fs.wasb.user.agent.id for further details.
    • Patch

    Description

      WASB passes a User-Agent header to the Azure back-end. Right now, it uses the default value set by the Azure Client SDK, so Hadoop traffic doesn't appear any different from general Blob traffic. If we customize the User-Agent header, then it will enable better troubleshooting and analysis by Azure service.

      The following configuration
      <property>
      <name>fs.azure.user.agent.prefix</name>
      <value>MSFT</value>
      </property>

      set the user agent to
      User-Agent: WASB/3.0.0-alpha4-SNAPSHOT (MSFT) Azure-Storage/4.2.0 (JavaJRE 1.8.0_131; WindowsServer2012R2 6.3)

      Test Results :
      Tests run: 703, Failures: 0, Errors: 0, Skipped: 119

      Attachments

        1. HADOOP-14518-branch-2.01.patch
          27 kB
          Jitendra Nath Pandey
        2. HADOOP-14518-06.patch
          25 kB
          Georgi Chalakov
        3. HADOOP-14518-05.patch
          25 kB
          Georgi Chalakov
        4. HADOOP-14518-04.patch
          6 kB
          Georgi Chalakov
        5. HADOOP-14518-03.patch
          7 kB
          Georgi Chalakov
        6. HADOOP-14518-02.patch
          6 kB
          Georgi Chalakov
        7. HADOOP-14518-01-test.txt
          10 kB
          Georgi Chalakov
        8. HADOOP-14518-01.patch
          4 kB
          Georgi Chalakov

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Georgi Georgi Chalakov
            Georgi Georgi Chalakov
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment