Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7240 Scaling HDFS
  3. HDFS-11873

Ozone: Object store handler supports reusing http client for multiple requests.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • HDFS-7240
    • ozone
    • Reviewed

    Description

      This issue was found when I worked on HDFS-11846. Instead of creating a new http client instance per request, I tried to reuse CloseableHttpClient in OzoneClient class in a PoolingHttpClientConnectionManager. However, every second request from the http client hangs, which could not get dispatched to ObjectStoreJerseyContainer. There seems to be something wrong in the netty pipeline, this jira aims to 1) fix the problem in the server side 2) use the pool for client http clients to reduce the resource overhead.

      Attachments

        1. HDFS-11873-HDFS-7240.testcase.patch
          6 kB
          Weiwei Yang
        2. HDFS-11873-HDFS-7240.001.patch
          17 kB
          Xiaoyu Yao
        3. HDFS-11873-HDFS-7240.002.patch
          17 kB
          Xiaoyu Yao
        4. HDFS-11873-HDFS-7240.003.patch
          16 kB
          Xiaoyu Yao
        5. HDFS-11873-HDFS-7240.004.patch
          16 kB
          Xiaoyu Yao

        Activity

          People

            xyao Xiaoyu Yao
            cheersyang Weiwei Yang
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: