Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7240 Scaling HDFS
  3. HDFS-12488

Ozone: OzoneRestClient timeout is not configurable

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • HDFS-7240
    • HDFS-7240
    • ozone
    • Reviewed

    Description

      When I test ozone on a 15 nodes cluster with millions of keys, responses of rest client becomes to be slower. Following call times out after default 5s,

      bin/hdfs oz -listBucket  http://15oz1.fyre.ibm.com:9864/vol-0-84022 -user wwei
      Command Failed : {"httpCode":0,"shortMessage":"Read timed out","resource":null,"message":"Read timed out","requestID":null,"hostName":null}
      

      Then I increase the timeout by explicitly setting following property in ozone-site.xml

       <property>
          <name>ozone.client.socket.timeout.ms</name>
          <value>10000</value>
        </property>
      

      but this doesn't work and rest clients are still created with default 5s timeout. This needs to be fixed. Just like DFSClient, we should make OzoneRestClient to be configuration awareness, so that clients can adjust client configuration on demand.

      Attachments

        1. HDFS-12488-HDFS-7240.001.patch
          0.8 kB
          Weiwei Yang

        Activity

          People

            cheersyang Weiwei Yang
            cheersyang Weiwei Yang
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: