Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11697

Use larger value for fs.s3a.connection.timeout.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Duplicate
    • 2.6.0
    • 3.0.0
    • None
    • fs/s3a fs

    Description

      The default value of fs.s3a.connection.timeout is 50000 milliseconds. It causes many SocketTimeoutException when uploading large files using hadoop fs -put.

      Also, the units for fs.s3a.connection.timeout and fs.s3a.connection.estaablish.timeout are milliseconds. For s3 connections, I think it is not necessary to have sub-seconds timeout value. Thus I suggest to change the time unit to seconds, to easy sys admin's job.

      Attachments

        1. HDFS-7908.000.patch
          4 kB
          Lei (Eddy) Xu
        2. HADOOP-11697.001.patch
          2 kB
          Lei (Eddy) Xu

        Activity

          People

            eddyxu Lei (Eddy) Xu
            eddyxu Lei (Eddy) Xu
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: