Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-44111 Prepare Apache Spark 4.0.0
  3. SPARK-47552

Set spark.hadoop.fs.s3a.connection.establish.timeout to 30s

    XMLWordPrintableJSON

Details

    Description

      To suppress like HADOOP-19097

      24/03/25 14:46:21 WARN ConfigurationHelper: Option fs.s3a.connection.establish.timeout is too low (5,000 ms). Setting to 15,000 ms instead

      Attachments

        Issue Links

          relates to

          Sub-task - The sub-task of the issue HADOOP-18915 Tune/extend S3A http connection and thread pool settings

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HADOOP-19097 core-default fs.s3a.connection.establish.timeout value too low -warning always printed

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Web Link GitHub Pull Request #45710

          Web Link GitHub Pull Request #46874

          Activity

            People

              dongjoon Dongjoon Hyun
              dongjoon Dongjoon Hyun
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: