Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13139

Branch-2: S3a to use thread pool that blocks clients

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 2.8.0
    • Component/s: fs/s3
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Incompatible change
    • Release Note:
      Hide
      The configuration option 'fs.s3a.threads.core' is no longer supported. The string is still defined in org.apache.hadoop.fs.s3a.Constants.CORE_THREADS, however its value is ignored. If it is set, a warning message will be printed when initializing the S3A filesystem
      Show
      The configuration option 'fs.s3a.threads.core' is no longer supported. The string is still defined in org.apache.hadoop.fs.s3a.Constants.CORE_THREADS, however its value is ignored. If it is set, a warning message will be printed when initializing the S3A filesystem

      Description

      HADOOP-11684 is accepted into trunk, but was not applied to branch-2. I will attach a patch applicable to branch-2.

      It should be noted in CHANGES-2.8.0.txt that the config parameter 'fs.s3a.threads.core' has been been removed and the behavior of the ThreadPool for s3a has been changed.

        Attachments

        1. HADOOP-13139-001.patch
          28 kB
          Pieter Reuse
        2. HADOOP-13139-branch-2.001.patch
          28 kB
          Pieter Reuse
        3. HADOOP-13139-branch-2.002.patch
          28 kB
          Pieter Reuse
        4. HADOOP-13139-branch-2-003.patch
          29 kB
          Steve Loughran
        5. HADOOP-13139-branch-2-004.patch
          29 kB
          Steve Loughran
        6. HADOOP-13139-branch-2-005.patch
          29 kB
          Steve Loughran
        7. HADOOP-13139-branch-2-006.patch
          29 kB
          Steve Loughran

          Issue Links

            Activity

              People

              • Assignee:
                PieterReuse Pieter Reuse
                Reporter:
                PieterReuse Pieter Reuse
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: