Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13139

Branch-2: S3a to use thread pool that blocks clients

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 2.8.0
    • Component/s: fs/s3
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Incompatible change
    • Release Note:
      Hide
      The configuration option 'fs.s3a.threads.core' is no longer supported. The string is still defined in org.apache.hadoop.fs.s3a.Constants.CORE_THREADS, however its value is ignored. If it is set, a warning message will be printed when initializing the S3A filesystem
      Show
      The configuration option 'fs.s3a.threads.core' is no longer supported. The string is still defined in org.apache.hadoop.fs.s3a.Constants.CORE_THREADS, however its value is ignored. If it is set, a warning message will be printed when initializing the S3A filesystem

      Description

      HADOOP-11684 is accepted into trunk, but was not applied to branch-2. I will attach a patch applicable to branch-2.

      It should be noted in CHANGES-2.8.0.txt that the config parameter 'fs.s3a.threads.core' has been been removed and the behavior of the ThreadPool for s3a has been changed.

        Attachments

        1. HADOOP-13139-001.patch
          28 kB
          Pieter Reuse
        2. HADOOP-13139-branch-2.001.patch
          28 kB
          Pieter Reuse
        3. HADOOP-13139-branch-2.002.patch
          28 kB
          Pieter Reuse
        4. HADOOP-13139-branch-2-003.patch
          29 kB
          Steve Loughran
        5. HADOOP-13139-branch-2-004.patch
          29 kB
          Steve Loughran
        6. HADOOP-13139-branch-2-005.patch
          29 kB
          Steve Loughran
        7. HADOOP-13139-branch-2-006.patch
          29 kB
          Steve Loughran

        Issue Links

          Activity

            People

            • Assignee:
              PieterReuse Pieter Reuse
              Reporter:
              PieterReuse Pieter Reuse

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment