Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-44678

Downgrade Hadoop to 3.3.4

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 3.5.0
    • 3.5.0
    • Build
    • None

    Description

      There is a community report on S3A committer performance regression. Although it's one liner fix, there is no available Hadoop release with that fix at this time.

      HADOOP-18757: Bump corePoolSize of HadoopThreadPoolExecutor in s3a committer

      Attachments

        Issue Links

          relates to

          Sub-task - The sub-task of the issue SPARK-44197 Upgrade Hadoop to 3.3.6

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue SPARK-43880 Organize hadoop-cloud in standard maven project structure

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-18757 S3A Committer only finalizes the commits in a single thread

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-42913 Upgrade Hadoop to 3.3.5

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-43448 Remove dummy hadoop-openstack

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Resolved

          Activity

            People

              dongjoon Dongjoon Hyun
              dongjoon Dongjoon Hyun
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: