Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-19353 Über-jira: S3A Hadoop 3.4.2 features
  3. HADOOP-14302

Test MR split optimisation with recursive listing

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.0.0-alpha2
    • None
    • fs/s3, test
    • None

    Description

      Once MAPREDUCE-5907 is in, add an S3A test which uses the metrics to measure what's happening, verify it works. If it can be made a scale test, even better

      Attachments

        Issue Links

          depends upon

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-5907 Improve getSplits() performance for fs implementations that can utilize performance gains from recursive listing

          • Major - Major loss of function.
          • Patch Available

          Activity

            People

              Unassigned Unassigned
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: