Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11694 Über-jira: S3a phase II: robustness, scale and performance
  3. HADOOP-13614

Purge some superfluous/obsolete S3 FS tests that are slowing test runs down

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.8.0
    • 2.8.0, 3.0.0-alpha2
    • fs/s3, test
    • None
    • Reviewed

    Description

      Some of the slow test cases contain tests that are now obsoleted by newer ones. For example, ITestS3ADeleteManyFiles has the test case testOpenCreate() which writes then reads files up 25 MB.

      Have a look at which of the s3a tests are taking time, review them to see if newer tests have superceded the slow ones; and cut them where appropriate.

      Attachments

        1. HADOOP-13614-branch-2-001.patch
          2 kB
          Steve Loughran
        2. HADOOP-13614-branch-2-002.patch
          9 kB
          Steve Loughran
        3. testrun.txt
          38 kB
          Steve Loughran
        4. HADOOP-13614-branch-2-002.patch
          9 kB
          Steve Loughran
        5. HADOOP-13614-branch-2-004.patch
          38 kB
          Steve Loughran
        6. HADOOP-13614-branch-2-005.patch
          38 kB
          Chris Nauroth
        7. HADOOP-13614-branch-2-006.patch
          38 kB
          Steve Loughran
        8. HADOOP-13614-branch-2-007.patch
          53 kB
          Steve Loughran
        9. HADOOP-13614-branch-2-008.patch
          52 kB
          Steve Loughran

        Issue Links

          breaks

          Sub-task - The sub-task of the issue HADOOP-13801 regression: ITestS3AMiniYarnCluster failing

          • Major - Major loss of function.
          • Resolved
          duplicates

          Sub-task - The sub-task of the issue HADOOP-13755 Purge superfluous/obsolete S3A Tests

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is duplicated by

          Test - A new unit, integration or system test. HADOOP-13758 HADOOP-13614 pre-commit testing JIRA

          • Major - Major loss of function.
          • Resolved
          is superceded by

          Sub-task - The sub-task of the issue HADOOP-13755 Purge superfluous/obsolete S3A Tests

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          supercedes

          Sub-task - The sub-task of the issue HADOOP-13231 Isolate test path used by a few S3A tests for more reliable parallel execution.

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Web Link GitHub Pull Request #132

          Activity

            People

              stevel@apache.org Steve Loughran
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: