Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.0, 2.9.0, 3.0.0-alpha2
    • Fix Version/s: 2.8.0, 3.0.0-alpha2
    • Component/s: fs/s3
    • Labels:
      None
    • Environment:

      landsat bucket from the UK

    • Hadoop Flags:
      Reviewed

      Description

      The ITestS3AInputStreamPerformance.testTimeToOpenAndReadWholeFileBlocks takes 15s on branch-2, but is now taking minutes.

      This is a regression, and it's surfacing on some internal branches too. Even where the code hasn't changed. It does not happen on branch-2, which has a later SDK.

        Attachments

        1. HADOOP-13871-003.patch
          12 kB
          Steve Loughran
        2. HADOOP-13871-002.patch
          11 kB
          Steve Loughran
        3. HADOOP-13871-001.patch
          2 kB
          Steve Loughran
        4. org.apache.hadoop.fs.s3a.scale.ITestS3AInputStreamPerformance-output.txt
          1.10 MB
          Steve Loughran

          Issue Links

            Activity

              People

              • Assignee:
                stevel@apache.org Steve Loughran
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: