Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-16829 Über-jira: S3A Hadoop 3.4 features
  3. HADOOP-15485

reduce/tune read failure fault injection on inconsistent client

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.1.0
    • Fix Version/s: None
    • Component/s: fs/s3, test
    • Labels:
      None

      Description

      If you crank up the s3guard directory inconsistency rate to stress test the directory listings, then the read failure rate can go up high enough that things read IO fails,.

      Maybe that read injection should only happen for the first few seconds of a stream being created, to better model delayed consistency, or least limit the #of times it can surface in a stream. (This woluld imply some kind of stream-specific binding....)

      Otherwise: provide a way to explicitly set it, including disable

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              stevel@apache.org Steve Loughran
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: