Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13204 Über-jira: S3a phase III: scale and tuning
  3. HADOOP-14590

Extend and enhance S3A exception handling

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 2.8.1
    • Fix Version/s: None
    • Component/s: fs/s3
    • Labels:
      None

      Description

      S3A translateException() works OK, but we should look at improving it for diagnostics (more details), code (more specific exceptions), and, critically, for meaningful translation of other AWS services including DynamoDB, token services & key management.

      This could be followed by better retry logic, which will be easier ones exception translation is improved. In particular, we may want to hint about which exceptions may be retriable, and which ones are going to be fatal (auth)

        Attachments

          Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-14531 [Umbrella] Improve S3A error handling & reporting

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: