Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.2
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: fs/s3
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      S3A failures happening in the AWS library surface as AmazonClientException derivatives, rather than IOEs. As the amazon exceptions are runtime exceptions, any code which catches IOEs for error handling breaks.

      The fix will be to catch and wrap. The hard thing will be to wrap it with meaningful exceptions rather than a generic IOE. Furthermore, if anyone has been catching AWS exceptions, they are going to be disappointed. That means that fixing this situation could be considered "incompatible" —but only for code which contains assumptions about the underlying FS and the exceptions they raise.

        Attachments

        1. HADOOP-13130-016.patch
          74 kB
          Steve Loughran
        2. HADOOP-13130-branch-2-016.patch
          75 kB
          Steve Loughran
        3. HADOOP-13130-branch-2-015.patch
          75 kB
          Steve Loughran
        4. HADOOP-13130-branch-2-014.patch
          75 kB
          Steve Loughran
        5. HADOOP-13130-branch-2-013.patch
          66 kB
          Steve Loughran
        6. HADOOP-13130-branch-2-012.patch
          66 kB
          Steve Loughran
        7. HADOOP-13130-branch-2-011.patch
          66 kB
          Steve Loughran
        8. HADOOP-13130-branch-2-010.patch
          66 kB
          Steve Loughran
        9. HADOOP-13130-branch-2-009.patch
          64 kB
          Steve Loughran
        10. HADOOP-13130-branch-2-008.patch
          64 kB
          Steve Loughran
        11. HADOOP-13130-branch-2-007.patch
          64 kB
          Steve Loughran
        12. HADOOP-13130-branch-2-006.patch
          56 kB
          Steve Loughran
        13. HADOOP-13130-005.patch
          57 kB
          Steve Loughran
        14. HADOOP-13130-004.patch
          56 kB
          Steve Loughran
        15. HADOOP-13130-003.patch
          55 kB
          Steve Loughran
        16. HADOOP-13130-002.patch
          53 kB
          Steve Loughran
        17. HADOOP-13130-002.patch
          53 kB
          Daniel Takamori
        18. HADOOP-13130-001.patch
          49 kB
          Steve Loughran

          Issue Links

            Activity

              People

              • Assignee:
                stevel@apache.org Steve Loughran
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: