Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-6061

Impala needs to handle deprecation of s3n in hadoop 3.0

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: Impala 2.10.0
    • Fix Version/s: Impala 2.11.0
    • Component/s: Frontend
    • Labels:
      None
    • Epic Color:
      ghx-label-1

      Description

      Recently, support for s3n was removed from Hadoop by HADOOP-14738. All calls to s3n APIs will now throw an error:
      "The s3n:// client to Amazon S3 is no longer available: please migrate to the s3a:// client"

      This change impacts some Impala frontend tests that cover s3n. Some fail because they expect s3n to work. Some fail because the error message is different from the one expected. The failing tests are in these two test files:
      org.apache.impala.analysis.AnalyzeDDLTest
      org.apache.impala.analysis.AnalyzeStmtsTest

      Since this is only in a recent version of hadoop, Impala still needs to maintain support for s3n, but it needs to be able to run tests on this new version of hadoop.

        Attachments

          Activity

            People

            • Assignee:
              laszlog Laszlo Gaal
              Reporter:
              joemcdonnell Joe McDonnell
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: