Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-6061

Impala needs to handle deprecation of s3n in hadoop 3.0

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • Impala 2.10.0
    • Impala 2.11.0
    • Frontend
    • None
    • ghx-label-1

    Description

      Recently, support for s3n was removed from Hadoop by HADOOP-14738. All calls to s3n APIs will now throw an error:
      "The s3n:// client to Amazon S3 is no longer available: please migrate to the s3a:// client"

      This change impacts some Impala frontend tests that cover s3n. Some fail because they expect s3n to work. Some fail because the error message is different from the one expected. The failing tests are in these two test files:
      org.apache.impala.analysis.AnalyzeDDLTest
      org.apache.impala.analysis.AnalyzeStmtsTest

      Since this is only in a recent version of hadoop, Impala still needs to maintain support for s3n, but it needs to be able to run tests on this new version of hadoop.

      Attachments

        Activity

          People

            laszlog Laszlo Gaal
            joemcdonnell Joe McDonnell
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: