Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9991

Cannot do a SELECT on external tables that are on S3 due to Encryption error

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.0.0
    • 1.2.0
    • None
    • None

    Description

      I cannot do any select query on external tables that are not part of HDFS. For example S3.

      Select * from my_table limit 10;
      
      FAILED: SemanticException Unable to determine if s3n://my-bucket/is encrypted: java.lang.IllegalArgumentException: Wrong FS: s3n://my-bucket/, expected: hdfs://0.0.0.0:8020
      

      This error is due to a internal function that checks if a table is encrypted or not. This is only supported on HDFS files, but the check is happening on any external table as well causing the above error.

      To fix this, we should check for encrypted tables only for HDFS tables. And skip the check for any other file schema.

      Attachments

        1. HIVE-9991.1.patch
          16 kB
          Sergio Peña
        2. HIVE-9991.2.patch
          16 kB
          Sergio Peña
        3. HIVE-9991.3.patch
          17 kB
          Sergio Peña
        4. HIVE-9991.4.patch
          17 kB
          Sergio Peña

        Activity

          People

            spena Sergio Peña
            spena Sergio Peña
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: