Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9991

Cannot do a SELECT on external tables that are on S3 due to Encryption error

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1.2.0
    • Component/s: None
    • Labels:
      None

      Description

      I cannot do any select query on external tables that are not part of HDFS. For example S3.

      Select * from my_table limit 10;
      
      FAILED: SemanticException Unable to determine if s3n://my-bucket/is encrypted: java.lang.IllegalArgumentException: Wrong FS: s3n://my-bucket/, expected: hdfs://0.0.0.0:8020
      

      This error is due to a internal function that checks if a table is encrypted or not. This is only supported on HDFS files, but the check is happening on any external table as well causing the above error.

      To fix this, we should check for encrypted tables only for HDFS tables. And skip the check for any other file schema.

        Attachments

        1. HIVE-9991.1.patch
          16 kB
          Sergio Peña
        2. HIVE-9991.2.patch
          16 kB
          Sergio Peña
        3. HIVE-9991.3.patch
          17 kB
          Sergio Peña
        4. HIVE-9991.4.patch
          17 kB
          Sergio Peña

          Activity

            People

            • Assignee:
              spena Sergio Peña
              Reporter:
              spena Sergio Peña
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: