Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-9275

Impala refresh the ORC table does not take effect

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: Impala 3.2.0
    • Fix Version/s: None
    • Component/s: Catalog
    • Labels:
      None
    • Environment:
      Impala 3.2.0-cdh6.2.0 RELEASE+Hive 1.2.1+Spark 2.0.2
    • Epic Color:
      ghx-label-13

      Description

      I'm using Impala to refresh the ORC table created by Spark and then execute the select statement to report an error:

      Caused by: java.sql.SQLException: [Cloudera][ImpalaJDBCDriver](500051) ERROR processing query/statement. Error Code: 0, SQL state: Encountered parse error in tail of ORC file hdfs://hadoop2cluster/user/hive-1.2.1/warehouse/test.db/dim_department_adminuc/part-00000: Invalid ORC postscript length
      

      I added the sync_ddl parameter to follow the refresh operation with the same result,so I dropped the table and rebuilt with Hive,and then I can refresh and query this table and it's fine

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              dapeng dapeng
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: