[IMPALA-10042] ERROR: File has an invalid version number: This could be due to stale metadata. Try running "refresh <Table_name>".

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: Impala 3.2.0
• Component/s: Backend, Catalog
• Epic Color: ghx-label-6
• Assignee: Unassigned
• Reporter: kishorekumar kuruguntla
• Created: 03/Aug/20 14:39
• Updated: 24/Aug/20 17:01
• Resolved: 24/Aug/20 17:01

Description

Hi,

I am performing etl and loading Parquet table through Hive .

Ran invalidate metadata <db_name.table_name> in impala.

While trying to run "compute stats <db_name.table_name>" or running "Select count ( * ) from <db_name.table_name>" ,getting File has Invalid  Version Number.

Full Error :

ERROR: File '<full_hdfs_path>' has an invalid version number: <Random_number>
This could be due to stale metadata. Try running "refresh <db_name.table_name>".

 

 

Tried running "refresh <db_name.table_name>"  multiple times ,still  "Select count ( * )" or "Compute stats " not working.

 I am able to run "Select count ( * )  from <db_name.table_name> " in hive beeline successfully ,but in impala it is not working.

 

Seems like this issue is fixed in https://issues.apache.org/jira/browse/IMPALA-2477  ( impala 2.3.0 ). 

 But still we are facing this issue in version 3.2.0-cdh6.2.1

 

 

Issue Links

• duplicates: IMPALA-8561 ScanRanges with mtime=-1 can lead to inconsistent reads when using the file handle cache