[IMPALA-6020] REFRESH statement cannot detect HDFS block movement

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 2.8.0, Impala 2.9.0, Impala 2.10.0
• Fix Version/s: Impala 2.13.0, Impala 3.1.0
• Component/s: Docs
• Epic Color: ghx-label-5
• Assignee: Alexandra Rodoni
• Reporter: Jim Apple
• Created: 06/Oct/17 15:36
• Updated: 04/Jun/18 16:30
• Resolved: 02/Jun/18 00:35

Description

In the release notes, it says
http://impala.apache.org/docs/build/html/topics/impala_new_features.html

The REFRESH statement now updates information about HDFS block locations. Therefore, you can perform a fast and efficient REFRESH after doing an HDFS rebalancing operation instead of the more expensive INVALIDATE METADATA statement.

However there is no change in HDFS or Impala side to support this. There may be some misunderstanding. After hdfs load balancing, user still needs to run INVALIDATE METADATA <table> to get latest block metadata.