[IMPALA-5021] COMPUTE STATS hang while RowsRead of one SCAN fragment winds down

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Impala 2.8.0
• Fix Version/s: Impala 2.9.0
• Component/s: Backend
• Labels: hang
• Target Version: Impala 2.9.0
• Assignee: Alexander Behm
• Reporter: Matthew Mulder
• Created: 03/Mar/17 01:02
• Updated: 08/Mar/17 02:24
• Resolved: 08/Mar/17 02:24

Description

I created a table copied from another table, but sorted, partially using Impala and partially using Hive. I invalidated the table metadata. When I run COMPUTE STATS on the table the SELECT COUNT query runs for awhile and then stops making progress. After that point, comparing snapshots of the profile reveals that only one SCAN fragment seems to be active, but its RowsRead counter is moving backwards, and even goes negative. When I kill the query and try again, the problem reproduces, hanging at the same point in the scan progress.