[IMPALA-1973] Query a partitioned table cause Impala crash when data file doesn't have newline at the end.

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 2.2
• Fix Version/s: Impala 2.3.0
• Assignee: Juan Yu
• Reporter: Juan Yu
• Created: 01/May/15 17:55
• Updated: 05/May/15 19:52
• Resolved: 05/May/15 19:52

Description

IMPALA-1476 fixes the newline issue by counting the last row even if it does not have a newline at the end of file. but it doesn't fill the row with data. If there are partition key columns to materialize, this screws up offsets in the tuple and leads later on to a crash.

This can be easily reproduce by creating a partitioned table, load data from a data file without newline at the end, then select <partitionkey column> from table