[IMPALA-10447] Missing \n every 1024 or 2048 lines when exporting output from shell to a file

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 4.0.0
• Fix Version/s: Impala 4.0.0
• Component/s: Clients
• Epic Color: ghx-label-13
• Assignee: Andrew Sherman
• Reporter: Andrew Sherman
• Created: 19/Jan/21 03:06
• Updated: 03/Dec/21 05:55
• Resolved: 19/Mar/21 01:24

Description

When Impala shell exports output to a file, for example 

impala-shell -B  -V  -q "select * from tpcds.item" -o filex.csv --output_delimiter=';'

then every 1024 (or maybe 2048) rows a newline is missing.

I think the problem is here: https://github.com/apache/impala/blob/9bb7157bf014282c95ab3e233b80d77e00c95b52/shell/shell_output.py#L119
where we now use write instead of print to output the rows.
It may be sufficient to add a

out_file.write('\n')

here