[HIVE-14170] Beeline IncrementalRows should buffer rows and incrementally re-calculate width if TableOutputFormat is used

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.3.0
• Component/s: Beeline
• Assignee: Sahil Takiar
• Reporter: Sahil Takiar
• Created: 06/Jul/16 18:28
• Updated: 07/May/17 18:48
• Resolved: 30/Aug/16 15:36

Description

If --incremental is specified in Beeline, rows are meant to be printed out immediately. However, if TableOutputFormat is used with this option the formatting can look really off.

The reason is that IncrementalRows does not do a global calculation of the optimal width size for TableOutputFormat (it can't because it only sees one row at a time). The output of BufferedRows looks much better because it can do this global calculation.

If --incremental is used, and TableOutputFormat is used, the width should be re-calculated every "x" rows ("x" can be configurable and by default it can be 1000).

Issue Links

• links to: Review Board