Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7224 Set incremental printing to true by default in Beeline
  3. HIVE-14170

Beeline IncrementalRows should buffer rows and incrementally re-calculate width if TableOutputFormat is used

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.3.0
    • Component/s: Beeline
    • Labels:
      None

      Description

      If --incremental is specified in Beeline, rows are meant to be printed out immediately. However, if TableOutputFormat is used with this option the formatting can look really off.

      The reason is that IncrementalRows does not do a global calculation of the optimal width size for TableOutputFormat (it can't because it only sees one row at a time). The output of BufferedRows looks much better because it can do this global calculation.

      If --incremental is used, and TableOutputFormat is used, the width should be re-calculated every "x" rows ("x" can be configurable and by default it can be 1000).

        Attachments

        1. HIVE-14170.4.patch
          14 kB
          Sahil Takiar
        2. HIVE-14170.3.patch
          13 kB
          Sahil Takiar
        3. HIVE-14170.2.patch
          11 kB
          Sahil Takiar
        4. HIVE-14170.1.patch
          10 kB
          Sahil Takiar

          Issue Links

            Activity

              People

              • Assignee:
                stakiar Sahil Takiar
                Reporter:
                stakiar Sahil Takiar
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: