Hive
  1. Hive
  2. HIVE-7221

Beeline buffers the entire output file in memory before writing to stdout

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Invalid
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: Clients, JDBC
    • Labels:
      None

      Description

      It seems beeline does not write to stdout till it reads the entire output relation. This can cause OOM and should be fixed. Beeline should only buffer a small number of row batches.

        Issue Links

          Activity

          Hide
          Vaibhav Gumashta added a comment -

          Actually there is an option (which wasn't documented earlier) which lets you print output incrementally: beeline --incremental=true. I think we should have that true by default. Will create another jira for that.

          Show
          Vaibhav Gumashta added a comment - Actually there is an option (which wasn't documented earlier) which lets you print output incrementally: beeline --incremental=true. I think we should have that true by default. Will create another jira for that.

            People

            • Assignee:
              Unassigned
              Reporter:
              Vaibhav Gumashta
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development