Apache Drill
  1. Apache Drill
  2. DRILL-998

Limit amount of memory used by drill C++ client API

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.5.0
    • Component/s: Client - C++
    • Labels:
      None
    • Target Version/s:

      Description

      The C++ client API buffers the data that it gets back from the server and holds it until it the application has consumed it. If the application is unable to (or does not) consume the data as fast as the server is sending it back, the client API will buffer all the data, eventually running out of memory.
      The client API should limit the amount of data it buffers and block on receiving data until the application consumes the data.

        Issue Links

          Activity

          Hide
          Parth Chandra added a comment -

          Memory is limited to a configurable amount. The default is 256 MB. The actual amount of memory used may exceed the configured amount if a record batch is large and overflows the limit.

          Show
          Parth Chandra added a comment - Memory is limited to a configurable amount. The default is 256 MB. The actual amount of memory used may exceed the configured amount if a record batch is large and overflows the limit.
          Hide
          Parth Chandra added a comment -

          Assigned for review

          Show
          Parth Chandra added a comment - Assigned for review
          Hide
          Jacques Nadeau added a comment -

          Hanifi, please review.

          Show
          Jacques Nadeau added a comment - Hanifi, please review.
          Hide
          Jacques Nadeau added a comment -
          Show
          Jacques Nadeau added a comment - Review link: https://reviews.apache.org/r/23095/

            People

            • Assignee:
              DrillCommitter
              Reporter:
              Parth Chandra
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Due:
                Created:
                Updated:
                Resolved:

                Development