Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-1808

Large compilation unit tests fails due to high memory allocation

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Duplicate
    • None
    • 1.10.0
    • Execution - Codegen
    • None

    Description

      The buildSchema method of external sort calls allocateNew() on each vector in schema batch, which normally isn't much memory, but when there are thousands of columns, this ends up being significant. We should avoid allocating any memory for the schema batch.

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. DRILL-5117 Compile error when query a json file with 1000+columns

          • Major - Major loss of function.
          • Closed

          Activity

            People

              sharnyk Serhii Harnyk
              sphillips Steven Phillips
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: