Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4551

Set limits on size of expression trees

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 2.8.0
    • Impala 3.3.0
    • Backend
    • None

    Description

      Very large expression trees can cause havoc in various Impala components. I have been experimenting with the attached test that generates large case statements of varying depths and widths, and have been able to hit limits in the frontend (Java OOM) and caused various runaway memory usage problems in the backend (thrift structures, LLVM IR, codegen, etc).

      We should set some kind of limit here, either on the number of nodes in the expression trees, or on the size of the query text, and then make sure that we can execute queries of the maximum size end-to-end.

      Attachments

        1. huge_case.patch
          3 kB
          Tim Armstrong

        Issue Links

          Activity

            People

              joemcdonnell Joe McDonnell
              tarmstrong Tim Armstrong
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: