Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4551

Set limits on size of expression trees

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: Impala 2.8.0
    • Fix Version/s: Impala 3.3.0
    • Component/s: Backend
    • Labels:
      None

      Description

      Very large expression trees can cause havoc in various Impala components. I have been experimenting with the attached test that generates large case statements of varying depths and widths, and have been able to hit limits in the frontend (Java OOM) and caused various runaway memory usage problems in the backend (thrift structures, LLVM IR, codegen, etc).

      We should set some kind of limit here, either on the number of nodes in the expression trees, or on the size of the query text, and then make sure that we can execute queries of the maximum size end-to-end.

        Attachments

        1. huge_case.patch
          3 kB
          Tim Armstrong

          Issue Links

            Activity

              People

              • Assignee:
                joemcdonnell Joe McDonnell
                Reporter:
                tarmstrong Tim Armstrong
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: