Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3902 Multi-threaded query execution
  3. IMPALA-4080

Share codegen work between fragment instances

          Details

          • Type: Sub-task
          • Status: Open
          • Priority: Major
          • Resolution: Unresolved
          • Affects Version/s: Impala 2.8.0
          • Fix Version/s: None
          • Component/s: Backend
          • Labels:

            Description

            With multithreading, we should find a way to share codegen modules between fragment instances to avoid redundant compilation, optimisation, etc.

              Attachments

                Issue Links

                breaks

                Bug - A problem which impairs or prevents the functions of the product. IMPALA-6262 Crash Impalad [ DataSink::Create fail which cause profile nullptr ]

                • Critical - Crashes, loss of data, severe memory leak.
                • Resolved
                incorporates

                Improvement - An improvement or enhancement to an existing feature or task. IMPALA-5192 Avoid hard coding pointer to the tuple pool into generated IR of Tuple::CodegenMaterializeExprs()

                • Major - Major loss of function.
                • Resolved
                is blocked by

                Sub-task - The sub-task of the issue IMPALA-4008 Generate codegen module without operator/query-specific constants

                • Major - Major loss of function.
                • Resolved

                Bug - A problem which impairs or prevents the functions of the product. IMPALA-4108 Move cached set_is_null/is_null/etc functions from SlotDescriptor to LlvmCodeGen

                • Minor - Minor loss of function, or other problem where easy workaround is present.
                • Resolved

                Improvement - An improvement or enhancement to an existing feature or task. IMPALA-4192 Pull all expressions in a fragment into RuntimeState

                • Major - Major loss of function.
                • Open
                is related to

                Task - A task that needs to be done. IMPALA-5356 Move Expr's fragment local states from ExprContext to Expr

                • Minor - Minor loss of function, or other problem where easy workaround is present.
                • Open

                  Activity

                    People

                    • Assignee:
                      kwho Michael Ho
                      Reporter:
                      tarmstrong Tim Armstrong
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      2 Start watching this issue

                      Dates

                      • Created:
                        Updated: