Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3902 Multi-threaded query execution
  3. IMPALA-4008

Generate codegen module without operator/query-specific constants

Agile BoardAttach filesAttach ScreenshotVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 2.7.0
    • Impala 2.8.0
    • Backend

    Description

      Codegen'd code currently has certain operator-specific constants baked into it. E.g. the HashTableCtx address. This limits flexibility if we want to e.g. cache codegen'd objects or share codegen'd objects between different fragment instances.

      I attached a proof-of-concept codegen caching implementation based on the LLVM bitcode generated by the operators. It's interesting because a cache hit implies that the codegen'd module content was identical.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            kwho Michael Ho
            tarmstrong Tim Armstrong
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment