Uploaded image for project: 'Apache Lens (Retired)'
  1. Apache Lens (Retired)
  2. LENS-831

Create a single jar for shipping with hive queries

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.4
    • Fix Version/s: 2.4
    • Component/s: build
    • Labels:

      Description

      Currently a number of jars have to be shipped along with each query apart from user extension jars for udf, serde etc. This has two side effects:

      1. Number of ClassLoader on the hive server increases (potentially causing PermGen OOM issues)
      2. Number of jar localization events in the node manager when executing a task.

      The proposal is to bundle these and create a single shaded jar and make it available in the binary distribution.

        Attachments

        1. LENS-831.patch
          19 kB
          Srikanth Sundarrajan
        2. LENS-831-V1.patch
          19 kB
          Srikanth Sundarrajan

          Issue Links

            Activity

              People

              • Assignee:
                sriksun Srikanth Sundarrajan
                Reporter:
                sriksun Srikanth Sundarrajan
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: