Uploaded image for project: 'Apache Lens (Retired)'
  1. Apache Lens (Retired)
  2. LENS-831

Create a single jar for shipping with hive queries

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.4
    • 2.4
    • build

    Description

      Currently a number of jars have to be shipped along with each query apart from user extension jars for udf, serde etc. This has two side effects:

      1. Number of ClassLoader on the hive server increases (potentially causing PermGen OOM issues)
      2. Number of jar localization events in the node manager when executing a task.

      The proposal is to bundle these and create a single shaded jar and make it available in the binary distribution.

      Attachments

        1. LENS-831-V1.patch
          19 kB
          Srikanth Sundarrajan
        2. LENS-831.patch
          19 kB
          Srikanth Sundarrajan

        Issue Links

          Activity

            People

              sriksun Srikanth Sundarrajan
              sriksun Srikanth Sundarrajan
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: