Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-17319

Move addJar from HiveSessionState to HiveSharedState

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • 2.1.0
    • None
    • SQL

    Description

      aThe added jar is shared by all the sessions, because SparkContext does not support sessions. Thus, it makes more sense to move addJar from `HiveSessionState` to `HiveSharedState`

      This is also another step to remove Hive client usage in `HiveSessionState`.

      Different sessions are sharing the same class loader, and thus, `metadataHive.addJar(path)` basically loads the JARs for all the sessions. Thus, no impact is made if we move `addJar` from `HiveSessionState` to `HiveExternalCatalog`.

      Attachments

        Activity

          People

            Unassigned Unassigned
            smilegator Xiao Li
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: