Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8548 Integrate with remote Spark context after HIVE-8528 [Spark Branch]
  3. HIVE-8835

identify dependency scope for Remote Spark Context.[Spark Branch]

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.1.0
    • Spark

    Description

      While submit job through Remote Spark Context, spark RDD graph generation and job submit is executed in remote side, so we have to add hive related dependency into its classpath with spark.driver.extraClassPath. instead of add all hive/hadoop dependency, we should narrow the scope and identify what dependency remote spark context required.

      Attachments

        1. HIVE-8835.1-spark.patch
          0.5 kB
          Chengxiang Li

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue HIVE-8833 Unify spark client API and implement remote spark client.[Spark Branch]

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              chengxiang li Chengxiang Li
              chengxiang li Chengxiang Li
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: