Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2885

Running Spark actions should not need Hive on the classpath

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • None
    • 4.3.1
    • None
    • None

    Description

      SparkMain references HiveConf so we need hive-common jar on the classpath even if the Spark job has nothing to do with Hive.
      This shouldn't be the case.

      Attachments

        1. OOZIE-2885-2.patch
          0.9 kB
          Satish Saley
        2. OOZIE-2885-1.patch
          0.7 kB
          Satish Saley

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. OOZIE-3064 Add Spark SQL test for spark action

          • Major - Major loss of function.
          • Open

          Activity

            People

              satishsaley Satish Saley
              gezapeti Gézapeti
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: