Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-17531

Don't initialize Hive Listeners for the Execution Client

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0
    • Fix Version/s: 1.6.3, 2.0.1, 2.1.0
    • Component/s: SQL
    • Labels:
      None
    • Target Version/s:

      Description

      If a user provides listeners inside the Hive Conf, the configuration for these listeners are passed to the Hive Execution Client as well. This may cause issues for two reasons:
      1. The Execution Client will actually generate garbage
      2. The listener class needs to be both in the Spark Classpath and Hive Classpath

      The configuration can be overwritten within

      HiveUtils.newTemporaryConfiguration
      

        Attachments

          Activity

            People

            • Assignee:
              brkyvz Burak Yavuz
              Reporter:
              brkyvz Burak Yavuz
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: