Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-17531

Don't initialize Hive Listeners for the Execution Client

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.0.0
    • 1.6.3, 2.0.1, 2.1.0
    • SQL
    • None

    Description

      If a user provides listeners inside the Hive Conf, the configuration for these listeners are passed to the Hive Execution Client as well. This may cause issues for two reasons:
      1. The Execution Client will actually generate garbage
      2. The listener class needs to be both in the Spark Classpath and Hive Classpath

      The configuration can be overwritten within

      HiveUtils.newTemporaryConfiguration
      

      Attachments

        Activity

          People

            brkyvz Burak Yavuz
            brkyvz Burak Yavuz
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: