Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23710 Upgrade the built-in Hive to 2.3.5 for hadoop-3.2
  3. SPARK-27354

Move incompatible code from the hive-thriftserver module to sql/hive-thriftserver/v1.2.1

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • SQL
    • None

    Description

      When we upgraded the built-in Hive to 2.3.4, the current hive-thriftserver module is not compatible, such as these Hive changes:

      1. HIVE-12442 HiveServer2: Refactor/repackage HiveServer2's Thrift code so that it can be used in the tasks
      2. HIVE-12237 Use slf4j as logging facade
      3. HIVE-13169 HiveServer2: Support delegation token based connection when using http transport

      So we should add a new hive-thriftserver module for Hive 2.3.4:
      1. Add a new empty module for Hive 2.3.4 named hive-thriftserverV2.
      2. Make hive-thriftserver can only be activated when testing with hadoop-2.7.
      3. Make hive-thriftserverV2 can only be activated when testing with hadoop-3.2.

       

      Attachments

        Issue Links

          Activity

            People

              yumwang Yuming Wang
              yumwang Yuming Wang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: