Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25735

Improve start-thriftserver.sh: print clean usage and exit with code 1

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.4.0
    • 3.0.0
    • Spark Core
    • None

    Description

      Currently if we run
      sh start-thriftserver.sh -h

      we get

      ...
      Thrift server options:
      2018-10-15 21:45:39 INFO HiveThriftServer2:54 - Starting SparkContext
      2018-10-15 21:45:40 INFO SparkContext:54 - Running Spark version 2.3.2
      2018-10-15 21:45:40 WARN NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
      2018-10-15 21:45:40 ERROR SparkContext:91 - Error initializing SparkContext.
      org.apache.spark.SparkException: A master URL must be set in your configuration
      at org.apache.spark.SparkContext.<init>(SparkContext.scala:367)
      at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2493)
      at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:934)
      at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:925)
      at scala.Option.getOrElse(Option.scala:121)
      at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:925)
      at org.apache.spark.sql.hive.thriftserver.SparkSQLEnv$.init(SparkSQLEnv.scala:48)
      at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2$.main(HiveThriftServer2.scala:79)
      at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2.main(HiveThriftServer2.scala)
      2018-10-15 21:45:40 ERROR Utils:91 - Uncaught exception in thread main

      After fix, the usage output is clean:
      Thrift server options:
      --hiveconf <property=value> Use value for given property

      Also exit with code 1, to follow other scripts.

      Attachments

        Activity

          People

            Gengliang.Wang Gengliang Wang
            Gengliang.Wang Gengliang Wang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: