Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-29564

Cluster deploy mode should support Spark Thrift server

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.4.4, 3.0.0
    • None
    • Spark Submit, SQL
    • None

    Description

      Cluster deploy mode is not applicable to Spark Thrift server now. This restriction is too rude.
      In our production, we use multiple Spark Thrift servers as long running services which are used yarn-cluster mode to launch. The life cycle of STS is managed by upper layer manager system which is also used to dispatcher user's JDBC connection to applicable STS.

      Attachments

        Issue Links

          links to

          Web Link GitHub Pull Request #26223

          Activity

            People

              Unassigned Unassigned
              cltlfcjin Lantao Jin
              Votes:
              1 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: