XMLWordPrintableJSON

Details

    Description

      It should be a seperate spark context for each user session, currently we share a singleton local spark context in all user sessions with local spark, and create remote spark context for each spark job with spark cluster.

      To binding one spark context to each user session, we may construct spark client on session open, one thing to notify is that, is SparkSession::conf is consist with Context::getConf?

      Attachments

        1. HIVE-8868.2-spark.patch
          3 kB
          Chengxiang Li
        2. HIVE-8868.2-spark.patch
          3 kB
          Chengxiang Li
        3. HIVE-8868.1-spark.patch
          2 kB
          Chengxiang Li

        Issue Links

          Activity

            People

              lirui Rui Li
              chengxiang li Chengxiang Li
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: