XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • Examples
    • None

    Description

      This PR aims to update Scala/Python/Java examples by replacing `SQLContext` with newly added `SparkSession`.

      • Use SparkSession Builder Pattern in 154(Scala 55, Java 52, Python 47) files.
      • Add `getConf` in Python `SparkContext` class: python/pyspark/context.py
      • Replace SQLContext Singleton Pattern with SparkSession Singleton Pattern:
      • `SqlNetworkWordCount.scala`
      • `JavaSqlNetworkWordCount.java`
      • `sql_network_wordcount.py`

      Now, `SQLContexts` are used only in R examples and the following two Python examples. The python examples are untouched in this PR since it already fails some unknown issue.

      • `simple_params_example.py`
      • `aft_survival_regression.py`

      Attachments

        Activity

          People

            dongjoon Dongjoon Hyun
            dongjoon Dongjoon Hyun
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: