Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9378

Spark qfile tests should reuse RSC [Spark Branch]

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • spark-branch
    • 1.1.0
    • Spark
    • None

    Description

      Run several qfile tests, use jps to monitor the java processes. You will find several SparkSubmitDriverBootstrapper processes are created (not the same time of course). It seems to me that we create a RSC for each qfile, then terminate it when this qfile test is done. The RSC seems not shared among qfiles.

      Attachments

        1. HIVE-9378.1-spark.patch
          359 kB
          Jimmy Xiang
        2. HIVE-9378.2-spark.patch
          182 kB
          Jimmy Xiang
        3. HIVE-9378.3-spark.patch
          184 kB
          Jimmy Xiang
        4. HIVE-9378.4-spark.patch
          181 kB
          Jimmy Xiang

        Activity

          People

            jxiang Jimmy Xiang
            jxiang Jimmy Xiang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: