Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-22120

TestHiveSparkSession.reset() should clean out Hive warehouse directory

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.2.0
    • Fix Version/s: 2.2.1, 2.3.0
    • Component/s: Tests
    • Labels:
      None

      Description

      Background: We call TestHiveSparkSession.reset() after each suite that extends TestHiveSingleton. The goal of the function is to reset all Hive-related state before the next suite.

      This task: When attempting to make some changes to the Hive-based tests, we noticed some subtle and annoying bugs related to state from one TestHiveSingleton suite affecting the results of later suites. To fix those bugs, and in the interests of making this method more complete, we should fully clean out the Hive warehouse directory in the reset() method.

        Attachments

          Activity

            People

            • Assignee:
              GregOwen Gregory Owen
              Reporter:
              GregOwen Gregory Owen
              Shepherd:
              Gregory Owen
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: