Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-36467

Creating Hive managed table from spark to Hive, results in the table being in the external directory

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.4.5
    • None
    • Spark Core, SQL
    • We use

      •  Spark 2.4.5 
      • Hive 3.1.3
      • Cloudera CDP 7.1.6

       

    Description

      Hi, 

      Whenever I try creating a managed table in Hive from Spark,

      • the tables get created in external directory in HDFS with external type and format.
      • However, I tried dropping the table from Hive and it deleted the metadata as well as the actual data in the table.  

      Attachments

        Activity

          People

            Unassigned Unassigned
            galal97 Abdullah Galal
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: