Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-30710

SPARK 2.4.4 - DROP TABLE and drop HDFS

    XMLWordPrintableJSON

Details

    • Question
    • Status: Resolved
    • Major
    • Resolution: Invalid
    • 2.4.4
    • None
    • Deploy

    Description

      Hi all,

      I need to DROP a hive table and clear data in HDFS. But I can't convert it from External to Managed (I have to create external table for my business).

      On Spark 2.0.2, I can use script ALTER TABLE <tbl_name> SET TBLPROPERTIES ('EXTERNAL' = 'FALSE'); then I execute script DROP TABLE <tbl_name>; metadata and data was deleted together.

      But on spark 2.4.4, it's not work. I need a solution for that (drop a external table and drop data in hdfs or convert a external table to managed table and drop it).

      Many thanks.

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            meocon Nguyen Nhanduc
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: