Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-25579

LOAD overwrite appends rather than overwriting

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • None
    • None

    Description

      The overwrite query gets converted to append.

      7b6-4b43-8452-52c44e8a2f71): LOAD DATA INPATH 'hdfs://ayushsaxena-1.ayushsaxena.root.hwx.site:8020/warehouse/tablespace/external/hive/test_ext/000000_0' OVERWRITE  INTO TABLE test_spark
      2021-09-30 03:30:23,033 INFO  org.apache.hadoop.hive.ql.lockmgr.DbTxnManager: [db2ab9c9-bf54-4304-bc06-e3bef76f2e79 HiveServer2-Handler-Pool: Thread-2600]: Opened txnid:15
      2021-09-30 03:30:23,035 INFO  org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer: [db2ab9c9-bf54-4304-bc06-e3bef76f2e79 HiveServer2-Handler-Pool: Thread-2600]: Starting caching scope for: hive_20210930033023_bb1f6dc4-d7b6-4b43-8452-52c44e8a2f71
      2021-09-30 03:30:23,042 INFO  org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer: [db2ab9c9-bf54-4304-bc06-e3bef76f2e79 HiveServer2-Handler-Pool: Thread-2600]: Load data triggered a Tez job instead of usual file operation
      2021-09-30 03:30:23,042 INFO  org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer: [db2ab9c9-bf54-4304-bc06-e3bef76f2e79 HiveServer2-Handler-Pool: Thread-2600]: Going to reparse <LOAD DATA INPATH 'hdfs://ayushsaxena-1.ayushsaxena.root.hwx.site:8020/warehouse/tablespace/external/hive/test_ext/000000_0' OVERWRITE  INTO TABLE test_spark> as
      <insert into table `default`.`test_spark` partition (`col2`) select * from test_spark__temp_table_for_load_data__>
      

      Attachments

        Activity

          People

            ayushtkn Ayush Saxena
            ayushtkn Ayush Saxena
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 20m
                20m