[HIVE-25907] IOW Directory queries fails to write data to final path when query result cache is enabled

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0-alpha-2
• Component/s: Hive
• Labels: pull-request-available
• Assignee: Syed Shameerur Rahman
• Reporter: Syed Shameerur Rahman
• Created: 27/Jan/22 10:54
• Updated: 10/Nov/24 18:46
• Resolved: 01/Jun/22 09:19

Description

INSERT OVERWRITE DIRECTORY queries fails to write the data to the specified directory location when query result cache is enabled.

Steps to reproduce

1. create a data file with the following data

1 abc 10.5
2 def 11.5


2. create table pointing to that data

create external table iowd(strct struct<a:int, b:string, c:string>)
row format delimited
fields terminated by '\t'
collection items terminated by ' '
location '<data_location>';


3. run the following query

set hive.query.results.cache.enabled=true;
INSERT OVERWRITE DIRECTORY "<destination directory>" SELECT * FROM iowd;

After execution of the above query, It is expected that the destination directory contains data from the table iowd, But due to HIVE-21386 it is not happening anymore.

Issue Links

• is caused by: HIVE-21386 Extend the fetch task enhancement done in HIVE-21279 to make it work with query result cache
• relates to: HIVE-28620 Query result is cached in case of IOWD if the subquery is not trivial
• links to: GitHub Pull Request #2978