[HIVE-22624] Fix results_cache_invalidation and results_cache_lifetime

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Assignee: Zoltan Haindrich
• Reporter: Zoltan Haindrich
• Created: 11/Dec/19 09:53
• Updated: 17/Nov/22 08:50
• Resolved: 12/Dec/19 12:58

Description

these tests are falling together

• they both run on hive-ptest-slaves-8e2.c.gcp-hive-upstream.internal
• I suspect that they are fighting for the ownership /tmp/hive/resultscache

exception#1

2019-12-11T00:16:02,564  INFO [22d96536-983a-417d-b10c-aa1766ba0994 main] results.QueryResultsCache: Initializing query results cache at /tmp/hive/_resultscache_
2019-12-11T00:16:02,569 DEBUG [22d96536-983a-417d-b10c-aa1766ba0994 main] exec.Utilities: HDFS dir: /tmp/hive/_resultscache_ with schema null, permission: rwxr-xr-x
2019-12-11T00:16:02,571 ERROR [22d96536-983a-417d-b10c-aa1766ba0994 main] ql.Driver: FAILED: IllegalStateException java.lang.RuntimeException: The dir: /tmp/hive/_resultscache_ on HDFS should be writable. Curren
t permissions are: rwxr-xr-x
java.lang.IllegalStateException: java.lang.RuntimeException: The dir: /tmp/hive/_resultscache_ on HDFS should be writable. Current permissions are: rwxr-xr-x
        at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.checkResultsCache(SemanticAnalyzer.java:15230)
        at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:12467)
        at org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:359)
        at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:285)
        at org.apache.hadoop.hive.ql.parse.ExplainSemanticAnalyzer.analyzeInternal(ExplainSemanticAnalyzer.java:171)
        at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:285)

exception#2

2019-12-11T00:15:06,156 ERROR [5f435468-f02b-4587-ae48-517777bfdbed main] ql.Driver: FAILED: IllegalStateException java.lang.RuntimeException: The dir: /tmp/hive/_resultscache_ on HDFS should be writable. Curren
t permissions are: rwxr-xr-x
java.lang.IllegalStateException: java.lang.RuntimeException: The dir: /tmp/hive/_resultscache_ on HDFS should be writable. Current permissions are: rwxr-xr-x
        at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.checkResultsCache(SemanticAnalyzer.java:15230)
        at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:12467)
        at org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:359)