[HIVE-15956] StackOverflowError when drop lots of partitions

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.3.0, 2.2.0
• Fix Version/s: 4.0.0-alpha-1
• Component/s: Metastore
• Assignee: Denys Kuzmenko
• Reporter: Niklaus Xiao
• Created: 17/Feb/17 01:01
• Updated: 17/Nov/22 08:55
• Resolved: 11/Sep/19 09:42

Description

Repro steps:
1. Create partitioned table and add 10000 partitions

create table test_partition(id int) partitioned by (dt int);

alter table test_partition add partition(dt=1);
alter table test_partition add partition(dt=3);
alter table test_partition add partition(dt=4);
...
alter table test_partition add partition(dt=10000);

2. Drop 9000 partitions:

alter table test_partition drop partition(dt<9000);

Step 2 will fail with StackOverflowError:

Exception in thread "pool-7-thread-161" java.lang.StackOverflowError
    at org.datanucleus.query.expression.ExpressionCompiler.isOperator(ExpressionCompiler.java:819)
    at org.datanucleus.query.expression.ExpressionCompiler.compileOrAndExpression(ExpressionCompiler.java:190)
    at org.datanucleus.query.expression.ExpressionCompiler.compileExpression(ExpressionCompiler.java:179)
    at org.datanucleus.query.expression.ExpressionCompiler.compileOrAndExpression(ExpressionCompiler.java:192)
    at org.datanucleus.query.expression.ExpressionCompiler.compileExpression(ExpressionCompiler.java:179)
    at org.datanucleus.query.expression.ExpressionCompiler.compileOrAndExpression(ExpressionCompiler.java:192)
    at org.datanucleus.query.expression.ExpressionCompiler.compileExpression(ExpressionCompiler.java:179)

Exception in thread "pool-7-thread-198" java.lang.StackOverflowError
    at org.datanucleus.query.expression.DyadicExpression.bind(DyadicExpression.java:83)
    at org.datanucleus.query.expression.DyadicExpression.bind(DyadicExpression.java:87)
    at org.datanucleus.query.expression.DyadicExpression.bind(DyadicExpression.java:87)
    at org.datanucleus.query.expression.DyadicExpression.bind(DyadicExpression.java:87)
    at org.datanucleus.query.expression.DyadicExpression.bind(DyadicExpression.java:87)
    at org.datanucleus.query.expression.DyadicExpression.bind(DyadicExpression.java:87)
    at org.datanucleus.query.expression.DyadicExpression.bind(DyadicExpression.java:87)
    at org.datanucleus.query.expression.DyadicExpression.bind(DyadicExpression.java:87)
    at org.datanucleus.query.expression.DyadicExpression.bind(DyadicExpression.java:87)
    at org.datanucleus.query.expression.DyadicExpression.bind(DyadicExpression.java:87)