[HIVE-22955] PreUpgradeTool can fail because access to CharsetDecoder is not synchronized

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Component/s: Transactions
• Labels: pull-request-available
• Assignee: Hankó Gergely
• Reporter: Hankó Gergely
• Created: 02/Mar/20 08:24
• Updated: 25/Mar/20 09:29
• Resolved: 18/Mar/20 18:03

Description

2020-02-26 20:22:49,683 ERROR [main] acid.PreUpgradeTool (PreUpgradeTool.java:main(150)) - PreUpgradeTool failed org.apache.hadoop.hive.ql.metadata.HiveException at org.apache.hadoop.hive.upgrade.acid.PreUpgradeTool.prepareAcidUpgradeInternal(PreUpgradeTool.java:283) at org.apache.hadoop.hive.upgrade.acid.PreUpgradeTool.main(PreUpgradeTool.java:146) Caused by: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.IllegalStateException: Current state = RESET, new state = FLUSHED
...
Caused by: java.lang.IllegalStateException: Current state = RESET, new state = FLUSHED at java.nio.charset.CharsetDecoder.throwIllegalStateException(CharsetDecoder.java:992) at java.nio.charset.CharsetDecoder.flush(CharsetDecoder.java:675) at java.nio.charset.CharsetDecoder.decode(CharsetDecoder.java:804) at org.apache.hadoop.hive.upgrade.acid.PreUpgradeTool.needsCompaction(PreUpgradeTool.java:606) at org.apache.hadoop.hive.upgrade.acid.PreUpgradeTool.needsCompaction(PreUpgradeTool.java:567) at org.apache.hadoop.hive.upgrade.acid.PreUpgradeTool.getCompactionCommands(PreUpgradeTool.java:464) at org.apache.hadoop.hive.upgrade.acid.PreUpgradeTool.processTable(PreUpgradeTool.java:374)

This is probably caused by HIVE-21948.

Issue Links

• links to: GitHub Pull Request #936