Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
1.0.0
-
None
Description
in extreme situations, due to misconfigurations, it may be possible to have 100Ks or even 1Ms of aborted txns.
This causes delete from TXNS where txn_id in (...) to have a huge IN clause and DB chokes.
Should use something like TxnHandler.TIMED_OUT_TXN_ABORT_BATCH_SIZE to break up delete into multiple queries. (Incidentally the batch size should likely be 1000, not 100, maybe even configurable).
On MySQL for example, it can cause query to fail with
Packet for query is too large (9288598 > 1048576). You can change this value on the server by setting the max_allowed_packet' variable.
Attachments
Attachments
Issue Links
- is blocked by
-
HIVE-11948 Investigate TxnHandler and CompactionTxnHandler to see where we improve concurrency
-
- Resolved
-