[HIVE-24077] Streaming Ingest v2 does not send heartbeats

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Component/s: Streaming
• Labels: pull-request-available
• Assignee: Steve Carlin
• Reporter: Matt Burgess
• Created: 26/Aug/20 17:43
• Updated: 27/Feb/24 22:23
• Resolved: 18/Sep/20 02:22

Description

In Hive Streaming v2, TransactionBatch calls setupHeartbeatThread() before setting minTxnId to an AtomicLong object, so the value that is used for HeartbeatRunnable is null. Upon the first call to run(), a NullPointerException is thrown by the minTxnId.get() call, which causes the thread to fail and it does not get rescheduled. This causes any transaction that exceeds the transaction timeout time (default 5 mins) to be aborted.

Issue Links

• links to: GitHub Pull Request #1505