[HDFS-15813] DataStreamer: keep sending heartbeat packets while streaming

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.3.1, 3.4.0, 3.2.3
• Component/s: hdfs
• Assignee: Jim Brennan Assign to me
• Reporter: Jim Brennan
• Created: 02/Feb/21 16:57
• Updated: 13/Jul/21 14:51
• Resolved: 05/Feb/21 23:04

Description

In response to HDFS-5032, Daryn Sharp made a change to our internal code to ensure that heartbeats continue during data steaming, even in the face of a slow disk.
As Kihwal Lee noted, absence of heartbeat during flush will be fixed in a separate jira. It doesn't look like this change was ever pushed back to apache, so I am providing it here.

Issue Links

• causes: HDFS-16127 Improper pipeline close recovery causes a permanent write failure or data loss.
• duplicates: HDFS-12763 DataStreamer should heartbeat during flush