[HBASE-15983] Replication improperly discards data from end-of-wal in some cases.

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.98.0, 1.0.0, 1.1.0, 1.2.0
• Component/s: Replication
• Assignee: Sean Busbey
• Reporter: Sean Busbey
• Created: 07/Jun/16 20:46
• Updated: 11/Jun/22 18:37
• Resolved: 11/Jun/22 18:37

Description

In some particular deployments, the Replication code believes it has
reached EOF for a WAL prior to successfully parsing all bytes known to
exist in a cleanly closed file.

The underlying issue is that several different underlying problems with a WAL reader are all treated as end-of-file by the code in ReplicationSource that decides if a given WAL is completed or needs to be retried.

Sub-Tasks

• Given failure to parse a given WAL that was closed cleanly, replay the WAL.: Resolved
• clarify promises about edits from replication in ref guide: Resolved