[HBASE-5745] SequenceFileLogReader#getPos may get wrong length on DFS restart

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Incomplete
• Affects Version/s: 0.95.2
• Component/s: wal
• Assignee: Unassigned
• Reporter: Uma Maheswara Rao G
• Created: 07/Apr/12 02:30
• Updated: 13/Jun/22 16:16
• Resolved: 11/Apr/15 01:28

Description

This is actually a kind of integration bug from Hbase perspective.

Currently HDFS will count the partial block length as 0, if there are no locations found for the partial block. This can happend opn DFS restart, before DNs completely reports to NN.

Explained the scenario in HDFS-3222. Actually this is a bug in HDFS. we may solve this in latest versions.

So, whatever the versions Hbase using may have this bug. HMaster may not be able to replay the complete edits if there is an Hmaster switch also at the same time.

Issue Links

• relates to: HDFS-3222 DFSInputStream#openInfo should not silently get the length as 0 when locations length is zero for last partial block.