[HBASE-8314] HLogSplitter can retry to open a 0-length hlog file

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.98.0, 0.95.1
• Hadoop Flags: Reviewed
• Assignee: Jimmy Xiang
• Reporter: Jimmy Xiang
• Created: 10/Apr/13 00:09
• Updated: 23/Sep/13 19:08
• Resolved: 14/Apr/13 15:25

Description

In case a HLog file is of size 0, and it is under recovery, HLogSplitter will fail to open it since it can get the file length, therefore, master can't start.

java.io.IOException: Cannot obtain block length for LocatedBlock{...; getBlockSize()=0; corrupt=false; offset=0; locs=[...]}
    at org.apache.hadoop.hdfs.DFSInputStream.readBlockLength(DFSInputStream.java:238)
    at org.apache.hadoop.hdfs.DFSInputStream.fetchLocatedBlocksAndGetLastBlockLength(DFSInputStream.java:182)
    at org.apache.hadoop.hdfs.DFSInputStream.openInfo(DFSInputStream.java:124)
    at org.apache.hadoop.hdfs.DFSInputStream.<init>(DFSInputStream.java:117)
    at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:1080)

Issue Links

• is related to: HBASE-8321 Log split worker should heartbeat to avoid timeout when the hlog is under recovery
• is related to: HBASE-8485 Retry to open a HLog on more exceptions
• relates to: HBASE-6443 HLogSplitter should ignore 0 length files