Details
-
Bug
-
Status: Open
-
Critical
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
The RBW reservation feature removed the padding of 5 block worth of space in the remaining space check. But when disks are close to being full, a small accounting errors can make block creations to fail on the datanode. One obvious source of such error is the slow control loop formed by heartbeats.
We have been testing a patch which adjusts the padding based on the heartbeat interval and it seems to be working fine. At the default 3 second heartbeat interval, the padding becomes 6 blocks, which is close to the previous value of 5. If a longer heartbeat interval is used, this will increase.