[HDFS-13473] DataNode update BlockKeys using mode PULL rather than PUSH from NameNode - ASF JIRA

Log work

Agile Board

Rank to Top

Rank to Bottom

Attach files

Attach Screenshot

Bulk Copy Attachments

Bulk Move Attachments

Add vote

Voters

Watch issue

Watchers

Create sub-task

Convert to sub-task

Move

Link

Clone

Labels

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Patch Available
Priority: Major
Resolution: Unresolved
Affects Version/s: None
Fix Version/s: None
Component/s: datanode
Labels:
None

Description

+underlined text+It is passive behavior about updating Block keys for DataNode currently, and it depends on if NameNode return #KeyUpdateCommand for heartbeat response.
There are several problems of this Block keys synchronization mode:
a. NameNode can't be sensed about if Block Keys reach DataNode successfully,
b. It is also not sensed for DataNode who meets some exception while receive or process heartbeat response which include BlockKeyCommand,
such as HDFS-13441 and ~~HDFS-12749~~ mentioned.
So I propose improve Push Block Keys from NameNode for DataNode to DataNode Pull Block Keys.