[EAGLE-342] Impact Analysis based on missing blocks

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: v0.6.0
• Labels: JPM
• Assignee: Unassigned
• Reporter: Jing Ge
• Created: 13/Jun/16 10:56
• Updated: 10/Jan/22 18:53

Description

Sometimes the hadoop cluster will have missing blocks. Running jobs that are consuming the relevant files will fail. As a Hadoop cluster administrator, I want to be able to find all jobs that are failed because of missing blocks.

example log:

org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-1267816582-10.114.118.11-1392844883031:blk_9301532705_1108414260064 file=/apps/hdmi-technology/b_pandaren_kwdm/tep/amber30_test/2016/04/15/score/v3_0/group/pla_group_au/part-00040.gz