Issue Details (XML | Word | Printable)

Key: HADOOP-1497
Type: Bug Bug
Status: Closed Closed
Resolution: Duplicate
Priority: Major Major
Assignee: dhruba borthakur
Reporter: dhruba borthakur
Votes: 0
Watchers: 0
Operations

If you were logged in you would be able to see more operations.
Hadoop Common

Possibility of duplicate blockids if dead-datanodes come back up after corresponding files were deleted

Created: 15/Jun/07 09:28 PM   Updated: 08/Jul/09 04:42 PM
Return to search
Component/s: None
Affects Version/s: None
Fix Version/s: None

Time Tracking:
Not Specified

Issue Links:
Duplicate
 
Reference
 

Resolution Date: 14/May/08 07:10 AM


 Description  « Hide
Suppose a datanode D has a block B that belongs to file F. Suppose the datanode D dies and the namenode replicates those blocks to other datanodes. No, suppose the user deletes file F. The namenode removes all the blocks that belonged to file F. Now, suppose a new file F1 is created and the namenode generates the same blockid B for this new file F1.

Suppose the old datanode D comes back to life. Now we have a valid corrupted block B on datanode D.

This case is possibly detected by the Client (using CRC). But does HDFS need to handle this scenario better?



 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
dhruba borthakur made changes - 15/Jun/07 09:28 PM
Field Original Value New Value
Component/s dfs [ 12310710 ]
dhruba borthakur made changes - 16/Jun/07 06:29 AM
Link This issue duplicates HADOOP-158 [ HADOOP-158 ]
dhruba borthakur made changes - 18/Jul/07 06:00 PM
Fix Version/s 0.15.0 [ 12312565 ]
Doug Cutting made changes - 10/Oct/07 09:56 PM
Fix Version/s 0.15.0 [ 12312565 ]
dhruba borthakur made changes - 16/Nov/07 06:33 AM
Link This issue is related to HADOOP-1700 [ HADOOP-1700 ]
dhruba borthakur made changes - 14/May/08 07:10 AM
Status Open [ 1 ] Resolved [ 5 ]
Fix Version/s 0.18.0 [ 12312972 ]
Resolution Duplicate [ 3 ]
Nigel Daley made changes - 22/Aug/08 07:46 PM
Fix Version/s 0.18.0 [ 12312972 ]
Doug Cutting made changes - 16/Sep/08 05:24 PM
Status Resolved [ 5 ] Closed [ 6 ]
Owen O'Malley made changes - 08/Jul/09 04:42 PM
Component/s dfs [ 12310710 ]