[ACCUMULO-4000] log recovery failed after hard reset

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 1.6.2

Environment

very large cluster, accumulo 1.6.2, hadoop 2.5.0 (cdh 5.3)

• Assignee: Eric C. Newton
• Reporter: Eric C. Newton
• Created: 16/Sep/15 15:40
• Updated: 31/Oct/16 13:37
• Resolved: 18/Sep/15 19:03

Description

Had a hardware failure on a single node within a large cluster. Tablets were migrated away, but one tablet would not recover. The Closer run by the master to release the write lease on the WAL failed repeatedly.

Afterwards, it was determined the file was small, probably just opened and used at the moment the machine failed. The block could not be recovered from any replicas.

One question raised: does the write pipeline acknowledge the sync, before the write pipeline completes?

Issue Links

• is related to: ACCUMULO-4004 open WALs prevent DN decommissioning
• relates to: ACCUMULO-4004 open WALs prevent DN decommissioning
• links to: GitHub Pull Request #176