[ACCUMULO-2770] Support Local WAL Recovery in 1.6

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.6.0
• Fix Version/s: 1.6.1, 1.7.0
• Component/s: logger
• Assignee: Mike Drob
• Reporter: Mike Drob
• Created: 02/May/14 18:23
• Updated: 19/Jun/14 02:01
• Resolved: 14/May/14 14:58

Description

I had a user testing an upgrade from 1.4.5 to 1.6.0 (via 1.5.1) and they ended up with some unrecoverable data.

Not all of the WALs got copied from local directories to HDFS, and this was not noticed during the 1.4 to 1.5 upgrade (possibly due to the presence of offline tables, but we're not sure). After continuing the upgrade to 1.6, and bringing some of the tables back online, we discovered that we were missing WALs and could not recover them. We found them on local disks.

Sub-Tasks

• Local WAL Recovery breaks Hadoop 1 Compilation: Resolved
• LocalWALRecoveryTest.testRecoverLocalWriteAheadLogs:73 Wrong number of WAL files recovered. expected:<1> but was:<0>: Resolved
• LocalWALRecoveryTest throws IndexOutOfBoundsException: Resolved
• New WALog file for 1.4.x fails RAT check on OS X: Resolved