[ACCUMULO-1352] filter on !METADATA can prematurely delete loaded flags

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.4.0
• Fix Version/s: 1.4.4, 1.5.0
• Component/s: master, tserver
• Assignee: Eric C. Newton
• Reporter: Keith Turner
• Created: 26/Apr/13 16:14
• Updated: 31/May/13 20:18
• Resolved: 26/Apr/13 16:15

Description

Comments and commits against the parent ticket (ACCUMULO-1044) address multiple causes. This substask summarizes one of those causes.

Accumulo configure a filter on the metadata table that drops inactive bulk load flags. Inactive flags could be propagated by splitting tablets, and thats why this filter exist. There is a bug in the way the fitler works. It may delete active bulk load flags. If this occurs there is a small possibility that bulk loaded files could be moved. This would result in accumulo complaining about missing files.

A work around for 1.4.0 - 1.4.3 is to remove this filter from the metdata table.

  deleteiter -majc -n bulkLoadFilter -t !METADATA

Then periodically delete bulk load flags that are left by splits. Would need to add the filter back once this bug is fixed.

All svn commits related to this issue were done using the parent ticket.