[HBASE-15218] On RS crash and replay of WAL, loosing all Tags in Cells

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.98.13, 1.0.2, 1.2.0, 1.1.1, 2.0.0
• Fix Version/s: 1.2.0, 1.3.0, 1.1.4, 1.0.4, 0.98.18, 2.0.0
• Component/s: Recovery, regionserver, security
• Labels: needs_releasenote
• Hadoop Flags: Reviewed

Release Note

This issue fixes
- In case of normal WAL (Not encrypted) we were loosing all cell tags on WAL replay after an RS crash
- In case of encrypted WAL we were not even persisting Cell tags in WAL. Tags from all unflushed (to HFile) Cells will get lost even after WAL replay recovery is done.

As we use tags for Cell level security, this fixes 2 security issues
 - Cell level visibility labels security breach . Making a visibility restricted cell global readable
 - Cell level ACL availability issue. A user who is cell level authorized to read this cell can not read it. It is a data loss for him.

• Assignee: Anoop Sam John
• Reporter: Anoop Sam John
• Created: 05/Feb/16 07:00
• Updated: 06/Feb/16 17:52
• Resolved: 05/Feb/16 18:37

Description

The KeyValueCodec's Decoder makes NoTagsKeyValue. The WalCellCodec also makes this Decoder and so while reading Cells after RS crash, we will loose all tags in Cells. (While writing to WAL using WALCellCodec, we are preserving Cell tags.)
In case of SecureWALCellCodec, we are not even writing Cell tags to WAL.

Issue Links

• is related to: HBASE-13579 Avoid isCellTTLExpired() for NO-TAG cases