[HBASE-47] option to set TTL for columns in hbase

• Type: New Feature
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.2.0
• Component/s: regionserver, util
• Assignee: Andrew Kyle Purtell
• Reporter: Billy Pearson
• Created: 17/Nov/07 17:10
• Updated: 31/Jul/10 18:31
• Resolved: 07/May/08 04:17

Description

I would like to see the option to have a TTL on the columns in hbase this feature could be helpfully in removing stale data from large datasets with out havening to do a full scan of the dataset and then issuing deletes.

Example
Say I am crawling pages and only refreshing pages based on a set score and some pages doe not get updated over X days the old version of the page gets removed from the data set.

Say I am striping out links form html and storing them say a link is removed from a page then I would need to issue a delete statement to remove that links form the data set with a ttl the link data would remove its self if not updated in x secs. These are just examples based on crawling like nutch but I can foresee many apps using this option.

This is a feature in bigtables thats is handled when bigtable does garbage-collection.

Issue Links

• incorporates: HBASE-612 HColumnDescriptor's readFields() method is version aware but its write() method is not
• is related to: HBASE-2893 Table metacolumns