Details
-
New Feature
-
Status: Closed
-
Trivial
-
Resolution: Invalid
-
None
-
None
-
None
-
None
-
All
Description
Since HBase already emulates appends to DFS-based HStore, and allows query on these tables, please consider implementing a LogAppender based on HBase. This will allow storage of job-logs and counters to DFS while making them query-able. Since HBase already has a web-based query interface, it will be very useful for "real-time" queries to see what is going wrong with the job.
When DFS has appends (HADOOP-1700), HBase will surely take advantage of them, but the rest of the framework need not change.