[TAJO-1026] Implement Query history persistency manager.

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.10.0
• Component/s: QueryMaster, TajoMaster
• Assignee: Hyoungjun Kim
• Reporter: Hyoungjun Kim
• Created: 02/Sep/14 13:47
• Updated: 23/Mar/15 15:47
• Resolved: 06/Dec/14 09:52

Description

Currently query history stored in the memory of TajoMaster or QueryMaster. Query detail information is disappeared when the cluster is restarted. And because of memory limitations, only a few hours or a few days histories are kept.
I suggest the following features for the query history.

• Worker saves a query task history to the HDFS after finishing a query.
• QueryMaster saves a query history to the HDFS after finishing a query.
• If query is finished, Information Web server in TajoMaster shows query history in the web page, If query is running TajoMaster forward to QueryMaster.
• History data will be saved to HDFS with JSON format.
• JSON format has history file version for backward compatibility.

Issue Links

• is related to: TAJO-1136 Implement queryable virtual table for query history
• relates to: TAJO-1014 Implement query history server.
• relates to: TAJO-749 Pagination function in the WEB UI.