[HIVE-4513] disable hivehistory logs by default

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.0
• Component/s: Configuration, Logging
• Labels: TODOC12
• Assignee: Thejas Nair
• Reporter: Thejas Nair
• Created: 06/May/13 23:39
• Updated: 24/Jun/14 07:54
• Resolved: 13/Aug/13 11:58

Description

HiveHistory log files (hive_job_log_hive_*.txt files) store information about hive query such as query string, plan , counters and MR job progress information.

There is no mechanism to delete these files and as a result they get accumulated over time, using up lot of disk space.
I don't think this is used by most people, so I think it would better to turn this off by default. Jobtracker logs already capture most of this information, though it is not as structured as history logs.

Issue Links

• is blocked by: HIVE-4500 HS2 holding too many file handles of hive_job_log_hive_*.txt files
• is duplicated by: HIVE-3779 An empty value to hive.logquery.location can't disable the creation of hive history log files
• is duplicated by: HIVE-1708 make hive history file configurable
• relates to: HIVE-4374 Hive does not periodically cleanup hive.exec.scratchdir