Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Won't Fix
-
None
-
None
-
None
Description
Some improvements/good_to_have features in logcondense
- logcondense currently doesn't give us a way to purge jobtracker/namenode logs, admins might want to have something like this, thought it might be used only rarely.
- Currently when purging logs, it does dfs deletes per cluster specific directly, these deletes could be batched to reduce load on and round trips to namenode.
- logcondense could take hadoop package (-p, --package) from HADOOP_HOME env var, and hadoop config (-c, --config) from HADOOP_CONF_DIR.