[AMBARI-12502] ambari-metrics-collector filling up root-fs causes daemon failures

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.1.1
• Component/s: ambari-metrics, stacks
• Assignee: Dmytro Sen
• Reporter: Dmytro Sen
• Created: 22/Jul/15 15:25
• Updated: 23/Jul/15 20:30
• Resolved: 23/Jul/15 18:44

Description

Ambari-metrics-collector stores data in /.

[root@ ~]# df -h
Filesystem      Size  Used Avail Use% Mounted on
/dev/vda1        16G   15G     0 100% /
tmpfs           7.8G  8.0K  7.8G   1% /dev/shm
/dev/vdb        246G  8.4G  226G   4% /grid/0

[root@~]# du -sh /var/lib/ambari-metrics-collector/*
24K     /var/lib/ambari-metrics-collector/checkpoint
4.3G    /var/lib/ambari-metrics-collector/hbase
8.4G    /var/lib/ambari-metrics-collector/hbase-tmp

Because of this, kinit succeeds, but klist etc fail.

[hdfs@~]$ klist
klist: Bad format in credentials cache while setting cache flags (ticket cache FILE:/tmp/krb5cc_505)

Ambari should recommend using non-root device

Issue Links

• links to: Review Board