[HBASE-18679] YARN may null Counters object and cause an NPE in ITBLL

• Type: Bug
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Fix Version/s: 1.4.0, 1.3.2, 1.1.13, 2.0.0, 1.2.7
• Component/s: integration tests
• Hadoop Flags: Reviewed
• Assignee: Josh Elser
• Reporter: Josh Elser
• Created: 24/Aug/17 21:51
• Updated: 01/Aug/18 06:22
• Resolved: 25/Aug/17 23:17

Description

YARN has a configuration limit to the number of counters that a job can create (to avoid some bad job from DDOS'ing the service).

When running ITBLL, we ran into this limit due to the default configuration rather low at the time. When YARN notices that the counter limit has been exceeded, it nulls out the Counters object obtained by the Job.

Presently in ITBLL, we have a few places where we (reasonably ) assume that the Counters object would be non-null. Can easily fix this with a null-check.