[MAPREDUCE-6889] Add Job#close API to shutdown MR client services.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.9.0, 3.0.0-beta1
• Hadoop Flags: Reviewed
• Assignee: Rohith Sharma K S
• Reporter: Rohith Sharma K S
• Created: 15/May/17 06:14
• Updated: 17/Jul/17 08:29
• Resolved: 17/Jul/17 08:14

Description

ATS1.5 uses FileSystemTimelineWriter which creates FS object on every writer initialization. If writer is not closed, then there is possibility of OOM see YARN-5438 fixes closing FS object.

TimelineClient is used by YarnClient. So all the user who uses YarnClient with ATS1.5 need to stop service properly. Otherwise there is big chance of FS object leak.

Of course MR uses YARN client submit job. If MR do not stop YarnClient then there is FS object leak.

JobClient provides a API to stop all these service using JobClient#close. But many MR clients uses Job object to submit a job. But do not stop started services by default.

So, provide a API Job#close to shutdown MR client services. This API can be utilized by caller explicitly to stop service which avoids FS leak.