[HADOOP-3808] [HOD] Include job tracker RPC in notes attribute after job submission

• Type: Improvement
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.18.0
• Fix Version/s: 0.18.0
• Component/s: contrib/hod
• Hadoop Flags: Incompatible change, Reviewed

Release Note

Modified HOD to include the RPC port of the JobTracker in the 'notes' attribute of the resource manager. The RPC port is included as the string 'Mapred RPC Port:<port number>'. Tools that depend on the value of the notes attribute must change to parse this new value.

• Assignee: Hemanth Yamijala
• Reporter: Hemanth Yamijala
• Created: 22/Jul/08 16:34
• Updated: 22/Aug/08 19:50
• Resolved: 24/Jul/08 10:36

Description

Currently, after a job is submitted, HOD records the Jobtracker URL and the NameNode URL in the 'notes' attribute of the Torque resource manager. This helps in building centralized administration tools that need to get a full picture of all allocated clusters etc. Including the Jobtracker RPC port in this attribute would be useful to build such similar tools. One of them is an idle job tracker that can be centrally run to clear up any clusters that aren't automatically cleaned up due to some faulty nodes in the cluster or resource manager problems.