[OOZIE-3381] [coordinator] Enhance logging of CoordElFunctions

• Type: Task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 5.1.0
• Fix Version/s: 5.2.0
• Component/s: coordinator
• Assignee: Andras Piros
• Reporter: Andras Piros
• Created: 09/Nov/18 12:54
• Updated: 09/Dec/19 08:54
• Resolved: 22/Nov/18 10:34

Description

When using ${coord:latest(n)} coordinator EL function inside an input dataset dependency, it's often the case that more information is needed how many HDFS URIs are being checked for each <data-in/>.

Right now we don't have this information. While debugging and fine tuning parameters like dataset frequency, initial-instance, and data-in instance, it would be very useful to know how many HDFS roundtrips are issues by the current settings CoordELFunctions#coord_latestRange_sync() and CoordELFunctions#coord_futureRange_sync() having called DFSClient#exists(). We need appropriate logging there.

Issue Links

• blocks: OOZIE-3387 Optimize coordinator data input dependency search
• links to: ReviewBoard review request