[GOBBLIN-267] HiveSource creates workunit even when update time is before maxLookBackDays

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.0
• Component/s: misc
• Assignee: Aditya Sharma
• Reporter: Aditya Sharma
• Created: 26/Sep/17 16:32
• Updated: 03/Jan/18 06:41
• Resolved: 27/Sep/17 04:22

Description

org.apache.gobblin.data.management.conversion.hive.source.HiveSource creates workunit if:
1) Create time is after maxLookBackDays
2) Update time is greater than watermark

Since there are multiple policies to decide update time, it can happen that create time is greater than update time and hence maxLookBackDays will be redundant.

HiveSource should check for maxLookBackDays corresponding to update time