[FALCON-284] Hcatalog based feed retention doesn't work when partition filter spans across multiple partition keys

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.5
• Fix Version/s: 0.5
• Assignee: Satish Mittal
• Reporter: Satish Mittal
• Created: 31/Jan/14 12:15
• Updated: 24/Apr/14 10:07
• Resolved: 24/Apr/14 10:07

Description

When an HCatalog based feed is scheduled in falcon, retention only looks at the first partition key that satisfies either of date pattern: yyyy | MM | dd | HH | mm. As a result, it calculates a partition filter that contains only one of these patterns. However if HCatalog table is defined in such a way that date spans across multiple partition keys (year/month/day/hour/minute), then feed retention doesn't delete any partitions that are granular than first level (year).

Issue Links

• links to: Review Board