[FLUME-696] Exec on close decorator.

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.9.4
• Fix Version/s: 0.9.5
• Assignee: Unassigned
• Reporter: Jonathan Hsieh
• Created: 01/Jul/11 18:00
• Updated: 05/Nov/14 10:33
• Resolved: 05/Nov/14 10:33

Description

There have been several requests for a trigger than happens when a sink (such as a file) gets closed. These include changing a file name, importing/altering a hive table with new info, changing file perms, or signalling another system.

It seems that a flexible and generic mechanism would be to pass some context information and allow a program to be exec upon close. (file gets closed, exec task).

Issue Links

• is duplicated by: FLUME-670 Trigger event when sink is closed
• relates to: FLUME-74 HIVE & FLUME integration - Documentation + Code
• relates to: FLUME-499 names of incomplete files being written to hdfs should indicate they are incomplete.