[APEXMALHAR-1637] Cleanup skipping of records from setup of FSDirectoryInputOperator

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.1.0
• Component/s: adapters other
• Assignee: Chandni Singh
• Reporter: Chandni Singh
• Created: 19/Jan/15 19:37
• Updated: 03/Jan/16 10:00
• Resolved: 20/Jan/15 01:48

Description

Currently the FSDirectoryInput operator skip records in setup for unfinished and failed files.
I believe the current file is converted to an Unfinished file in definePartitions.

This logic in setup may not be needed at all as skipping of records is already taken care in emitTuples().
So we should remove it from setup(...) and make it sure it doesn't break anything.