[REEF-1206] Update Deserializer API to allow deserialize from remote files directly

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Implemented
• Fix Version/s: 0.14
• Assignee: Julia Wang
• Reporter: Julia Wang
• Created: 16/Feb/16 22:06
• Updated: 20/Feb/16 02:16
• Resolved: 20/Feb/16 02:16

Description

Currently Deserialize() API accept a folder as input parameter. It only works for local files as only in local case, we can guarantee all the files are copied to the same folder and the folder only contains the files that need to be deserialized.
For remote file case, the file paths are passed from upper stream, the file folder may contain some other irrelevant files. In this case, passing a set of individual file oaths would be more more sense.
For deserializer, it also needs to know the file paths are local or remote. For remote files, deserializer must use IFileSystem to access the files. For local files, normal .Net file system can be simply used.