Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Incomplete
-
None
-
None
-
None
-
None
Description
Right now users have to specify a directory of the HDFS to be consumed. Many other systems support the idea of "LATEST" file/directory. For example, if we have:
/data/database/db1/snapshot-2016-09-10
/data/database/db1/snapshot-2016-09-11
Then "/data/database/db1/#LATEST" will automatically point to "/data/database/db1/snapshot-2016-09-11"
We want to implement such a feature.
Plus, we also want to support the consumption of single file.