Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-992

Create CollectionDataSets by reading (client) local files.

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: DataSet API, Python API
    • Labels:

      Description

      CollectionDataSets are a nice way to feed data into programs.
      We could add support to read a client-local file at program construction time using a FileInputFormat, put its data into a CollectionDataSet, and ship its data together with the program.

      This would remove the need to upload small files into DFS which are used together with some large input (stored in DFS).

        Attachments

          Activity

            People

            • Assignee:
              nssalian Neelesh Srinivas Salian
              Reporter:
              fhueske Fabian Hueske
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated: