Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-992

Create CollectionDataSets by reading (client) local files.

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: API / DataSet, API / Python
    • Labels:

      Description

      CollectionDataSets are a nice way to feed data into programs.
      We could add support to read a client-local file at program construction time using a FileInputFormat, put its data into a CollectionDataSet, and ship its data together with the program.

      This would remove the need to upload small files into DFS which are used together with some large input (stored in DFS).

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              fhueske Fabian Hueske
            • Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated: