Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-3655

Allow comma-separated or multiple directories to be specified for FileInputFormat

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1.5.0
    • Component/s: Core
    • Labels:

      Description

      Allow comma-separated or multiple directories to be specified for FileInputFormat so that a DataSource will process the directories sequentially.

      env.readFile("/data/2016/01/01//,/data/2016/01/02//,/data/2016/01/03//")

      in Scala

      env.readFile(paths: Seq[String])
      or
      env.readFile(path: String, otherPaths: String*)

      Wildcard support would be a bonus.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                fhueske Fabian Hueske
                Reporter:
                Gna Phetsarath Gna Phetsarath
              • Votes:
                1 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: