Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-10218

Allow writing DataSet without explicit path parameter

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Won't Fix
    • Affects Version/s: 1.6.0
    • Fix Version/s: None
    • Component/s: API / DataSet

      Description

      Currently, DataSet API has two overloaded `write` methods for using FileOutputFormat as output format, and both require a path parameter, but the output path could already be set in the FileOutputFormat object. What's more, the subclasses of FileOutputFormat mostly don't have default constructors and required a path parameter too, so users have to set output path twice in the code, like:

        String output = "hdfs:///tmp/";
        dataset.write(new TextOutputFormat<>(new Path(output)), output);
      

      So I propose to add another write helper method that requires no path parameter. May someone assign this issue to me?

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                Paul Lin Paul Lin
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: