[FLINK-31749] The Using Hadoop OutputFormats example is not avaliable for DataStream

• Type: Improvement
• Status: Resolved
• Priority: Not a Priority
• Resolution: Fixed
• Affects Version/s: 1.17.0, 1.15.4
• Fix Version/s: cassandra-3.2.0
• Component/s: Documentation
• Labels: pull-request-available stale-assigned
• Assignee: Etienne Chauchot
• Reporter: junzhong qin
• Created: 07/Apr/23 02:38
• Updated: 19/Apr/24 09:25
• Resolved: 16/Aug/23 08:21

Description

The following example shows how to use Hadoop’s TextOutputFormat from the doc: https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/connectors/datastream/formats/hadoop/#using-hadoop-outputformats . But the DataStream has no output().

// Obtain the result we want to emit
DataStream<Tuple2<Text, IntWritable>> hadoopResult = [...]

// Set up the Hadoop TextOutputFormat.
HadoopOutputFormat<Text, IntWritable> hadoopOF =
  // create the Flink wrapper.
  new HadoopOutputFormat<Text, IntWritable>(
    // set the Hadoop OutputFormat and specify the job.
    new TextOutputFormat<Text, IntWritable>(), job
  );
hadoopOF.getConfiguration().set("mapreduce.output.textoutputformat.separator", " ");
TextOutputFormat.setOutputPath(job, new Path(outputPath));

// Emit data using the Hadoop TextOutputFormat.
hadoopResult.output(hadoopOF); 

Issue Links

• links to: GitHub Pull Request #13
• links to: GitHub Pull Request #22527