Details
-
Improvement
-
Status: Open
-
Not a Priority
-
Resolution: Unresolved
-
None
-
None
Description
We have some business requirements that require the data handled by Flink to interact with some external programs (such as Python/Perl/shell scripts). There is no such function in the existing DataSet API, although it can be implemented by the map function, but it is not concise. It would be helpful if we could provide a pipe[1] function like Spark.
[1]: https://spark.apache.org/docs/latest/rdd-programming-guide.html#transformations
Attachments
Issue Links
- links to