Details
-
New Feature
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
Description
This is the umbrella Jira for FLIP-130, which intends to support Python DataStream API for the stateless part.
FLIP wiki page: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158866298
As we all know, Flink provides three layered APIs: the ProcessFunctions, the DataStream API and the SQL & Table API. Each API offers a different trade-off between conciseness and expressiveness and targets different use cases.
Currently, the SQL & Table API has already been supported in PyFlink. The API provides relational operations as well as user-defined functions to provide convenience for users who are familiar with python and relational programming.
Meanwhile, the DataStream API and ProcessFunctions provide more generic APIs to implement stream processing applications. The ProcessFunctions expose time and state which are the fundamental building blocks for any kind of streaming application. To cover more use cases, we are planning to cover all these APIs in PyFlink.
In this FLIP, we propose to support the Python DataStream API for the stateless part. For more detail, please refer to the FLIP wiki page. As for the stateful part, it would come later after this FLIP.
Attachments
Issue Links
- mentioned in
-
Page Loading...