Details
-
New Feature
-
Status: Closed
-
Major
-
Resolution: Fixed
-
1.6.0
-
None
Description
This is an umbrella JIRA tracking all enhancement and issues related to integrating Flink with Hive ecosystem. This is an outcome of a discussion in the community, and thanks go to everyone that provided feedback and interest.
Specifically, we'd like to see the following features and capabilities immediately in Flink:
- Metadata interoperability
- Data interoperability
- Data type compatibility
- Hive UDF support
- DDL/DML/Query language compatibility
For a longer term, we'd also like to add or improve:
- Compatible SQL service, client tools, JDBC/ODBC drivers
- Better task failure tolerance and task scheduling
- Support other user customizations in Hive (storage handlers, serdes, etc).
I will provide more details regarding the proposal in a doc shortly. Design doc, if deemed necessary, will be provided in each related sub tasks under this JIRA.
Feedback and contributions are greatly welcome!
Attachments
Attachments
Issue Links
- is a parent of
-
FLINK-10729 Create a Hive connector for Hive data access in Flink
- Closed
-
FLINK-10744 Integrate Flink with Hive metastore
- Resolved
- relates to
-
FLINK-10232 Add a SQL DDL
- Open
-
FLINK-10686 Introduce a flink-table-common module
- Closed
1.
|
Flink SQL calling Hive User-Defined Functions | Closed | TANG Wen-hui | ||||||||||
2.
|
Support for simple hive UDF | Closed | TANG Wen-hui | ||||||||||
3.
|
Support for Hive GenericUDF | Closed | MJ Deng |
|
|||||||||
4.
|
Support for Hive User-defined Table-generating Function (UDTF) | Closed | Zhuoluo Yang | ||||||||||
5.
|
Support for Hive's User-defined Aggregation Function (UDAF) | Closed | Zhuoluo Yang | ||||||||||
6.
|
Add user documentation for Flink-Hive integration | Closed | Unassigned |