[IOTDB-560] Add Flink Connector Support for TsFile

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.11.0
• Component/s: Others
• Labels: pull-request-available
• Assignee: Wei Zhong
• Reporter: sunjincheng
• Created: 19/Mar/20 01:09
• Updated: 21/Jan/21 14:23
• Resolved: 21/Jan/21 14:23

Description

TsFile is a columnar storage file format in Apache IoTDB. It is designed for time series data and supports efficient compression and query and is easy to be integrated into big data processing frameworks.

Apache Flink is a framework and distributed processing engine for stateful computations over unbounded and bounded data streams and becoming more and more popular in IOT scenes. So, it would be great to integrate IoTDB and Flink.

In this JIRA I would like to introduce the TsFile Flink Connector, i.e., allows Flink to read, write TsFile.

More detail can be found in discussion thread [1], or in the IoTDB wiki [2]

[1]https://lists.apache.org/thread.html/r6dd6afe4e8e4ca42e3ddfbc80609597788f90b214e7a81788c3b51b3%40%3Cdev.iotdb.apache.org%3E

[2]https://cwiki.apache.org/confluence/display/IOTDB/%5BImprovement+Proposal%5D+Add+Flink+Connector+Support+for+TsFile

Issue Links

• links to: GitHub Pull Request #947
• links to: GitHub Pull Request #1084
• links to: GitHub Pull Request #1084
• mentioned in: Page Loading...