[FLINK-6428] Add support DISTINCT in dataStream SQL

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Component/s: Table SQL / API
• Assignee: sunjincheng
• Reporter: sunjincheng
• Created: 02/May/17 11:40
• Updated: 09/Feb/18 13:45
• Resolved: 17/May/17 01:42

Description

Add support DISTINCT in dataStream SQL as follow:
DATA:

(name, age)
(kevin, 28),
(sunny, 6),
(jack, 6)

SQL:

SELECT DISTINCT age FROM MyTable"

RESULTS:

28, 6

To DataStream:

inputDS
  .keyBy() // KeyBy on all fields
  .flatMap() //  Eliminate duplicate data

fhueske do we need this feature?

Issue Links

• is blocked by: FLINK-6491 Add QueryConfig to specify state retention time for streaming queries
• links to: GitHub Pull Request #3817