[FLINK-3664] Create a method to easily Summarize a DataSet

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.1.0
• Assignee: Todd Lisonbee
• Reporter: Todd Lisonbee
• Created: 23/Mar/16 17:20
• Updated: 18/Apr/16 14:48
• Resolved: 18/Apr/16 14:48

Description

Here is an example:

/**
 * Summarize a DataSet of Tuples by collecting single pass statistics for all columns
 */
public Tuple summarize()

Dataset<Tuple3<Double, String, Boolean>> input = // [...]
Tuple3<DoubleColumnSummary,StringColumnSummary,BooleanColumnSummary> summary = input.summarize()

summary.getField(0).stddev()
summary.getField(1).maxStringLength()