[FLINK-23237] Add log to print data that failed to deserialize when ignore-parse-error=true

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
• Assignee: Unassigned
• Reporter: hehuiyuan
• Created: 05/Jul/21 04:55
• Updated: 09/Jul/21 02:37

Description

Add log to print error data that failed to deserialize when set `ignore-parse-error` = `true`

 

public RowData deserialize(@Nullable byte[] message) throws IOException {
    if (message == null) {
        return null;
    }
    try {
        final JsonNode root = objectReader.readValue(message);
        return (RowData) runtimeConverter.convert(root);
    } catch (Throwable t) {
        if (ignoreParseErrors) {
            return null;
        }
        throw new IOException(
                String.format("Failed to deserialize CSV row '%s'.", new String(message)), t);
    }
}