[FLINK-17051] Persist spilled records of SpillingAdaptiveSpanningRecordDeserializer

• Type: Sub-task
• Status: Closed
• Priority: Critical
• Resolution: Duplicate
• Fix Version/s: 1.11.0
• Component/s: Runtime / Checkpointing, Runtime / Network
• Assignee: Roman Khachatryan
• Reporter: Piotr Nowojski
• Created: 08/Apr/20 13:07
• Updated: 19/May/20 15:14
• Resolved: 19/May/20 15:14

Description

Currently SpillingAdaptiveSpanningRecordDeserializer#copyToTargetSegment (which is used for unaligned checkpoints) throws UnsupportedOperationException for spilled records.

// for the case of full length, partial data in buffer
if (recordLength > THRESHOLD_FOR_SPILLING) {
	throw new UnsupportedOperationException("Unaligned checkpoint currently do not support spilled " +
		"records.");
}

Issue Links

• is duplicated by: FLINK-17547 Support unaligned checkpoints for records spilled to files