[FLINK-27558] Introduce a new optional option for TableStoreFactory to represent planned manifest entries

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: table-store-0.2.0
• Fix Version/s: table-store-0.2.0
• Component/s: Table Store
• Labels: pull-request-available
• Assignee: Jane Chan
• Reporter: Jane Chan
• Created: 09/May/22 15:01
• Updated: 13/May/22 04:23
• Resolved: 13/May/22 04:23

Description

When 

TableStoreFactory.onCompactTable

gets called, the planned manifest entries need to be injected back into the enriched options, and we need a new key to represent it.

The explained plan should be like

== Abstract Syntax Tree ==
LogicalSink(table=[default_catalog.default_database.T0], fields=[f0, f1, f2], hints=[[[OPTIONS options:{num-sorted-run.compaction-trigger=2, path=file:/var/folders/xd/9dp1y4vd3h56kjkvdk426l500000gn/T/junit6150615541165154705/junit667583448612916332/, compaction.scanned-manifest={"snapshotId":4,"manifestEntries":{"__DEFAULT__":{"bucket-0":[{"fileName":"data-05f48089-3b58-4a29-8274-9105bfdce224-0","minKey":["f0=6","f1=Jane Eyre","f2=9.9"],"maxKey":["f0=6","f1=Jane Eyre","f2=9.9"]},{"fileName":"data-980d06b9-50c6-4540-ae01-d5c1ff688c4d-0","minKey":["f0=5","f1=Northanger Abby","f2=8.6"],"maxKey":["f0=5","f1=Northanger Abby","f2=8.6"]},{"fileName":"data-beadf34e-9918-4abd-a271-1dcd9733dfb7-0","minKey":["f0=3","f1=The Mansfield Park","f2=7.0"],"maxKey":["f0=4","f1=Sense and Sensibility","f2=9.0"]},{"fileName":"data-5e772406-6b80-4b2f-b6cc-20bf79a11369-0","minKey":["f0=1","f1=Pride and Prejudice","f2=9.0"],"maxKey":["f0=2","f1=Emma","f2=8.5"]}]}}}}]]])
+- LogicalTableScan(table=[[default_catalog, default_database, T0]], hints=[[[OPTIONS inheritPath:[] options:{num-sorted-run.compaction-trigger=2, path=file:/var/folders/xd/9dp1y4vd3h56kjkvdk426l500000gn/T/junit6150615541165154705/junit667583448612916332/, compaction.scanned-manifest={"snapshotId":4,"manifestEntries":{"__DEFAULT__":{"bucket-0":[{"fileName":"data-05f48089-3b58-4a29-8274-9105bfdce224-0","minKey":["f0=6","f1=Jane Eyre","f2=9.9"],"maxKey":["f0=6","f1=Jane Eyre","f2=9.9"]},{"fileName":"data-980d06b9-50c6-4540-ae01-d5c1ff688c4d-0","minKey":["f0=5","f1=Northanger Abby","f2=8.6"],"maxKey":["f0=5","f1=Northanger Abby","f2=8.6"]},{"fileName":"data-beadf34e-9918-4abd-a271-1dcd9733dfb7-0","minKey":["f0=3","f1=The Mansfield Park","f2=7.0"],"maxKey":["f0=4","f1=Sense and Sensibility","f2=9.0"]},{"fileName":"data-5e772406-6b80-4b2f-b6cc-20bf79a11369-0","minKey":["f0=1","f1=Pride and Prejudice","f2=9.0"],"maxKey":["f0=2","f1=Emma","f2=8.5"]}]}}}}]]])

Issue Links

• links to: GitHub Pull Request #116