[MADLIB-1492] WCC: Optimize subtx count and catalog entry frequency

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: v1.19.0
• Component/s: Module: Graph
• Assignee: Orhan Kislal
• Reporter: Orhan Kislal
• Created: 05/Jan/22 02:39
• Updated: 05/Jan/22 02:40
• Resolved: 05/Jan/22 02:40

Description

WCC had a high number of plpy.execute commands. Since each call
creates a new subtransaction, it was constantly hitting the
overflow limit.

WCC also creates and dropped temp tables in each iteration.
This bloats the catalog.