[SYSTEMDS-3657] smaller adjustments around the word embedding encoder

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: SystemDS 3.1
• Fix Version/s: SystemDS 3.2
• Component/s: Builtins

Language

java

• Assignee: Unassigned
• Reporter: Janardhan Pulivarthi
• Created: 04/Dec/23 03:07
• Updated: 13/Jan/24 15:20

Description

Bug fix for memory estimates of dedup block

• optimised recalc of nnz for dedup block
• add stats for spark broadcast for transformapply encoder
• added accurate mem estimate for transform apply's wordembedding in ParameterizedBuiltinOp.java

Issue Links

• links to: GitHub Pull Request #1942