[SYSTEMDS-3254] CountDistinct Col and Row & Unique

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: SystemDS 3.1
• Fix Version/s: SystemDS 3.1
• Labels: StudentProject
• Assignee: Unassigned
• Reporter: Sebastian Baunsgaard
• Created: 14/Dec/21 13:48
• Updated: 15/Mar/23 19:14
• Resolved: 25/Aug/22 17:56

Description

 

This task is to extend the countDistinct to support column and row counting and add another alias for the same operation called 'unique'.

example test of countDistinct:

src/test/scripts/functions/countDistinct/countDistinct.dml

 

the operations to implement in this task are:

 

unique(X)

colUnique(X)

rowUnique(X)

 

colCountDistinct(X)

rowCountDistinct(X)

 

There are multiple options for the implementation, one suggestion is to extend

src/main/java/org/apache/sysds/runtime/matrix/data/sketch/MatrixSketch.java

and move the countDistinctValuesNaive method to your new implementation.

src/main/java/org/apache/sysds/runtime/matrix/data/LibMatrixCountDistinct.java

 

 

Issue Links

• links to: GitHub Pull Request #1714