[ARROW-12312] [Rust][DataFusion] COUNT DISTINCT does not support for `Float64`

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Invalid
• Component/s: Rust - DataFusion
• External issue URL: https://github.com/apache/arrow/issues/28114
• Assignee: Unassigned
• Reporter: Andrew Lamb
• Created: 09/Apr/21 12:58
• Updated: 11/Jan/23 08:25
• Resolved: 26/Apr/21 13:33

Description

If you try to run a `COUNT (DISTINCT ..)` query on a float column you get the following error:

thread 'tokio-runtime-worker' panicked at 'Unexpected DataType for list', datafusion/src/scalar.rs:342:22

Reproducer:

 echo "foo,1.23" > /tmp/foo.csv
 ./target/debug/datafusion-cli

> CREATE EXTERNAL TABLE t (a varchar, b float) STORED AS CSV LOCATION '/tmp/foo.csv';
0 rows in set. Query took 0 seconds.
> select count(distinct a) from t;
+-------------------+
| COUNT(DISTINCT a) |
+-------------------+
| 1                 |
+-------------------+
1 rows in set. Query took 0 seconds.
> select count(distinct b) from t;
thread 'tokio-runtime-worker' panicked at 'Unexpected DataType for list', datafusion/src/scalar.rs:342:22
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
ArrowError(ExternalError(Canceled))

Issue Links

• is cloned by: ARROW-12339 [Rust][DataFusion] COUNT DISTINCT does not support for `Boolean`