Currently, some SQL tests with Python UDFs takes long.
In my local:
and it takes up to 9 mins in Jenkins currently.
In Python UDF tests, the number of shuffle partitions matter considerably in testing time because it requires to fork and communicate between external processes. We should reduce the number of it.