Description
https://github.com/apache/spark/pull/38468 implemented Arrow-based collect but they cannot stream the result from server to the client. We can stream them if the first partition is collected first
https://github.com/apache/spark/pull/38468 implemented Arrow-based collect but they cannot stream the result from server to the client. We can stream them if the first partition is collected first