Details
-
Sub-task
-
Status: Open
-
Major
-
Resolution: Unresolved
-
2.1.0
-
None
-
None
Description
In ThriftJDBCBinarySerde, which we are using in FileSinkOperator to write final results, we buffer rows and store them into typed columns before writing a batch of rows to the result file. However, when vectorized rows batches are available from higher level operators, we should try to use them and avoid the extra penalty of converting from vector --> non-vector single row --> buffered thrift columns (equivalent to vector).