Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
Description
I'm hitting this from data coming from Spark while retrieving this data frame:
<database> <name> <temp>
default a TRUE
b TRUE
Error:
error: Failed to fetch data: invalid data in buffer 2
The problem is that is possible to have a NULL character array with offsets set to 0, notice that in the example above Spark returns two batches, so effectively, we are trying to parse:
<database> <name> <temp> b TRUE
Where the data array is NULL and the offsets 0s for the <database> columns.
Here is a snapshot while debugging StringArray_to_Vector:
