Hi! I'm trying to load some nested JSON data and am running into a problem with arrays. I can reproduce it with a slightly modified example from the documentation:
Running this code with pyarrow 0.15.1 (I also tried 0.14) gives the following error:
I've tried various combinations and it seems like the error only appears when the total number of elements in all the "a" arrays is less than the number of rows in the file. I did not expect there to be any relationship between those things and have found nothing in the documentation about it. Is this intentional? If not, I'd suspect there's some problem in the validation step.