[PARQUET-1478] Can't read spec compliant, 3-level lists via parquet-proto

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.11.0
• Fix Version/s: 1.11.0
• Component/s: parquet-mr
• Labels: pull-request-available
• Assignee: Nándor Kollár
• Reporter: Nándor Kollár
• Created: 14/Dec/18 10:20
• Updated: 07/Jan/19 16:22
• Resolved: 07/Jan/19 16:22

Description

I noticed that ProtoInputOutputFormatTest doesn't test the following case properly: when lists are written using the spec compliant 3-level structure. The test actually doesn't write 3-level list, because the passed configuration is not used at all, a new one is created each time. See attached PR.

When I fixed this test, it turned out that it is failing: now it writes the correct 3-level structure, but looks like the read path is broken. Is it indeed a bug, or I'm doing something wrong?

Issue Links

• links to: GitHub Pull Request #578