[PARQUET-354] Question on parquet-protobuf and parquet-pig

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.8.0
• Component/s: parquet-mr
• Labels: question
• Assignee: Unassigned
• Reporter: Christian Nguyen Van Than
• Created: 03/Aug/15 16:05
• Updated: 03/Aug/15 16:05

Description

Hi,

I have a question about protobuf to parquet conversion.
I have a message like this (simplified) :

 
message MyMessage {
  repeated string language = 1;
}

parquet-protobuf convert it to the following schema :

message MyMessage {
  repeated binary language (UTF8);
}

But, according to TestPigSchameConverter.java, the correct schema should be :

message MyMessage {
  optional group language (LIST) {
    repeated binary value (UTF8);
  }
}

Language is an optional list of language, i want to store zero or more language.

Who have the correct schema for my case ? parquet-protobuf or parquet-pig ?