[PARQUET-1850] toParquetMetadata method in ParquetMetadataConverter does not set dictionary page offset bit

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.10.1, 1.12.0
• Fix Version/s: 1.12.0
• Component/s: parquet-mr
• Flags: Patch, Important
• Assignee: Srinivas S T
• Reporter: Srinivas S T
• Created: 27/Apr/20 12:25
• Updated: 01/Jun/20 17:33
• Resolved: 01/Jun/20 17:33

Description

toParquetMetadata method converts org.apache.parquet.hadoop.metadata.ParquetMetadata to org.apache.parquet.format.FileMetaData but this does not set the dictionary page offset bit in FileMetaData.

When a FileMetaData object is serialized while writing to the footer and then deserialized, the dictionary offset is lost as the dictionary page offset bit was never set.