[HOP-4601] Parquet File Input needs support for binary encoded BigDecimal values

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.2.0
• Component/s: Transforms
• Assignee: Matt Casters
• Reporter: Matt Casters
• Created: 17/Nov/22 09:16
• Updated: 20/Nov/22 12:39
• Resolved: 20/Nov/22 12:39

Description

If we have a Binary field with a Decimal sub-type we get essentially a fixed length byte array.  We need some way to convert this back to a BigDecimal value which is Hop data type BigNumber. 

It looks like what's happening over here:

https://github.com/apache/parquet-mr/blob/master/parquet-pig/src/main/java/org/apache/parquet/pig/convert/DecimalUtils.java