Major Description
with heap set to 50gb seeings lots of errors like this
Jul 17, 2015 3:18:14 PM WARNING: org.apache.parquet.hadoop.MemoryManager: Total allocation exceeds 95.00% (2,147,483,647 bytes) of heap memory
this is because the ratio passed into calculate the total memory is a float which when used is causing the long value to be truncate to max int32.
Fix this by making it a double instead