Description
Pig values support wider range than Hive. e.g. Pig BIGDECIMAL vs Hive DECIMAL. When storing Pig data into Hive table, if the value is out of range there are 2 options:
1. throw an exception.
2. write NULL instead of the value
The 1st has the drawback that it may kill the process that loads 100M rows after 90M rows have been loaded. But the 2nd may not be appropriate for all use cases.
Should add support for additional parameters in HCatStorer where the user can specify an option to controll this.
see org.apache.pig.backend.hadoop.hbase.HBaseStorage for examples
Attachments
Issue Links
- is part of
-
HIVE-5814 Add DATE, TIMESTAMP, DECIMAL, CHAR, VARCHAR types support in HCat
-
- Resolved
-