When using hive-drop-import-delims together with direct on a MySQL database the delimiters are not dropped. I have not tested PostgreSQL yet.
I tried looking at the code but it wasn't easy to follow.
There seem to be at least two problems:
- The logic in MySQLDumpMapper.map only looks for MySQLUtils.outputDelimsAreMySQL(conf) to decide if it needs to be reparsed or not, this should also include the hive options
- This is just a guess at the real problem: The ReparsingStreamThread calls a RecordParser directly without using the created ORM classes and thus circumventing the calls to hiveStringDropDelims
|Field||Original Value||New Value|
|Status||Open [ 1 ]||Patch Available [ 10002 ]|
|Assignee||Jarek Jarcec Cecho [ jarcec ]|
|Fix Version/s||1.4.1-incubating [ 12318902 ]|
Bilung Lee made changes -
|Status||Patch Available [ 10002 ]||Resolved [ 5 ]|
|Resolution||Fixed [ 1 ]|