[IMPALA-4235] Consider making data load independent of hadoop-Lzo

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: Impala 2.6.0
• Component/s: Infrastructure
• Labels: asf infra
• Assignee: Unassigned
• Reporter: Sailesh Mukil
• Created: 30/Sep/16 21:55
• Updated: 19/Jun/20 20:05
• Resolved: 19/Jun/20 20:05

Description

Currently parts of our data loading uses Hive that depends on hadoop-lzo for all the lzo file formats we load, and there also seems to be some other subtle dependencies on hadoop-lzo during data load (like loading complex types with Hive).

If we do not have hadoop-lzo, our data loading errors out halfway through. It would be good to refactor our data-load scripts so that we can still go ahead and load other file formats.

Issue Links

• duplicates: IMPALA-9709 Remove Impala-lzo support