[MAPREDUCE-1473] Sqoop should allow users to control export parallelism

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Assignee: Aaron Kimball
• Reporter: Aaron Kimball
• Created: 10/Feb/10 02:20
• Updated: 02/May/13 02:29
• Resolved: 03/May/10 18:41

Description

Sqoop uses MapReduce jobs to export files back to a table in the database. The degree of parallelism is controlled by the number of splits; i.e., the number of input files used. The bottleneck in the system, though, is likely to be the database itself.

Users should have the ability to tune the number of parallel exporters being used to a degree appropriate to their database deployment.

Issue Links

• depends upon: MAPREDUCE-1480 CombineFileRecordReader does not properly initialize child RecordReader