[SQOOP-2334] Sqoop Volume Per Mapper

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4.5
• Fix Version/s: 1.4.7
• Assignee: Rakesh Sharma
• Reporter: Atul Gupta
• Created: 28/Apr/15 11:16
• Updated: 30/Jun/15 05:03
• Resolved: 30/Jun/15 03:35

Description

There is no way where user can define the upper limit of volume that each mapper can handle. Current Sqoop does the calculation based on mapper by Switch -m and --split-by but this does not give control user to specify the upper limit of volume handle by the mapper .

if we can add such functionality in the Sqoop that would help us to load the bigger data set in case we don't have continuous key data available and there is a huge gap in maximum and minimum data set value.

Issue Links

• links to: RB link