Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-2334

Sqoop Volume Per Mapper

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.5
    • Fix Version/s: 1.4.7
    • Component/s: None
    • Labels:
      None

      Description

      There is no way where user can define the upper limit of volume that each mapper can handle. Current Sqoop does the calculation based on mapper by Switch -m and --split-by but this does not give control user to specify the upper limit of volume handle by the mapper .

      if we can add such functionality in the Sqoop that would help us to load the bigger data set in case we don't have continuous key data available and there is a huge gap in maximum and minimum data set value.

        Attachments

        1. SQOOP-2334_2.patch
          19 kB
          Rakesh Sharma
        2. SQOOP-2334_1.patch
          19 kB
          Rakesh Sharma
        3. SQOOP-2334.patch
          19 kB
          Rakesh Sharma

          Issue Links

            Activity

              People

              • Assignee:
                raksharma Rakesh Sharma
                Reporter:
                atugupta Atul Gupta
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: