Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-2334

Sqoop Volume Per Mapper

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.4.5
    • 1.4.7
    • None
    • None

    Description

      There is no way where user can define the upper limit of volume that each mapper can handle. Current Sqoop does the calculation based on mapper by Switch -m and --split-by but this does not give control user to specify the upper limit of volume handle by the mapper .

      if we can add such functionality in the Sqoop that would help us to load the bigger data set in case we don't have continuous key data available and there is a huge gap in maximum and minimum data set value.

      Attachments

        1. SQOOP-2334.patch
          19 kB
          Rakesh Sharma
        2. SQOOP-2334_2.patch
          19 kB
          Rakesh Sharma
        3. SQOOP-2334_1.patch
          19 kB
          Rakesh Sharma

        Issue Links

          Activity

            People

              raksharma Rakesh Sharma
              atugupta Atul Gupta
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: