Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-360

Duplication of the record in the case of using import mode

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Not A Problem
    • 1.3.0
    • None
    • connectors

    Description

      When I use Import mode of Sqoop,
      I get duplicate records.

      This occurs on condition of the following.

      1.Use Import mode of Sqoop
      2.Set a character type to "split-by" parameter
      3.Set a big value to "num-mappers" parameter

      The big value is a relatively large thing as compared with the total number of records.
      For example,
      when total number of records is 10,
      I set 100 to "num-mappers" parameter.

      I expect to get 10 records.
      But I get 10 or more lines.

      Attachments

        1. SQOOP-360.patch
          9 kB
          SATOSHI KONDO

        Activity

          People

            Unassigned Unassigned
            kondoust SATOSHI KONDO
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: