Sqoop
  1. Sqoop
  2. SQOOP-788

Sqoop2: Import sometimes duplicate some data

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.99.1
    • Component/s: None
    • Labels:
      None

      Description

      I've noticed that on my unique testing set of 408957 rows, import always imports 408957 rows. However when I check number of unique lines I usually got smaller number - for example 408056 (less by 901).

      Because total number of rows fits, I'm expecting that we sometimes read one value twice somehow. I'm not quite sure why.

      1. bugSQOOP-788.patch
        3 kB
        Jarek Jarcec Cecho

        Issue Links

          Activity

          Jarek Jarcec Cecho created issue -
          Jarek Jarcec Cecho made changes -
          Field Original Value New Value
          Attachment bugSQOOP-788.patch [ 12561607 ]
          Jarek Jarcec Cecho made changes -
          Remote Link This issue links to "Review board (Web Link)" [ 11920 ]
          Jarek Jarcec Cecho made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Assignee Jarek Jarcec Cecho [ jarcec ]
          Bilung Lee made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]

            People

            • Assignee:
              Jarek Jarcec Cecho
              Reporter:
              Jarek Jarcec Cecho
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development