Sqoop
  1. Sqoop
  2. SQOOP-738

Sqoop is not importing all data in Sqoop 2

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.0.0
    • Fix Version/s: 1.99.1
    • Component/s: None
    • Labels:
      None

      Description

      I've tried to import exactly 408,957 (nice rounded number right?) rows in 10 mappers and I've noticed that not all mappers will supply all the data all the time. For example in run I got 6 files with expected size of 10MB whereas the other 4 random files are completely empty. In another run I got 8 files of 10MB and just 2 files empty. I did not quite found any logic regarding how many and which files will end up empty. We definitely need to address this.

      1. SQOOP-738.patch
        7 kB
        Hari Shreedharan

        Issue Links

          Activity

          Jarek Jarcec Cecho made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Jarek Jarcec Cecho made changes -
          Assignee Jarek Jarcec Cecho [ jarcec ] Hari Shreedharan [ hshreedharan ]
          Jarek Jarcec Cecho made changes -
          Remote Link This issue links to "Review board (Web Link)" [ 11823 ]
          Hari Shreedharan made changes -
          Attachment SQOOP-738.patch [ 12560517 ]
          Hari Shreedharan made changes -
          Attachment SQOOP-738-3.patch [ 12560460 ]
          Hari Shreedharan made changes -
          Attachment SQOOP-738-2.patch [ 12560427 ]
          Hari Shreedharan made changes -
          Attachment SQOOP-738.patch [ 12560129 ]
          Hari Shreedharan made changes -
          Attachment SQOOP-738-3.patch [ 12560460 ]
          Hari Shreedharan made changes -
          Attachment SQOOP-738-2.patch [ 12560427 ]
          Hari Shreedharan made changes -
          Attachment SQOOP-738.patch [ 12560129 ]
          Jarek Jarcec Cecho made changes -
          Assignee Jarek Jarcec Cecho [ jarcec ]
          Jarek Jarcec Cecho made changes -
          Field Original Value New Value
          Fix Version/s 2.0.0 [ 12319272 ]
          Fix Version/s 1.99.1 [ 12323641 ]
          Jarek Jarcec Cecho created issue -

            People

            • Assignee:
              Hari Shreedharan
              Reporter:
              Jarek Jarcec Cecho
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development