Sqoop
  1. Sqoop
  2. SQOOP-1049

Sqoop2: Record not imported if partition column value is NULL

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.99.2
    • Fix Version/s: 1.99.3
    • Component/s: None
    • Labels:
      None
    • Environment:

      Mysql

      Description

      In Sqoop2, if the partition column is NULL then record is not imported.

      For table t with id (int) and name columns, insert NULL value for id. where id is partition column. Then perform import from Sqoop2 and now id with NULL value is not imported.

      1. SQOOP-1049.4.patch
        9 kB
        Mengwei Ding
      2. SQOOP-1049.3.patch
        9 kB
        Mengwei Ding
      3. SQOOP-1049.2.patch
        7 kB
        Mengwei Ding
      4. SQOOP-1049.1.patch
        9 kB
        Mengwei Ding

        Issue Links

          Activity

          Hide
          Jarek Jarcec Cecho added a comment -

          Thank you for your contribution Mengwei Ding!

          Show
          Jarek Jarcec Cecho added a comment - Thank you for your contribution Mengwei Ding !
          Hide
          ASF subversion and git services added a comment -

          Commit 91b121ccaa9e40dc8a86b3a00d68300e7ba4c890 in branch refs/heads/sqoop2 from Jarek Jarcec Cecho
          [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=91b121c ]

          SQOOP-1049: Sqoop2: Record not imported if partition column value is NULL

          (Mengwei Ding via Jarek Jarcec Cecho)

          Show
          ASF subversion and git services added a comment - Commit 91b121ccaa9e40dc8a86b3a00d68300e7ba4c890 in branch refs/heads/sqoop2 from Jarek Jarcec Cecho [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=91b121c ] SQOOP-1049 : Sqoop2: Record not imported if partition column value is NULL (Mengwei Ding via Jarek Jarcec Cecho)
          Hide
          Sqoop QA bot added a comment -

          Here are the results of testing the latest attachment
          https://issues.apache.org/jira/secure/attachment/12593055/SQOOP-1049.4.patch against branch sqoop2.

          Overall: +1 all checks pass

          SUCCESS: Clean was successful
          SUCCESS: Patch applied correctly
          SUCCESS: Patch compiled
          SUCCESS: All tests passed

          Console output: https://builds.apache.org/job/PreCommit-SQOOP-Build/78/console

          This message is automatically generated.

          Show
          Sqoop QA bot added a comment - Here are the results of testing the latest attachment https://issues.apache.org/jira/secure/attachment/12593055/SQOOP-1049.4.patch against branch sqoop2. Overall: +1 all checks pass SUCCESS: Clean was successful SUCCESS: Patch applied correctly SUCCESS: Patch compiled SUCCESS: All tests passed Console output: https://builds.apache.org/job/PreCommit-SQOOP-Build/78/console This message is automatically generated.
          Hide
          Sqoop QA bot added a comment -

          Here are the results of testing the latest attachment
          https://issues.apache.org/jira/secure/attachment/12592102/SQOOP-1049.3.patch against branch sqoop2.

          Overall: +1 all checks pass

          SUCCESS: Clean was successful
          SUCCESS: Patch applied correctly
          SUCCESS: Patch compiled
          SUCCESS: All tests passed

          Console output: https://builds.apache.org/job/PreCommit-SQOOP-Build/65/console

          This message is automatically generated.

          Show
          Sqoop QA bot added a comment - Here are the results of testing the latest attachment https://issues.apache.org/jira/secure/attachment/12592102/SQOOP-1049.3.patch against branch sqoop2. Overall: +1 all checks pass SUCCESS: Clean was successful SUCCESS: Patch applied correctly SUCCESS: Patch compiled SUCCESS: All tests passed Console output: https://builds.apache.org/job/PreCommit-SQOOP-Build/65/console This message is automatically generated.
          Hide
          Sqoop QA bot added a comment -

          Here are the results of testing the latest attachment
          https://issues.apache.org/jira/secure/attachment/12592087/SQOOP-1049.2.patch against branch sqoop2.

          Overall: -1 due to 11 errors

          ERROR: mvn test exited 1
          ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer
          ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer
          ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer
          ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer
          ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer
          ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer
          ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer
          ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer
          ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer
          ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer
          SUCCESS: Clean was successful
          SUCCESS: Patch applied correctly
          SUCCESS: Patch compiled

          Console output: https://builds.apache.org/job/PreCommit-SQOOP-Build/64/console

          This message is automatically generated.

          Show
          Sqoop QA bot added a comment - Here are the results of testing the latest attachment https://issues.apache.org/jira/secure/attachment/12592087/SQOOP-1049.2.patch against branch sqoop2. Overall: -1 due to 11 errors ERROR: mvn test exited 1 ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer ERROR: Failed: org.apache.sqoop.connector.jdbc.TestImportInitializer SUCCESS: Clean was successful SUCCESS: Patch applied correctly SUCCESS: Patch compiled Console output: https://builds.apache.org/job/PreCommit-SQOOP-Build/64/console This message is automatically generated.
          Hide
          Sqoop QA bot added a comment -

          Here are the results of testing the latest attachment
          https://issues.apache.org/jira/secure/attachment/12591705/SQOOP-1049.1.patch against branch sqoop2.

          Overall: +1 all checks pass

          SUCCESS: Clean was successful
          SUCCESS: Patch applied correctly
          SUCCESS: Patch compiled
          SUCCESS: All tests passed

          Console output: https://builds.apache.org/job/PreCommit-SQOOP-Build/56/console

          This message is automatically generated.

          Show
          Sqoop QA bot added a comment - Here are the results of testing the latest attachment https://issues.apache.org/jira/secure/attachment/12591705/SQOOP-1049.1.patch against branch sqoop2. Overall: +1 all checks pass SUCCESS: Clean was successful SUCCESS: Patch applied correctly SUCCESS: Patch compiled SUCCESS: All tests passed Console output: https://builds.apache.org/job/PreCommit-SQOOP-Build/56/console This message is automatically generated.
          Hide
          Mengwei Ding added a comment -

          submit patch for review

          Show
          Mengwei Ding added a comment - submit patch for review
          Hide
          Mengwei Ding added a comment -

          This only happens when the values for partition column contain both null and non-null values. When all the values is not null, everything is good. When all the values is null, it could happen another problem, which is recorded by SQOOP-1130 https://issues.apache.org/jira/browse/SQOOP-1130

          Show
          Mengwei Ding added a comment - This only happens when the values for partition column contain both null and non-null values. When all the values is not null, everything is good. When all the values is null, it could happen another problem, which is recorded by SQOOP-1130 https://issues.apache.org/jira/browse/SQOOP-1130

            People

            • Assignee:
              Mengwei Ding
              Reporter:
              Vasanth kumar RJ
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development