Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-1052

Hive import is not compatible with Avro and SequenceFile but no errors are thrown

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.4.3
    • Fix Version/s: 1.4.4
    • Component/s: None
    • Labels:
      None

      Description

      Avro import using --as-avrodatafile and SequenceFile import using --as-sequencefile are not compatible with --hive-import, which is correctly documented in our user guide, however doing such import won't fail resulting in non-readable data on Hive side. I think that we should add parameter check to die quickly. At least before we will make those two data formats compatible with Hive.

      1. bugSQOOP-1052.patch
        1 kB
        Jarek Jarcec Cecho

        Issue Links

          Activity

          Hide
          kathleen Kathleen Ting added a comment -
          Show
          kathleen Kathleen Ting added a comment - Thanks Jarcec for the contribution. The patch is in: https://git-wip-us.apache.org/repos/asf?p=sqoop.git;a=commit;h=b07906a2a2fc9c5d2808cb53acf1e855cfef0314
          Hide
          hudson Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop200 #638 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/638/)
          SQOOP-1052: Hive import is not compatible with Avro and SequenceFile but no errors are thrown (Revision b07906a2a2fc9c5d2808cb53acf1e855cfef0314)

          Result = SUCCESS
          kathleen : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=b07906a2a2fc9c5d2808cb53acf1e855cfef0314
          Files :

          • src/java/org/apache/sqoop/tool/BaseSqoopTool.java
          Show
          hudson Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop200 #638 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/638/ ) SQOOP-1052 : Hive import is not compatible with Avro and SequenceFile but no errors are thrown (Revision b07906a2a2fc9c5d2808cb53acf1e855cfef0314) Result = SUCCESS kathleen : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=b07906a2a2fc9c5d2808cb53acf1e855cfef0314 Files : src/java/org/apache/sqoop/tool/BaseSqoopTool.java
          Hide
          hudson Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop23 #845 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/845/)
          SQOOP-1052: Hive import is not compatible with Avro and SequenceFile but no errors are thrown (Revision b07906a2a2fc9c5d2808cb53acf1e855cfef0314)

          Result = SUCCESS
          kathleen : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=b07906a2a2fc9c5d2808cb53acf1e855cfef0314
          Files :

          • src/java/org/apache/sqoop/tool/BaseSqoopTool.java
          Show
          hudson Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop23 #845 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/845/ ) SQOOP-1052 : Hive import is not compatible with Avro and SequenceFile but no errors are thrown (Revision b07906a2a2fc9c5d2808cb53acf1e855cfef0314) Result = SUCCESS kathleen : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=b07906a2a2fc9c5d2808cb53acf1e855cfef0314 Files : src/java/org/apache/sqoop/tool/BaseSqoopTool.java
          Hide
          hudson Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop100 #641 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/641/)
          SQOOP-1052: Hive import is not compatible with Avro and SequenceFile but no errors are thrown (Revision b07906a2a2fc9c5d2808cb53acf1e855cfef0314)

          Result = SUCCESS
          kathleen : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=b07906a2a2fc9c5d2808cb53acf1e855cfef0314
          Files :

          • src/java/org/apache/sqoop/tool/BaseSqoopTool.java
          Show
          hudson Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop100 #641 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/641/ ) SQOOP-1052 : Hive import is not compatible with Avro and SequenceFile but no errors are thrown (Revision b07906a2a2fc9c5d2808cb53acf1e855cfef0314) Result = SUCCESS kathleen : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=b07906a2a2fc9c5d2808cb53acf1e855cfef0314 Files : src/java/org/apache/sqoop/tool/BaseSqoopTool.java
          Hide
          hudson Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop20 #637 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/637/)
          SQOOP-1052: Hive import is not compatible with Avro and SequenceFile but no errors are thrown (Revision b07906a2a2fc9c5d2808cb53acf1e855cfef0314)

          Result = SUCCESS
          kathleen : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=b07906a2a2fc9c5d2808cb53acf1e855cfef0314
          Files :

          • src/java/org/apache/sqoop/tool/BaseSqoopTool.java
          Show
          hudson Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop20 #637 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/637/ ) SQOOP-1052 : Hive import is not compatible with Avro and SequenceFile but no errors are thrown (Revision b07906a2a2fc9c5d2808cb53acf1e855cfef0314) Result = SUCCESS kathleen : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=b07906a2a2fc9c5d2808cb53acf1e855cfef0314 Files : src/java/org/apache/sqoop/tool/BaseSqoopTool.java

            People

            • Assignee:
              jarcec Jarek Jarcec Cecho
              Reporter:
              jarcec Jarek Jarcec Cecho
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development