Sqoop
  1. Sqoop
  2. SQOOP-1190

Class HCatHadoopShims will be removed in HCatalog 0.12

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.4
    • Fix Version/s: 1.4.5
    • Component/s: None
    • Labels:
      None

      Description

      I've noticed that recently the Hive/HCatalog trunk has removed class HCatHadoopShims via HIVE-4460. The functionality was merged into Hive Shim layer instead. We are using this class in case that Sqoop is running on hadoop 1 in local mode, so we should change he implementation accordingly.

      1. bugSQOOP-1190.patch
        3 kB
        Jarek Jarcec Cecho

        Issue Links

          Activity

          Jarek Jarcec Cecho created issue -
          Jarek Jarcec Cecho made changes -
          Field Original Value New Value
          Link This issue relates to HIVE-4460 [ HIVE-4460 ]
          Jarek Jarcec Cecho made changes -
          Remote Link This issue links to "Review board (Web Link)" [ 12620 ]
          Jarek Jarcec Cecho made changes -
          Attachment bugSQOOP-1190.patch [ 12601340 ]
          Jarek Jarcec Cecho made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Eugene Koifman added a comment -

          The shim layer is not part of public API of hcat. Why does Scoop use it? Is there some other solution to this?

          Show
          Eugene Koifman added a comment - The shim layer is not part of public API of hcat. Why does Scoop use it? Is there some other solution to this?
          Hide
          ASF subversion and git services added a comment -

          Commit 56b5a372841a5ae132e65151b4dae7832cd9b9e2 in branch refs/heads/trunk from Arvind Prabhakar
          [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=56b5a37 ]

          SQOOP-1190 Class HCatHadoopShims will be removed in HCatalog 0.12

          (Jarek Jarcec Cecho via Arvind Prabhakar)

          Show
          ASF subversion and git services added a comment - Commit 56b5a372841a5ae132e65151b4dae7832cd9b9e2 in branch refs/heads/trunk from Arvind Prabhakar [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=56b5a37 ] SQOOP-1190 Class HCatHadoopShims will be removed in HCatalog 0.12 (Jarek Jarcec Cecho via Arvind Prabhakar)
          Hide
          Arvind Prabhakar added a comment -

          Patch committed. Thanks Jarcec!

          Eugene Koifman I have created SQOOP-1191 to track revisiting the design around using HCatalog Shim layer in Sqoop. Please add your comments and suggestions there as necessary.

          Show
          Arvind Prabhakar added a comment - Patch committed. Thanks Jarcec! Eugene Koifman I have created SQOOP-1191 to track revisiting the design around using HCatalog Shim layer in Sqoop. Please add your comments and suggestions there as necessary.
          Arvind Prabhakar made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop100 #805 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/805/)
          SQOOP-1190 Class HCatHadoopShims will be removed in HCatalog 0.12 (arvind: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=56b5a372841a5ae132e65151b4dae7832cd9b9e2)

          • src/java/org/apache/sqoop/mapreduce/hcat/SqoopHCatUtilities.java
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop100 #805 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/805/ ) SQOOP-1190 Class HCatHadoopShims will be removed in HCatalog 0.12 (arvind: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=56b5a372841a5ae132e65151b4dae7832cd9b9e2 ) src/java/org/apache/sqoop/mapreduce/hcat/SqoopHCatUtilities.java
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop200 #850 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/850/)
          SQOOP-1190 Class HCatHadoopShims will be removed in HCatalog 0.12 (arvind: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=56b5a372841a5ae132e65151b4dae7832cd9b9e2)

          • src/java/org/apache/sqoop/mapreduce/hcat/SqoopHCatUtilities.java
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop200 #850 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/850/ ) SQOOP-1190 Class HCatHadoopShims will be removed in HCatalog 0.12 (arvind: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=56b5a372841a5ae132e65151b4dae7832cd9b9e2 ) src/java/org/apache/sqoop/mapreduce/hcat/SqoopHCatUtilities.java
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop20 #846 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/846/)
          SQOOP-1190 Class HCatHadoopShims will be removed in HCatalog 0.12 (arvind: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=56b5a372841a5ae132e65151b4dae7832cd9b9e2)

          • src/java/org/apache/sqoop/mapreduce/hcat/SqoopHCatUtilities.java
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop20 #846 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/846/ ) SQOOP-1190 Class HCatHadoopShims will be removed in HCatalog 0.12 (arvind: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=56b5a372841a5ae132e65151b4dae7832cd9b9e2 ) src/java/org/apache/sqoop/mapreduce/hcat/SqoopHCatUtilities.java
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop23 #1044 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/1044/)
          SQOOP-1190 Class HCatHadoopShims will be removed in HCatalog 0.12 (arvind: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=56b5a372841a5ae132e65151b4dae7832cd9b9e2)

          • src/java/org/apache/sqoop/mapreduce/hcat/SqoopHCatUtilities.java
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop23 #1044 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/1044/ ) SQOOP-1190 Class HCatHadoopShims will be removed in HCatalog 0.12 (arvind: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=56b5a372841a5ae132e65151b4dae7832cd9b9e2 ) src/java/org/apache/sqoop/mapreduce/hcat/SqoopHCatUtilities.java
          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Patch Available Patch Available
          2m 32s 1 Jarek Jarcec Cecho 04/Sep/13 10:54
          Patch Available Patch Available Resolved Resolved
          8h 41m 1 Arvind Prabhakar 04/Sep/13 19:35

            People

            • Assignee:
              Jarek Jarcec Cecho
              Reporter:
              Jarek Jarcec Cecho
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development