Sqoop
  1. Sqoop
  2. SQOOP-1259

Sqoop on Windows can't run HCatalog/HBase multinode jobs

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.4.5
    • Component/s: None
    • Labels:
      None
    • Environment:

      Hadoop 2.x on Windows

      Description

      When running on Windows found couple of issues affecting Sqoop

      The configure-sqoop.cmd was not properly setting the classpath
      The hcat executabe that Sqoop runs to create the hcat table (if --create-hcatalog-table option was used) is a python script on Windows.
      HBase conf directory and zookeeper conf directories were not added correctly which resulted in multi node system failures

      1. SQOOP-1259.patch
        3 kB
        Venkat Ranganathan

        Issue Links

          Activity

          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop20 #867 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/867/)
          SQOOP-1259: Sqoop on Windows can't run HCatalog/HBase multinode jobs (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=c688915e8e88f48563181f5c47826e1a026c2374)

          • src/java/org/apache/sqoop/mapreduce/hcat/SqoopHCatUtilities.java
          • .gitattributes
          • bin/configure-sqoop.cmd
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop20 #867 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/867/ ) SQOOP-1259 : Sqoop on Windows can't run HCatalog/HBase multinode jobs (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=c688915e8e88f48563181f5c47826e1a026c2374 ) src/java/org/apache/sqoop/mapreduce/hcat/SqoopHCatUtilities.java .gitattributes bin/configure-sqoop.cmd
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop23 #1069 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/1069/)
          SQOOP-1259: Sqoop on Windows can't run HCatalog/HBase multinode jobs (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=c688915e8e88f48563181f5c47826e1a026c2374)

          • src/java/org/apache/sqoop/mapreduce/hcat/SqoopHCatUtilities.java
          • .gitattributes
          • bin/configure-sqoop.cmd
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop23 #1069 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/1069/ ) SQOOP-1259 : Sqoop on Windows can't run HCatalog/HBase multinode jobs (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=c688915e8e88f48563181f5c47826e1a026c2374 ) src/java/org/apache/sqoop/mapreduce/hcat/SqoopHCatUtilities.java .gitattributes bin/configure-sqoop.cmd
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop200 #873 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/873/)
          SQOOP-1259: Sqoop on Windows can't run HCatalog/HBase multinode jobs (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=c688915e8e88f48563181f5c47826e1a026c2374)

          • src/java/org/apache/sqoop/mapreduce/hcat/SqoopHCatUtilities.java
          • bin/configure-sqoop.cmd
          • .gitattributes
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop200 #873 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/873/ ) SQOOP-1259 : Sqoop on Windows can't run HCatalog/HBase multinode jobs (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=c688915e8e88f48563181f5c47826e1a026c2374 ) src/java/org/apache/sqoop/mapreduce/hcat/SqoopHCatUtilities.java bin/configure-sqoop.cmd .gitattributes
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop100 #832 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/832/)
          SQOOP-1259: Sqoop on Windows can't run HCatalog/HBase multinode jobs (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=c688915e8e88f48563181f5c47826e1a026c2374)

          • .gitattributes
          • bin/configure-sqoop.cmd
          • src/java/org/apache/sqoop/mapreduce/hcat/SqoopHCatUtilities.java
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop100 #832 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/832/ ) SQOOP-1259 : Sqoop on Windows can't run HCatalog/HBase multinode jobs (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=c688915e8e88f48563181f5c47826e1a026c2374 ) .gitattributes bin/configure-sqoop.cmd src/java/org/apache/sqoop/mapreduce/hcat/SqoopHCatUtilities.java
          Hide
          Jarek Jarcec Cecho added a comment -

          Thank you for your contribution Venkat Ranganathan!

          Show
          Jarek Jarcec Cecho added a comment - Thank you for your contribution Venkat Ranganathan !
          Hide
          ASF subversion and git services added a comment -

          Commit c688915e8e88f48563181f5c47826e1a026c2374 in branch refs/heads/trunk from Jarek Jarcec Cecho
          [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=c688915 ]

          SQOOP-1259: Sqoop on Windows can't run HCatalog/HBase multinode jobs

          (Venkat Ranganathan via Jarek Jarcec Cecho)

          Show
          ASF subversion and git services added a comment - Commit c688915e8e88f48563181f5c47826e1a026c2374 in branch refs/heads/trunk from Jarek Jarcec Cecho [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=c688915 ] SQOOP-1259 : Sqoop on Windows can't run HCatalog/HBase multinode jobs (Venkat Ranganathan via Jarek Jarcec Cecho)
          Hide
          Jarek Jarcec Cecho added a comment -

          +1

          I'm not a windows user, so I can't really verify the patch nor test it. However the code changes seems good and I trust Venkat's tests. Hence I'll commit it. Please do not hesitate and let me know if there are any concerns.

          Show
          Jarek Jarcec Cecho added a comment - +1 I'm not a windows user, so I can't really verify the patch nor test it. However the code changes seems good and I trust Venkat's tests. Hence I'll commit it. Please do not hesitate and let me know if there are any concerns.

            People

            • Assignee:
              Venkat Ranganathan
              Reporter:
              Venkat Ranganathan
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development