Sqoop
  1. Sqoop
  2. SQOOP-870

Allow Sqoop to import row key column into HBase

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.4.3
    • Component/s: None
    • Labels:
      None

      Description

      Currently when importing data into HBase, the row key column is not added to the column family as it is already the key. I would like to be able to tell Sqoop to add the row key as well.

      1. SQOOP-870.patch
        5 kB
        David Robson
      2. SQOOP-870.patch
        5 kB
        David Robson

        Issue Links

          Activity

          Hide
          David Robson added a comment -

          Added new option to import row key column. Set to false by default (same behaviour as before).
          Documented new option.
          Added tests for both options.

          Show
          David Robson added a comment - Added new option to import row key column. Set to false by default (same behaviour as before). Documented new option. Added tests for both options.
          Hide
          David Robson added a comment -

          Updated documentation wording.

          Show
          David Robson added a comment - Updated documentation wording.
          Hide
          Jarek Jarcec Cecho added a comment -
          Show
          Jarek Jarcec Cecho added a comment - Patch is in: https://git-wip-us.apache.org/repos/asf?p=sqoop.git;a=commit;h=d4d262591c342c863c02a9330e8e48b4be8cdf4b Thank you David for your contribution! Jarcec
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop20 #553 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/553/)
          SQOOP-870: Allow Sqoop to import row key column into HBase (Revision d4d262591c342c863c02a9330e8e48b4be8cdf4b)

          Result = SUCCESS
          jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=d4d262591c342c863c02a9330e8e48b4be8cdf4b
          Files :

          • src/docs/user/import.txt
          • src/java/org/apache/sqoop/hbase/HBasePutProcessor.java
          • src/test/com/cloudera/sqoop/hbase/HBaseImportTest.java
          • src/java/org/apache/sqoop/hbase/ToStringPutTransformer.java
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop20 #553 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/553/ ) SQOOP-870 : Allow Sqoop to import row key column into HBase (Revision d4d262591c342c863c02a9330e8e48b4be8cdf4b) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=d4d262591c342c863c02a9330e8e48b4be8cdf4b Files : src/docs/user/import.txt src/java/org/apache/sqoop/hbase/HBasePutProcessor.java src/test/com/cloudera/sqoop/hbase/HBaseImportTest.java src/java/org/apache/sqoop/hbase/ToStringPutTransformer.java
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop200 #551 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/551/)
          SQOOP-870: Allow Sqoop to import row key column into HBase (Revision d4d262591c342c863c02a9330e8e48b4be8cdf4b)

          Result = SUCCESS
          jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=d4d262591c342c863c02a9330e8e48b4be8cdf4b
          Files :

          • src/java/org/apache/sqoop/hbase/HBasePutProcessor.java
          • src/java/org/apache/sqoop/hbase/ToStringPutTransformer.java
          • src/test/com/cloudera/sqoop/hbase/HBaseImportTest.java
          • src/docs/user/import.txt
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop200 #551 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/551/ ) SQOOP-870 : Allow Sqoop to import row key column into HBase (Revision d4d262591c342c863c02a9330e8e48b4be8cdf4b) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=d4d262591c342c863c02a9330e8e48b4be8cdf4b Files : src/java/org/apache/sqoop/hbase/HBasePutProcessor.java src/java/org/apache/sqoop/hbase/ToStringPutTransformer.java src/test/com/cloudera/sqoop/hbase/HBaseImportTest.java src/docs/user/import.txt
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop23 #747 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/747/)
          SQOOP-870: Allow Sqoop to import row key column into HBase (Revision d4d262591c342c863c02a9330e8e48b4be8cdf4b)

          Result = SUCCESS
          jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=d4d262591c342c863c02a9330e8e48b4be8cdf4b
          Files :

          • src/docs/user/import.txt
          • src/java/org/apache/sqoop/hbase/HBasePutProcessor.java
          • src/test/com/cloudera/sqoop/hbase/HBaseImportTest.java
          • src/java/org/apache/sqoop/hbase/ToStringPutTransformer.java
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop23 #747 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/747/ ) SQOOP-870 : Allow Sqoop to import row key column into HBase (Revision d4d262591c342c863c02a9330e8e48b4be8cdf4b) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=d4d262591c342c863c02a9330e8e48b4be8cdf4b Files : src/docs/user/import.txt src/java/org/apache/sqoop/hbase/HBasePutProcessor.java src/test/com/cloudera/sqoop/hbase/HBaseImportTest.java src/java/org/apache/sqoop/hbase/ToStringPutTransformer.java
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop100 #549 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/549/)
          SQOOP-870: Allow Sqoop to import row key column into HBase (Revision d4d262591c342c863c02a9330e8e48b4be8cdf4b)

          Result = SUCCESS
          jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=d4d262591c342c863c02a9330e8e48b4be8cdf4b
          Files :

          • src/java/org/apache/sqoop/hbase/HBasePutProcessor.java
          • src/java/org/apache/sqoop/hbase/ToStringPutTransformer.java
          • src/test/com/cloudera/sqoop/hbase/HBaseImportTest.java
          • src/docs/user/import.txt
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop100 #549 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/549/ ) SQOOP-870 : Allow Sqoop to import row key column into HBase (Revision d4d262591c342c863c02a9330e8e48b4be8cdf4b) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=d4d262591c342c863c02a9330e8e48b4be8cdf4b Files : src/java/org/apache/sqoop/hbase/HBasePutProcessor.java src/java/org/apache/sqoop/hbase/ToStringPutTransformer.java src/test/com/cloudera/sqoop/hbase/HBaseImportTest.java src/docs/user/import.txt

            People

            • Assignee:
              David Robson
              Reporter:
              David Robson
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development