Sqoop
  1. Sqoop
  2. SQOOP-1172

Make Sqoop compatible with HBase 0.95+

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.4
    • Fix Version/s: 1.4.5
    • Component/s: None
    • Labels:
      None

      Description

      We should prepare Sqoop to be compatible with upcoming new major release of HBase (that is currently available in version 0.95). I've did preliminary investigation and it seems that there is no change in API that would break Sqoop. Entire HBase has been however broken from one monolithic archive into multiple smaller pieces that our build will have to take into consideration.

      1. bugSQOOP-1172.patch
        10 kB
        Jarek Jarcec Cecho
      2. bugSQOOP-1172.patch
        10 kB
        Jarek Jarcec Cecho

        Issue Links

          Activity

          Jarek Jarcec Cecho created issue -
          Hide
          Venkat Ranganathan added a comment -

          We also ran into this internally. We had to change the dependency to use the client, server and common modules

          We need to add a new configuration to do that so that we also can support HBase 0.94 and earlier.

          Show
          Venkat Ranganathan added a comment - We also ran into this internally. We had to change the dependency to use the client, server and common modules We need to add a new configuration to do that so that we also can support HBase 0.94 and earlier.
          Jarek Jarcec Cecho made changes -
          Field Original Value New Value
          Link This issue relates to PIG-3390 [ PIG-3390 ]
          Jarek Jarcec Cecho made changes -
          Remote Link This issue links to "Review board (Web Link)" [ 12515 ]
          Jarek Jarcec Cecho made changes -
          Remote Link This issue links to "Review board (Web Link)" [ 12516 ]
          Jarek Jarcec Cecho made changes -
          Remote Link This issue links to "Review board (Web Link)" [ 12516 ]
          Jarek Jarcec Cecho made changes -
          Attachment bugSQOOP-1172.patch [ 12597649 ]
          Jarek Jarcec Cecho made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Jarek Jarcec Cecho added a comment -

          Hi Venkat Ranganathan, thank you for your feedback! I've just uploaded that patch that do tweak the build in lines of what you've described. Don't hesitate and take a look!

          Show
          Jarek Jarcec Cecho added a comment - Hi Venkat Ranganathan , thank you for your feedback! I've just uploaded that patch that do tweak the build in lines of what you've described. Don't hesitate and take a look!
          Jarek Jarcec Cecho made changes -
          Attachment bugSQOOP-1172.patch [ 12597745 ]
          Hide
          ASF subversion and git services added a comment -

          Commit a9089430e41abafdbd460009ad695f29613787fd in branch refs/heads/trunk from [~nrv]
          [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=a908943 ]

          SQOOP-1172: Make Sqoop compatible with HBase 0.95+

          (Jarek Jarcec Cecho via Venkat Ranganathan)

          Show
          ASF subversion and git services added a comment - Commit a9089430e41abafdbd460009ad695f29613787fd in branch refs/heads/trunk from [~nrv] [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=a908943 ] SQOOP-1172 : Make Sqoop compatible with HBase 0.95+ (Jarek Jarcec Cecho via Venkat Ranganathan)
          Hide
          Venkat Ranganathan added a comment -

          Thanks for your contribution Jarek Jarcec Cecho. Great work.
          PS: I fixed a small indentation issue before committing.

          Show
          Venkat Ranganathan added a comment - Thanks for your contribution Jarek Jarcec Cecho . Great work. PS: I fixed a small indentation issue before committing.
          Venkat Ranganathan made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Hide
          Jarek Jarcec Cecho added a comment -

          Thank you Venkat Ranganathan for your review and the small fix!

          Show
          Jarek Jarcec Cecho added a comment - Thank you Venkat Ranganathan for your review and the small fix!
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop100 #800 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/800/)
          SQOOP-1172: Make Sqoop compatible with HBase 0.95+ (venkat: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=a9089430e41abafdbd460009ad695f29613787fd)

          • ivy.xml
          • build.xml
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop100 #800 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/800/ ) SQOOP-1172 : Make Sqoop compatible with HBase 0.95+ (venkat: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=a9089430e41abafdbd460009ad695f29613787fd ) ivy.xml build.xml
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop200 #844 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/844/)
          SQOOP-1172: Make Sqoop compatible with HBase 0.95+ (venkat: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=a9089430e41abafdbd460009ad695f29613787fd)

          • ivy.xml
          • build.xml
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop200 #844 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/844/ ) SQOOP-1172 : Make Sqoop compatible with HBase 0.95+ (venkat: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=a9089430e41abafdbd460009ad695f29613787fd ) ivy.xml build.xml
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop20 #841 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/841/)
          SQOOP-1172: Make Sqoop compatible with HBase 0.95+ (venkat: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=a9089430e41abafdbd460009ad695f29613787fd)

          • ivy.xml
          • build.xml
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop20 #841 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/841/ ) SQOOP-1172 : Make Sqoop compatible with HBase 0.95+ (venkat: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=a9089430e41abafdbd460009ad695f29613787fd ) ivy.xml build.xml
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop23 #1039 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/1039/)
          SQOOP-1172: Make Sqoop compatible with HBase 0.95+ (venkat: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=a9089430e41abafdbd460009ad695f29613787fd)

          • ivy.xml
          • build.xml
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop23 #1039 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/1039/ ) SQOOP-1172 : Make Sqoop compatible with HBase 0.95+ (venkat: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=a9089430e41abafdbd460009ad695f29613787fd ) ivy.xml build.xml
          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Patch Available Patch Available
          8h 4m 1 Jarek Jarcec Cecho 13/Aug/13 04:43
          Patch Available Patch Available Resolved Resolved
          13h 36m 1 Venkat Ranganathan 13/Aug/13 18:19

            People

            • Assignee:
              Jarek Jarcec Cecho
              Reporter:
              Jarek Jarcec Cecho
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development