Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 1.0.0
    • Component/s: deployment
    • Labels:
      None

      Description

      We included Sqoop 1.4.x and renamed sqoop 1.99.x to sqoop2. So, appropriate updates should be applied to puppet recipes for sqoop2 as well.

      1. BIGTOP-1876.1.patch
        14 kB
        YoungWoo Kim
      2. BIGTOP-1876.2.patch
        14 kB
        YoungWoo Kim

        Issue Links

          Activity

          Hide
          evans_ye Evans Ye added a comment -

          +1. I've committed this.
          Thanks for the patch YoungWoo Kim.

          Show
          evans_ye Evans Ye added a comment - +1. I've committed this. Thanks for the patch YoungWoo Kim .
          Hide
          warwithin YoungWoo Kim added a comment -

          BIGTOP-1876.2.patch

          • Fix the service name
          • Make 12000 as Sqoop server's port
          Show
          warwithin YoungWoo Kim added a comment - BIGTOP-1876.2.patch Fix the service name Make 12000 as Sqoop server's port
          Hide
          warwithin YoungWoo Kim added a comment -

          Evans Ye, Thanks for your review I'll revise the patch.

          Show
          warwithin YoungWoo Kim added a comment - Evans Ye , Thanks for your review I'll revise the patch.
          Hide
          evans_ye Evans Ye added a comment -

          I removed the hue 3.8.1 commit and test this patch locally.
          There is just one thing missing in the patch:

          Error: Could not start Service[sqoop-server]: Execution of '/sbin/service sqoop-server start' returned 1: sqoop-server: unrecognized service
          Error: /Stage[main]/Sqoop2::Server/Service[sqoop-server]/ensure: change from stopped to running failed: Could not start Service[sqoop-server]: Execution of '/sbin/service sqoop-server start' returned 1: sqoop-server: unrecognized service
          

          The daemon name shoud be sqoop2-server instead of sqoop-server

              service { "sqoop-server":
                ensure => running,
                require => Package["sqoop2-server"],
                hasstatus => true,
                hasrestart => true,
              }
          

          And, I know this was introduced in previous patch, not yours, but does bigtop::sqoop2_server_port: "<never defined correctly>" works if we don't override it in site.yaml?

          Show
          evans_ye Evans Ye added a comment - I removed the hue 3.8.1 commit and test this patch locally. There is just one thing missing in the patch: Error: Could not start Service[sqoop-server]: Execution of '/sbin/service sqoop-server start' returned 1: sqoop-server: unrecognized service Error: /Stage[main]/Sqoop2::Server/Service[sqoop-server]/ensure: change from stopped to running failed: Could not start Service[sqoop-server]: Execution of '/sbin/service sqoop-server start' returned 1: sqoop-server: unrecognized service The daemon name shoud be sqoop2-server instead of sqoop-server service { "sqoop-server" : ensure => running, require => Package[ "sqoop2-server" ], hasstatus => true , hasrestart => true , } And, I know this was introduced in previous patch, not yours, but does bigtop::sqoop2_server_port: "<never defined correctly>" works if we don't override it in site.yaml?
          Hide
          evans_ye Evans Ye added a comment -

          Hi YoungWoo Kim thanks for the patch. However the patch does not apply.

          Applying: BIGTOP-1876. Update puppet recipes for Sqoop2
          /root/bigtop-commit/.git/rebase-apply/patch:221: trailing whitespace.
              }
          /root/bigtop-commit/.git/rebase-apply/patch:245: trailing whitespace.
          sqoop::client { "test-sqoop-client": }
          /root/bigtop-commit/.git/rebase-apply/patch:271: trailing whitespace.
              }
          /root/bigtop-commit/.git/rebase-apply/patch:277: trailing whitespace.
              }
          /root/bigtop-commit/.git/rebase-apply/patch:308: trailing whitespace.
          sqoop2::client { "test-sqoop2-client": }
          error: patch failed: bigtop-deploy/puppet/modules/hue/manifests/init.pp:14
          error: bigtop-deploy/puppet/modules/hue/manifests/init.pp: patch does not apply
          error: patch failed: bigtop-deploy/puppet/modules/hue/templates/hue.ini:797
          error: bigtop-deploy/puppet/modules/hue/templates/hue.ini: patch does not apply
          Patch failed at 0001 BIGTOP-1876. Update puppet recipes for Sqoop2
          When you have resolved this problem run "git am --resolved".
          If you would prefer to skip this patch, instead run "git am --skip".
          To restore the original branch and stop patching run "git am --abort".
          

          Should be conflict with BIGTOP-1869: Hue 3.8.1 refinements.

          Show
          evans_ye Evans Ye added a comment - Hi YoungWoo Kim thanks for the patch. However the patch does not apply. Applying: BIGTOP-1876. Update puppet recipes for Sqoop2 /root/bigtop-commit/.git/rebase-apply/patch:221: trailing whitespace. } /root/bigtop-commit/.git/rebase-apply/patch:245: trailing whitespace. sqoop::client { "test-sqoop-client" : } /root/bigtop-commit/.git/rebase-apply/patch:271: trailing whitespace. } /root/bigtop-commit/.git/rebase-apply/patch:277: trailing whitespace. } /root/bigtop-commit/.git/rebase-apply/patch:308: trailing whitespace. sqoop2::client { "test-sqoop2-client" : } error: patch failed: bigtop-deploy/puppet/modules/hue/manifests/init.pp:14 error: bigtop-deploy/puppet/modules/hue/manifests/init.pp: patch does not apply error: patch failed: bigtop-deploy/puppet/modules/hue/templates/hue.ini:797 error: bigtop-deploy/puppet/modules/hue/templates/hue.ini: patch does not apply Patch failed at 0001 BIGTOP-1876. Update puppet recipes for Sqoop2 When you have resolved this problem run "git am --resolved" . If you would prefer to skip this patch, instead run "git am --skip" . To restore the original branch and stop patching run "git am --abort" . Should be conflict with BIGTOP-1869 : Hue 3.8.1 refinements.
          Hide
          warwithin YoungWoo Kim added a comment - - edited

          First patch. BIGTOP-1876.1.patch:

          • Separated the hadoop-sqoop module into sqoop and sqoop2

          One thing to note here: To avoid confusion, I renamed the existing variable from sqoop_% to sqoop2_%. so if you have previous site configurations, you should update the configurations.

          Show
          warwithin YoungWoo Kim added a comment - - edited First patch. BIGTOP-1876.1.patch : Separated the hadoop-sqoop module into sqoop and sqoop2 One thing to note here: To avoid confusion, I renamed the existing variable from sqoop_% to sqoop2_%. so if you have previous site configurations, you should update the configurations.

            People

            • Assignee:
              warwithin YoungWoo Kim
              Reporter:
              warwithin YoungWoo Kim
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development