Details

    Description

      Background:

      On the cluster with 5-6 nodes conf-select cycles takes 3 seconds. Trying to create conf-dir for every single components. Which makes install stages like ~25-30seconds for hosts with a lot of clients.

      Usually we run conf-select during every task. Since with every single install new packages might appear and new conf-select links will be required.

      Solution:

      If host_sysprep is true, run conf-select cycle only during first task and than create a file indicating this was done, so other tasks skip.

      Since all packages are preinstalled this should work fine as during first single run it will be possible to create all links.

      Attachments

        Activity

          mpapirkovskyy Papirkovskyy Myroslav created issue -
          githubbot ASF GitHub Bot made changes -
          Field Original Value New Value
          Remote Link This issue links to "GitHub Pull Request #2920 (Web Link)" [ 152489 ]
          githubbot ASF GitHub Bot made changes -
          Labels pull-request-available
          githubbot ASF GitHub Bot logged work - 09/Apr/19 12:46
          • Time Spent:
            10m
             
            mpapirkovskyy commented on pull request #2920: AMBARI-25235. Add a sysprep configurations to run conf-selects only a single time.
            URL: https://github.com/apache/ambari/pull/2920
             
             
               ## What changes were proposed in this pull request?
               
               Conf-selects will have been run once when cluster-env "sysprep_skip_conf_select" property is set to true.
               
               ## How was this patch tested?
               
               Manual check.
             
            ----------------------------------------------------------------
            This is an automated message from the Apache Git Service.
            To respond to the message, please log on to GitHub and use the
            URL above to go to the specific comment.
             
            For queries about this service, please contact Infrastructure at:
            users@infra.apache.org
          githubbot ASF GitHub Bot made changes -
          Worklog Id 224956 [ 224956 ]
          Remaining Estimate 0h [ 0 ]
          Time Spent 10m [ 600 ]
          githubbot ASF GitHub Bot made changes -
          Remote Link This issue links to "GitHub Pull Request #2922 (Web Link)" [ 152495 ]
          githubbot ASF GitHub Bot logged work - 09/Apr/19 13:16
          • Time Spent:
            10m
             
            mpapirkovskyy commented on pull request #2922: AMBARI-25235. Add a sysprep configurations to run conf-selects only a single time.
            URL: https://github.com/apache/ambari/pull/2922
             
             
               ## What changes were proposed in this pull request?
               
               Conf-selects will have been run once when cluster-env "sysprep_skip_conf_select" property is set to true.
               
               ## How was this patch tested?
               
               Manual check.
             
            ----------------------------------------------------------------
            This is an automated message from the Apache Git Service.
            To respond to the message, please log on to GitHub and use the
            URL above to go to the specific comment.
             
            For queries about this service, please contact Infrastructure at:
            users@infra.apache.org
          githubbot ASF GitHub Bot made changes -
          Worklog Id 224972 [ 224972 ]
          Time Spent 10m [ 600 ] 20m [ 1200 ]
          githubbot ASF GitHub Bot made changes -
          Remote Link This issue links to "GitHub Pull Request #2920 (Web Link)" [ 152489 ] This issue links to "GitHub Pull Request #2920 (Web Link)" [ 152489 ]
          githubbot ASF GitHub Bot logged work - 09/Apr/19 13:52
          githubbot ASF GitHub Bot made changes -
          Worklog Id 225002 [ 225002 ]
          Time Spent 20m [ 1200 ] 0.5h [ 1800 ]
          githubbot ASF GitHub Bot made changes -
          Remote Link This issue links to "GitHub Pull Request #2922 (Web Link)" [ 152495 ] This issue links to "GitHub Pull Request #2922 (Web Link)" [ 152495 ]
          githubbot ASF GitHub Bot logged work - 09/Apr/19 14:50
          githubbot ASF GitHub Bot made changes -
          Worklog Id 225025 [ 225025 ]
          Time Spent 0.5h [ 1800 ] 40m [ 2400 ]
          githubbot ASF GitHub Bot made changes -
          Remote Link This issue links to "GitHub Pull Request #2920 (Web Link)" [ 152489 ] This issue links to "GitHub Pull Request #2920 (Web Link)" [ 152489 ]
          githubbot ASF GitHub Bot logged work - 09/Apr/19 18:36
          • Time Spent:
            10m
             
            mpapirkovskyy commented on pull request #2920: AMBARI-25235. Add a sysprep configurations to run conf-selects only a single time.
            URL: https://github.com/apache/ambari/pull/2920
             
             
               
             
            ----------------------------------------------------------------
            This is an automated message from the Apache Git Service.
            To respond to the message, please log on to GitHub and use the
            URL above to go to the specific comment.
             
            For queries about this service, please contact Infrastructure at:
            users@infra.apache.org
          githubbot ASF GitHub Bot made changes -
          Worklog Id 225203 [ 225203 ]
          Time Spent 40m [ 2400 ] 50m [ 3000 ]
          githubbot ASF GitHub Bot made changes -
          Remote Link This issue links to "GitHub Pull Request #2922 (Web Link)" [ 152495 ] This issue links to "GitHub Pull Request #2922 (Web Link)" [ 152495 ]
          githubbot ASF GitHub Bot logged work - 09/Apr/19 18:37
          • Time Spent:
            10m
             
            mpapirkovskyy commented on pull request #2922: AMBARI-25235. Add a sysprep configurations to run conf-selects only a single time.
            URL: https://github.com/apache/ambari/pull/2922
             
             
               
             
            ----------------------------------------------------------------
            This is an automated message from the Apache Git Service.
            To respond to the message, please log on to GitHub and use the
            URL above to go to the specific comment.
             
            For queries about this service, please contact Infrastructure at:
            users@infra.apache.org
          githubbot ASF GitHub Bot made changes -
          Worklog Id 225205 [ 225205 ]
          Time Spent 50m [ 3000 ] 1h [ 3600 ]
          hudson Hudson added a comment -

          FAILURE: Integrated in Jenkins build Ambari-branch-2.7 #476 (See https://builds.apache.org/job/Ambari-branch-2.7/476/)
          AMBARI-25235. Add a sysprep configurations to run conf-selects only a (github: https://gitbox.apache.org/repos/asf?p=ambari.git&a=commit&h=a112364df203008048448759341e1e4ef9f97563)

          • (edit) ambari-server/src/main/resources/stack-hooks/after-INSTALL/scripts/shared_initialization.py
          • (edit) ambari-server/src/main/resources/stack-hooks/after-INSTALL/scripts/params.py
          hudson Hudson added a comment - FAILURE: Integrated in Jenkins build Ambari-branch-2.7 #476 (See https://builds.apache.org/job/Ambari-branch-2.7/476/ ) AMBARI-25235 . Add a sysprep configurations to run conf-selects only a (github: https://gitbox.apache.org/repos/asf?p=ambari.git&a=commit&h=a112364df203008048448759341e1e4ef9f97563 ) (edit) ambari-server/src/main/resources/stack-hooks/after-INSTALL/scripts/shared_initialization.py (edit) ambari-server/src/main/resources/stack-hooks/after-INSTALL/scripts/params.py
          hudson Hudson added a comment -

          FAILURE: Integrated in Jenkins build Ambari-branch-2.6 #729 (See https://builds.apache.org/job/Ambari-branch-2.6/729/)
          AMBARI-25235. Add a sysprep configurations to run conf-selects only a (github: https://gitbox.apache.org/repos/asf?p=ambari.git&a=commit&h=68101592bc2ea01606d920124e0cb48f348954dd)

          • (edit) ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/params.py
          • (edit) ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/shared_initialization.py
          hudson Hudson added a comment - FAILURE: Integrated in Jenkins build Ambari-branch-2.6 #729 (See https://builds.apache.org/job/Ambari-branch-2.6/729/ ) AMBARI-25235 . Add a sysprep configurations to run conf-selects only a (github: https://gitbox.apache.org/repos/asf?p=ambari.git&a=commit&h=68101592bc2ea01606d920124e0cb48f348954dd ) (edit) ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/params.py (edit) ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/shared_initialization.py

          Merged to branch-2.6 and branch-2.7.

          mpapirkovskyy Papirkovskyy Myroslav added a comment - Merged to branch-2.6 and branch-2.7.
          mpapirkovskyy Papirkovskyy Myroslav made changes -
          Resolution Fixed [ 1 ]
          Status Open [ 1 ] Resolved [ 5 ]
          githubbot ASF GitHub Bot logged work - 27/Oct/22 07:02
          githubbot ASF GitHub Bot made changes -
          Worklog Id 820825 [ 820825 ]
          Time Spent 1h [ 3600 ] 1h 10m [ 4200 ]
          jenkinsjira Jenkins Jira Test Reporter made changes -
          Remote Link This issue links to "GitHub PR#3441 (Web Link)" [ 299527 ]
          jenkinsjira Jenkins Jira Test Reporter made changes -
          Remote Link This issue links to "GitHub PR#3441 (Web Link)" [ 299527 ] This issue links to "GitHub PR#3441 (Web Link)" [ 299527 ]
          jenkinsjira Jenkins Jira Test Reporter made changes -
          Remote Link This issue links to "GitHub PR#3441 (Web Link)" [ 299527 ] This issue links to "GitHub PR#3441 (Web Link)" [ 299527 ]
          jenkinsjira Jenkins Jira Test Reporter made changes -
          Remote Link This issue links to "GitHub PR#3441 (Web Link)" [ 299527 ] This issue links to "GitHub PR#3441 (Web Link)" [ 299527 ]
          jenkinsjira Jenkins Jira Test Reporter made changes -
          Remote Link This issue links to "GitHub PR#3441 (Web Link)" [ 299527 ] This issue links to "GitHub PR#3441 (Web Link)" [ 299527 ]
          jenkinsjira Jenkins Jira Test Reporter made changes -
          Remote Link This issue links to "GitHub PR#3441 (Web Link)" [ 299527 ] This issue links to "GitHub PR#3441 (Web Link)" [ 299527 ]
          jenkinsjira Jenkins Jira Test Reporter made changes -
          Remote Link This issue links to "GitHub PR#3441 (Web Link)" [ 299527 ] This issue links to "GitHub PR#3441 (Web Link)" [ 299527 ]
          jenkinsjira Jenkins Jira Test Reporter made changes -
          Remote Link This issue links to "GitHub PR#3441 (Web Link)" [ 299527 ] This issue links to "GitHub PR#3441 (Web Link)" [ 299527 ]
          jenkinsjira Jenkins Jira Test Reporter made changes -
          Remote Link This issue links to "GitHub PR#3441 (Web Link)" [ 299527 ] This issue links to "GitHub PR#3441 (Web Link)" [ 299527 ]
          githubbot ASF GitHub Bot logged work - 08/Nov/22 18:36
          githubbot ASF GitHub Bot made changes -
          Worklog Id 824306 [ 824306 ]
          Time Spent 1h 10m [ 4200 ] 1h 20m [ 4800 ]
          wuzhiguo Zhiguo Wu made changes -
          Fix Version/s 2.8.0 [ 12344142 ]

          People

            mpapirkovskyy Papirkovskyy Myroslav
            mpapirkovskyy Papirkovskyy Myroslav
            Votes:
            0 Vote for this issue
            Watchers:
            Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 1h 20m
                1h 20m

                Slack