Details

    • Type: Task Task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Fix Version/s: Initial Clearing
    • Component/s: Website
    • Labels:
      None
    • Environment:
      mysql, httpd, pootle

      Description

      In order to prepare an upgrade of pootle, the enviroment on translate-vm needs to be cleaned. First part of the cleanup is ended (non-destructive part)

      second part consist of:
      - split /var/www and /var/www/translate (move translate to /x1)
      - determine changed files in translate and document in svn
      - update httpd conf and vhost to same standard as wiki.o.o.
      - update httpd/php to 2.4, fastCGI
      - prepare translate-test (to test the upgrade)

      1. erebus.patch.txt
        0.8 kB
        jan iversen
      2. puppet.patch.txt
        0.5 kB
        jan iversen

        Activity

        Hide
        jan iversen added a comment -
        gmcdonald made the backup away from the vm, and the www backup was changed to rsync.
        Show
        jan iversen added a comment - gmcdonald made the backup away from the vm, and the www backup was changed to rsync.
        Hide
        jan iversen added a comment -
        /x1/backups/db will contain 7 days of mysql dump
        /x1/backups/www contains 1 day of www directory (including dyn. po file part)

        These backup files needs to be transferred to the backup server
        Show
        jan iversen added a comment - /x1/backups/db will contain 7 days of mysql dump /x1/backups/www contains 1 day of www directory (including dyn. po file part) These backup files needs to be transferred to the backup server
        Hide
        jan iversen added a comment -
        is live !!!

        backup is currently manual and local to the vm.

        we need backup of /x1 (-mysqldb) and mysqldump of all-databases

        rgds
        jan I.
        Show
        jan iversen added a comment - is live !!! backup is currently manual and local to the vm. we need backup of /x1 (-mysqldb) and mysqldump of all-databases rgds jan I.
        Hide
        jan iversen added a comment -
        There are now 2+1 outstanding issues:

        1) backup (which I cannot do...or at least was told so on wiki2)
        2) switching dns (actually it is switching erebus config translate.a.o -> translate-vm2.a.o instead of translate-vm.a.o)
        2a) reduce ipttables for port 80.

        I will prepare patches for 2 and 2a.
        Show
        jan iversen added a comment - There are now 2+1 outstanding issues: 1) backup (which I cannot do...or at least was told so on wiki2) 2) switching dns (actually it is switching erebus config translate.a.o -> translate-vm2.a.o instead of translate-vm.a.o) 2a) reduce ipttables for port 80. I will prepare patches for 2 and 2a.
        Hide
        jan iversen added a comment -
        Waiting for user test.
        Show
        jan iversen added a comment - Waiting for user test.
        Hide
        jan iversen added a comment -
        testing pootle before go live.
        Show
        jan iversen added a comment - testing pootle before go live.
        Hide
        jan iversen added a comment -
        Added standard script /root/bin/puppet/kill-hanging-puppet.sh to cron.

        however when running this script by hand, the apt-get defunc processes does not disapear. Need to control tomorrow it cron does a better job.
        Show
        jan iversen added a comment - Added standard script /root/bin/puppet/kill-hanging-puppet.sh to cron. however when running this script by hand, the apt-get defunc processes does not disapear. Need to control tomorrow it cron does a better job.
        Hide
        jan iversen added a comment -
        At least it generates a temp file that fills the disk 100%
        (I was quite impressed too)

        In the pootle doc. they warn that the json file is very big.
        Show
        jan iversen added a comment - At least it generates a temp file that fills the disk 100% (I was quite impressed too) In the pootle doc. they warn that the json file is very big.
        Hide
        Gavin added a comment -
        The MySQL data on disk is 5.5GB.
        An exported sql dump is 638MB.
        Free space on the VM is 28GB.

        Are you saying an JSON dump of the DB will exceed 28GB ???
        Show
        Gavin added a comment - The MySQL data on disk is 5.5GB. An exported sql dump is 638MB. Free space on the VM is 28GB. Are you saying an JSON dump of the DB will exceed 28GB ???
        Hide
        jan iversen added a comment -
        In order to move and upgrade the database, I need additional disk space for 1-2 days on translate-vm, request has been asked on IRC:

        We cannot copy the database, but need to export it with pootle tools (json format) and import it in the new version. This is a HUGE file, which I hope can copy directly between vm and vm2 using the internal network.
        Show
        jan iversen added a comment - In order to move and upgrade the database, I need additional disk space for 1-2 days on translate-vm, request has been asked on IRC: We cannot copy the database, but need to export it with pootle tools (json format) and import it in the new version. This is a HUGE file, which I hope can copy directly between vm and vm2 using the internal network.
        Hide
        jan iversen added a comment -
        translate-vm2 is ready for backup....all data are stored in /x1 including the mysql database.
        Show
        jan iversen added a comment - translate-vm2 is ready for backup....all data are stored in /x1 including the mysql database.
        Hide
        jan iversen added a comment -
        As discussed on IRC: we are waiting for the pottle release, which has been postponed. If you prefer we can close the ticket and open a new one, when ready. I discussed it with gav earlier, and he had nothing against the ticket was open (allowing us to collect other comments).
        Show
        jan iversen added a comment - As discussed on IRC: we are waiting for the pottle release, which has been postponed. If you prefer we can close the ticket and open a new one, when ready. I discussed it with gav earlier, and he had nothing against the ticket was open (allowing us to collect other comments).
        Hide
        #asfinfra IRC Bot added a comment -
        <danielsh> Jan what needs to happen here before this ticket can be closed?
        Show
        #asfinfra IRC Bot added a comment - <danielsh> Jan what needs to happen here before this ticket can be closed?
        Hide
        jan iversen added a comment -
        expected version 2.5
        Show
        jan iversen added a comment - expected version 2.5
        Hide
        jan iversen added a comment -
        Version 2.5 is postponed, and for AOO we need the new toolset.

        So far the vm is prepared and ready to be upgraded, however the php upgrade (to apc) will be done with the pootle upgrade.
        Show
        jan iversen added a comment - Version 2.5 is postponed, and for AOO we need the new toolset. So far the vm is prepared and ready to be upgraded, however the php upgrade (to apc) will be done with the pootle upgrade.
        Hide
        jan iversen added a comment -
        It was 3 discussions, where you were part of 2.

        1) We wanted to make a setup, that looked like to wiki2, meaning /x1 contains appliation. At the time where I moved mysql to /x1 you commented it positively.
        2) the current httpd.conf contains /var/www as directory and /var/www/pootle as directory, with different statements, that is in my opinion not clean, but rather confusing.
        3) was a more general discussion with danielsh, if I could/should be responsible for a couple of jira, which at that time presented some kind of problem.
        Show
        jan iversen added a comment - It was 3 discussions, where you were part of 2. 1) We wanted to make a setup, that looked like to wiki2, meaning /x1 contains appliation. At the time where I moved mysql to /x1 you commented it positively. 2) the current httpd.conf contains /var/www as directory and /var/www/pootle as directory, with different statements, that is in my opinion not clean, but rather confusing. 3) was a more general discussion with danielsh, if I could/should be responsible for a couple of jira, which at that time presented some kind of problem.
        Hide
        Gavin added a comment -
        why do you want to move translate from /var/www/translate to /x1/ ?
        What is the purpsose of /x1 ?

        Can you summarise the disucssion you had on IRC as I dont remember being part of it.
        Show
        Gavin added a comment - why do you want to move translate from /var/www/translate to /x1/ ? What is the purpsose of /x1 ? Can you summarise the disucssion you had on IRC as I dont remember being part of it.
        Hide
        jan iversen added a comment -
        /x1 directory is prepared, and pootle changes analyzed.

        I have, as mentioned and discussed on irc, offered to do this job.
        Show
        jan iversen added a comment - /x1 directory is prepared, and pootle changes analyzed. I have, as mentioned and discussed on irc, offered to do this job.

          People

          • Assignee:
            Unassigned
            Reporter:
            jan iversen
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:
              Review Date:

              Development