Infrastructure
  1. Infrastructure
  2. INFRA-5111

Migrate kafka podling codebase from svn to git

    Details

    • Type: Task Task
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Fix Version/s: Initial Clearing
    • Component/s: Git
    • Labels:
      None

      Description

      The kafka podling community would like to migrate from svn to git. We understand there is a WIP in label, and have nominated me (cburroughs) to assist with any problems that come up.

      One question. We currently use a SVN site folder https://svn.apache.org/repos/asf/incubator/kafka/site/ for http://incubator.apache.org/kafka/, what is the equivalent we should be using in the git world for that?

      Mailing list thread: http://mail-archives.apache.org/mod_mbox/incubator-kafka-dev/201207.mbox/%3C501164A1.2080803%40gmail.com%3E

        Activity

        Gavin made changes -
        Fix Version/s Initial Clearing [ 12325964 ]
        Hide
        Gavin added a comment -
        I've updated git.a.o and github will follow suit soon.
        Show
        Gavin added a comment - I've updated git.a.o and github will follow suit soon.
        David Nalley made changes -
        Status Waiting for Infra [ 10011 ] Closed [ 6 ]
        Resolution Fixed [ 1 ]
        Hide
        David Nalley added a comment -
        Jun, et al:

        The git repo is writable now.

        I've also made /kafka/site writable in your SVN tree.

        Let me know if you encounter any difficulties.
        As a heads up - if you wish to continue mirroring to git.a.o or github that will need to be filed as a separate ticket (I have no privs on git.a.o)

        Show
        David Nalley added a comment - Jun, et al: The git repo is writable now. I've also made /kafka/site writable in your SVN tree. Let me know if you encounter any difficulties. As a heads up - if you wish to continue mirroring to git.a.o or github that will need to be filed as a separate ticket (I have no privs on git.a.o)
        Hide
        Jun Rao added a comment -
        Yes, the git repo looks good. We can do the switch. Please keep the svn repo for our website. Thanks,
        Show
        Jun Rao added a comment - Yes, the git repo looks good. We can do the switch. Please keep the svn repo for our website. Thanks,
        Hide
        Jay Kreps added a comment -
        To confirm: Git repo looks, good. Let's open up write access.
        Show
        Jay Kreps added a comment - To confirm: Git repo looks, good. Let's open up write access.
        Hide
        Neha Narkhede added a comment -
        I guess we have to update this ticket with OK for the write access to open up. Other than the write access, everything else looks good to us. Please can you enable the write access ?
        Show
        Neha Narkhede added a comment - I guess we have to update this ticket with OK for the write access to open up. Other than the write access, everything else looks good to us. Please can you enable the write access ?
        Neha Narkhede made changes -
        Status Waiting for user [ 10010 ] Waiting for Infra [ 10011 ]
        Hide
        Neha Narkhede added a comment -
        nnarkhed-ld:apache-kafka-git nnarkhed$ git push origin 0.8
        Counting objects: 29, done.
        Delta compression using up to 8 threads.
        Compressing objects: 100% (12/12), done.
        Writing objects: 100% (15/15), 1.71 KiB, done.
        Total 15 (delta 7), reused 0 (delta 0)
        remote: Write access is currently disabled. The ASF Git
        remote: repositories are currently undergoing maintenance.
        remote:

        Is this a setup issue or is Apache GIT really undergoing maintenance ?
        Show
        Neha Narkhede added a comment - nnarkhed-ld:apache-kafka-git nnarkhed$ git push origin 0.8 Counting objects: 29, done. Delta compression using up to 8 threads. Compressing objects: 100% (12/12), done. Writing objects: 100% (15/15), 1.71 KiB, done. Total 15 (delta 7), reused 0 (delta 0) remote: Write access is currently disabled. The ASF Git remote: repositories are currently undergoing maintenance. remote: Is this a setup issue or is Apache GIT really undergoing maintenance ?
        David Nalley made changes -
        Assignee David Nalley [ ke4qqq ]
        David Nalley made changes -
        Status Waiting for Infra [ 10011 ] Waiting for user [ 10010 ]
        Hide
        David Nalley added a comment -
        Jun:

        I've migrated this again:
        https://git-wip-us.apache.org/repos/asf/kafka.git

        It is read only (as is your SVN tree) so please have the PMC review it, and update this ticket and we'll make it writable if it's acceptable, and enable writing to site in your SVN tree.
        Show
        David Nalley added a comment - Jun: I've migrated this again: https://git-wip-us.apache.org/repos/asf/kafka.git It is read only (as is your SVN tree) so please have the PMC review it, and update this ticket and we'll make it writable if it's acceptable, and enable writing to site in your SVN tree.
        Hide
        Jun Rao added a comment -
        Any updates on this ticket from infra? Thanks,
        Show
        Jun Rao added a comment - Any updates on this ticket from infra? Thanks,
        Jun Rao made changes -
        Status Waiting for user [ 10010 ] Waiting for Infra [ 10011 ]
        Hide
        Jun Rao added a comment - - edited

        David,

        Auth stuff seems to have been done (https://issues.apache.org/jira/browse/INFRA-5584 and https://issues.apache.org/jira/browse/INFRA-5587). Our new svn location is at https://svn.apache.org/repos/asf/kafka/branches/0.8 and all committers seem to have the right permission. Could you create a new git repo based off the new svn location? Thanks,
        Show
        Jun Rao added a comment - - edited David, Auth stuff seems to have been done ( https://issues.apache.org/jira/browse/INFRA-5584 and https://issues.apache.org/jira/browse/INFRA-5587) . Our new svn location is at https://svn.apache.org/repos/asf/kafka/branches/0.8 and all committers seem to have the right permission. Could you create a new git repo based off the new svn location? Thanks,
        David Nalley made changes -
        Status Waiting for Infra [ 10011 ] Waiting for user [ 10010 ]
        Hide
        David Nalley added a comment -
        [~junrao] There is no reason this can't be done, just make sure all of the auth stuff for your new TLP exists before the name change of the repo, else folks won't be able to write to it until that gets sorted.
        Show
        David Nalley added a comment - [~junrao] There is no reason this can't be done, just make sure all of the auth stuff for your new TLP exists before the name change of the repo, else folks won't be able to write to it until that gets sorted.
        Hide
        Jun Rao added a comment -
        Hi,

        We officially graduated from incubator last week. So we will need a new repo name without "incubator". Should I file a new infra jira or can we just reuse this one? Thanks,
        Show
        Jun Rao added a comment - Hi, We officially graduated from incubator last week. So we will need a new repo name without "incubator". Should I file a new infra jira or can we just reuse this one? Thanks,
        Hide
        Gavin added a comment -
        Chris, kafka 0.72 was released a month ago, anythng else holding this migration up or can we resume?
        Show
        Gavin added a comment - Chris, kafka 0.72 was released a month ago, anythng else holding this migration up or can we resume?
        Hide
        Mohammad Nour added a comment -
        [~cburroughs]
        - No problem just give me the green light whenever you are ready
        Show
        Mohammad Nour added a comment - [~cburroughs] - No problem just give me the green light whenever you are ready
        Hide
        Chris Burroughs added a comment -
        We are in the middle of a release VOTE, and the release engineer would rather wait until we get that out the door to complee the swtich. Everything looks good so far.
        Show
        Chris Burroughs added a comment - We are in the middle of a release VOTE, and the release engineer would rather wait until we get that out the door to complee the swtich. Everything looks good so far.
        Chris Burroughs made changes -
        Status Waiting for user [ 10010 ] Waiting for Infra [ 10011 ]
        Hide
        Chris Burroughs added a comment -
        Thanks! Dev's are checking it out now So as I understand it the remaining steps are:
         * We sign off it looks great.
         * Re-import (or whatever the right terminology is) to pick up any commits since the 24th
         * svn (except for site) goes read only
         * git goes read/write
        Show
        Chris Burroughs added a comment - Thanks! Dev's are checking it out now So as I understand it the remaining steps are:  * We sign off it looks great.  * Re-import (or whatever the right terminology is) to pick up any commits since the 24th  * svn (except for site) goes read only  * git goes read/write
        #asfinfra IRC Bot made changes -
        Field Original Value New Value
        Status Waiting for Infra [ 10011 ] Waiting for user [ 10010 ]
        Hide
        Mohammad Nour added a comment -
        [~cburroughs]
        - Done
        - The repository if in read-only/no-commits mode for now at https://git-wip-us.apache.org/repos/asf/incubator-kafka.git
        - Would the Kafka PPMC check the repository and if all is OK would the PPMC report that back
        - When reporting back and in case there are no problems reported the repository will be made in read/write mode
        - Looking forward to your reply
        Show
        Mohammad Nour added a comment - [~cburroughs] - Done - The repository if in read-only/no-commits mode for now at https://git-wip-us.apache.org/repos/asf/incubator-kafka.git - Would the Kafka PPMC check the repository and if all is OK would the PPMC report that back - When reporting back and in case there are no problems reported the repository will be made in read/write mode - Looking forward to your reply
        Hide
        Chris Burroughs added a comment -
        I've double checked with other kafka developers and as far as we can tell the git mirror looks good. Please let us know if there is anything else you need.
        Show
        Chris Burroughs added a comment - I've double checked with other kafka developers and as far as we can tell the git mirror looks good. Please let us know if there is anything else you need.
        Hide
        Chris Burroughs added a comment -
        Sorry not sure I'm following. Did you have a particular question about the git mirror? I'm not aware of any issues with it and anecdotally it appears to be what is most commonly developed against.
        Show
        Chris Burroughs added a comment - Sorry not sure I'm following. Did you have a particular question about the git mirror? I'm not aware of any issues with it and anecdotally it appears to be what is most commonly developed against.
        Hide
        Mohammad Nour added a comment -
        [~cburroughs]
        - Any updates about the git mirror so I can start working on kafka's git repository ?
        Show
        Mohammad Nour added a comment - [~cburroughs] - Any updates about the git mirror so I can start working on kafka's git repository ?
        Hide
        Mohammad Nour added a comment -
        [~cburroughs]
        - Would you please take a look at Kafka's git mirror
        - I would be easier to make the git repo from there
        - Looking forward to your reply
        Show
        Mohammad Nour added a comment - [~cburroughs] - Would you please take a look at Kafka's git mirror - I would be easier to make the git repo from there - Looking forward to your reply
        Hide
        Mohammad Nour added a comment -
        [~cburroughs]
        - Sorry for the delay there was a problem at the zone machine at the time I started to work on that and then didn't have time to look into that again
        - I am looking into again today
        Show
        Mohammad Nour added a comment - [~cburroughs] - Sorry for the delay there was a problem at the zone machine at the time I started to work on that and then didn't have time to look into that again - I am looking into again today
        Hide
        Chris Burroughs added a comment -
        Mohammad did you run into any road blocks? Are there any technical problems we can help with?
        Show
        Chris Burroughs added a comment - Mohammad did you run into any road blocks? Are there any technical problems we can help with?
        Hide
        Mohammad Nour added a comment -
        /me Working on it now
        Show
        Mohammad Nour added a comment - /me Working on it now
        Hide
        Mohammad Nour added a comment -
        [~cburroughs]
        - I am on my way home and will do the migration once I am there
        Show
        Mohammad Nour added a comment - [~cburroughs] - I am on my way home and will do the migration once I am there
        Hide
        #asfinfra IRC Bot added a comment -
        <danielsh> We can keep just /site rw and the rest ro.
        Show
        #asfinfra IRC Bot added a comment - <danielsh> We can keep just /site rw and the rest ro.
        Hide
        Chris Burroughs added a comment -
        So post migration svn remains r/w (instead of ro) for the site dir, and we can put in a README file to tell people not to use tags/branches/trunk [1]? Not a problem.

        [1] Or delete them or do nothing, or whatever the best practice is to avoid confusion.
        Show
        Chris Burroughs added a comment - So post migration svn remains r/w (instead of ro) for the site dir, and we can put in a README file to tell people not to use tags/branches/trunk [1]? Not a problem. [1] Or delete them or do nothing, or whatever the best practice is to avoid confusion.
        Hide
        #asfinfra IRC Bot added a comment -
        <pctony> Chris, your must leave your site content in SVN, as the CMS/pubsub only supports subversion.
        Show
        #asfinfra IRC Bot added a comment - <pctony> Chris, your must leave your site content in SVN, as the CMS/pubsub only supports subversion.
        Chris Burroughs created issue -

          People

          • Assignee:
            David Nalley
            Reporter:
            Chris Burroughs
          • Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development