Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.22.0
    • Component/s: build
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      As discussed on general@ at http://tinyurl.com/4q6lhxm

      1. HADOOP-7106.sh
        2 kB
        Nigel Daley
      2. HADOOP-7106.sh
        2 kB
        Doug Cutting
      3. HADOOP-7106.sh
        2 kB
        Nigel Daley
      4. HADOOP-7106.sh
        5 kB
        Nigel Daley
      5. HADOOP-7106-auth.patch
        2 kB
        Ian Holsman
      6. HADOOP-7106-auth.patch
        1 kB
        Doug Cutting
      7. HADOOP-7106.sh
        6 kB
        Nigel Daley
      8. HADOOP-7106-auth.patch
        2 kB
        Nigel Daley
      9. HADOOP-7106.sh
        6 kB
        Todd Lipcon
      10. HADOOP-7106-git.sh
        2 kB
        Todd Lipcon
      11. HADOOP-7106.sh
        7 kB
        Todd Lipcon
      12. HADOOP-7106-git.sh
        3 kB
        Todd Lipcon
      13. HADOOP-7106.sh
        7 kB
        Todd Lipcon
      14. gitk-example.png
        141 kB
        Todd Lipcon
      15. mailer-conf.diff
        2 kB
        Todd Lipcon

        Issue Links

          Activity

          Hide
          Nigel Daley added a comment -

          The following changes to subversion were proposed and discussed. There seems to be general agreement currently on this new structure:

          CURRENT SVN REPO:
          hadoop /

          { common, mapreduce, hdfs }

          /

          { trunk, branches/*, tags/* }

          PROPOSAL:
          hadoop/ { trunk, branches/*, tags/* }

          /

          { common, hdfs, mapreduce }

          remove old pig, hive, and zookeeper
          leave logos, nightly, and site

          Show
          Nigel Daley added a comment - The following changes to subversion were proposed and discussed. There seems to be general agreement currently on this new structure: CURRENT SVN REPO: hadoop / { common, mapreduce, hdfs } / { trunk, branches/*, tags/* } PROPOSAL: hadoop/ { trunk, branches/*, tags/* } / { common, hdfs, mapreduce } remove old pig, hive, and zookeeper leave logos, nightly, and site
          Hide
          Doug Cutting added a comment -

          +1 I don't think we can release these separately until we adopt a stable RPC format with well-defined compatibility rules. So long as these are not released separately, separate trunks only introduce needless complexity and confusion.

          Show
          Doug Cutting added a comment - +1 I don't think we can release these separately until we adopt a stable RPC format with well-defined compatibility rules. So long as these are not released separately, separate trunks only introduce needless complexity and confusion.
          Hide
          Nigel Daley added a comment -
          Show
          Nigel Daley added a comment - Wiki FAQ started here: http://wiki.apache.org/hadoop/ProjectSplit
          Hide
          Nigel Daley added a comment -

          Here's a script to do the appropriate moves and removes in SVN. Note these are local operations that take a long time and will require a large commit. Should these be server side operations instead?

          The script also removes pig, hive, and zookeeper as well as amalgamates site directories.

          Careful review of this script by a couple folks would be much appreciated.

          Show
          Nigel Daley added a comment - Here's a script to do the appropriate moves and removes in SVN. Note these are local operations that take a long time and will require a large commit. Should these be server side operations instead? The script also removes pig, hive, and zookeeper as well as amalgamates site directories. Careful review of this script by a couple folks would be much appreciated.
          Hide
          Owen O'Malley added a comment -

          You should do this kind of operation server side. The only downside is that you can't make the change atomically, but with changes like this you need to announce the change ahead of time anyways. Announce the time, send email just before and send email after you are done.

          You'll also need to specify what you are doing with the branches (and tags??) that don't exist in all three projects.

          Show
          Owen O'Malley added a comment - You should do this kind of operation server side. The only downside is that you can't make the change atomically, but with changes like this you need to announce the change ahead of time anyways. Announce the time, send email just before and send email after you are done. You'll also need to specify what you are doing with the branches (and tags??) that don't exist in all three projects.
          Hide
          Doug Cutting added a comment -

          Here's a version that runs in 20 seconds for me since it only checks out the top bits of the tree that we touch, making it easy for folks to evaluate & debug. Doing it as a sequence of server-side moves will be harder to dry run and check output. Note that to check output with this local version one should use 'svn stat' as svn doesn't remove deleted local directories until after commit.

          This makes the same moves as Nigel's script, and these look like a good set to me. +1

          Show
          Doug Cutting added a comment - Here's a version that runs in 20 seconds for me since it only checks out the top bits of the tree that we touch, making it easy for folks to evaluate & debug. Doing it as a sequence of server-side moves will be harder to dry run and check output. Note that to check output with this local version one should use 'svn stat' as svn doesn't remove deleted local directories until after commit. This makes the same moves as Nigel's script, and these look like a good set to me. +1
          Hide
          Nigel Daley added a comment -

          Cool Doug. Didn't know about the depth args to svn. Wow that's fast!

          Attaching a new script that fixes a bug (which was also in my version). common/site now gets moved to site/common.

          Todd, with the way these moves are done will you still be able to create you git history fixer script?

          Show
          Nigel Daley added a comment - Cool Doug. Didn't know about the depth args to svn. Wow that's fast! Attaching a new script that fixes a bug (which was also in my version). common/site now gets moved to site/common. Todd, with the way these moves are done will you still be able to create you git history fixer script?
          Hide
          Nigel Daley added a comment -

          Announce the time, send email just before and send email after you are done.

          Right, thanks Owen. I guess I'll also announce on IRC. Any target date you think is good?

          You'll also need to specify what you are doing with the branches (and tags??) that don't exist in all three projects.

          Thx. Added to the wiki page.

          Show
          Nigel Daley added a comment - Announce the time, send email just before and send email after you are done. Right, thanks Owen. I guess I'll also announce on IRC. Any target date you think is good? You'll also need to specify what you are doing with the branches (and tags??) that don't exist in all three projects. Thx. Added to the wiki page.
          Hide
          Todd Lipcon added a comment -

          Todd, with the way these moves are done will you still be able to create you git history fixer script?

          I imagine so - git doesn't actually track renames explicitly, so all that needs to be the case is that some git repo (or repos) exists with history from before the gitpocalypse, and some repo needs to exist with history after. If that's the case, we just set up a graft, and git will show them as moved files when you ask it to with --follow, -M, etc.

          I imagine the graft file will look something like:

          <first commit in combined repo trunk> <last commit in mr trunk> <last commit in hdfs trunk> <last commit in common trunk}
          <first commit in combined 22> <last mr 22> <last hdfs 22> <last common 22>
          ...
          

          This will make the first commit in the new branch a three-way merge of the other branches when looking at history.

          (is there anything git can't do? I dont think so)

          Show
          Todd Lipcon added a comment - Todd, with the way these moves are done will you still be able to create you git history fixer script? I imagine so - git doesn't actually track renames explicitly, so all that needs to be the case is that some git repo (or repos) exists with history from before the gitpocalypse, and some repo needs to exist with history after. If that's the case, we just set up a graft, and git will show them as moved files when you ask it to with --follow, -M, etc. I imagine the graft file will look something like: <first commit in combined repo trunk> <last commit in mr trunk> <last commit in hdfs trunk> <last commit in common trunk} <first commit in combined 22> <last mr 22> <last hdfs 22> <last common 22> ... This will make the first commit in the new branch a three-way merge of the other branches when looking at history. (is there anything git can't do? I dont think so)
          Hide
          Owen O'Malley added a comment -

          You (actually Ian) also need to update the asf-authorization-template file and the asf-mailer.conf files. You'll also need to coordinate with Jukka to ensure a smooth transition for those of us who use git on a daily basis.

          Show
          Owen O'Malley added a comment - You (actually Ian) also need to update the asf-authorization-template file and the asf-mailer.conf files. You'll also need to coordinate with Jukka to ensure a smooth transition for those of us who use git on a daily basis.
          Hide
          Todd Lipcon added a comment -

          Tom suggests that we need to review any use of svn externals here to make sure they're updated correctly.

          Show
          Todd Lipcon added a comment - Tom suggests that we need to review any use of svn externals here to make sure they're updated correctly.
          Hide
          Nigel Daley added a comment -

          You'll also need to coordinate with Jukka to ensure a smooth transition for those of us who use git on a daily basis.

          Owen, can you elaborate on this? Is this something you can help with (I am not a git user).

          Todd, still waiting for your review to ensure you can still create your git history fixer script.

          There haven't been any objections to the current patch/script that is run locally and committed as a single commit. I assume therefore folks are fine with that.

          Show
          Nigel Daley added a comment - You'll also need to coordinate with Jukka to ensure a smooth transition for those of us who use git on a daily basis. Owen, can you elaborate on this? Is this something you can help with (I am not a git user). Todd, still waiting for your review to ensure you can still create your git history fixer script. There haven't been any objections to the current patch/script that is run locally and committed as a single commit. I assume therefore folks are fine with that.
          Hide
          Nigel Daley added a comment -

          Updated script that also updates svn:externals. Good catch Tom!

          Show
          Nigel Daley added a comment - Updated script that also updates svn:externals. Good catch Tom!
          Hide
          Joep Rottinghuis added a comment -

          What is the plan for the Git repos?
          I'm hoping that we can stick a fork in the separate repos and simply maintain everything in the hadoop-common one, as that already has the three projects on the 0.21* branches.
          Having three Git repos->three Jenkins jobs and coordinating them is a pain.

          Show
          Joep Rottinghuis added a comment - What is the plan for the Git repos? I'm hoping that we can stick a fork in the separate repos and simply maintain everything in the hadoop-common one, as that already has the three projects on the 0.21* branches. Having three Git repos->three Jenkins jobs and coordinating them is a pain.
          Hide
          Nigel Daley added a comment -

          Folks watching this issue: see general@ for my proposed date to commit this issue

          Show
          Nigel Daley added a comment - Folks watching this issue: see general@ for my proposed date to commit this issue
          Hide
          Ian Holsman added a comment -

          changes required for SVN/mailer configs to allow both to co-exist.

          I've never changed the mailer before.. I think it will work..

          eyes welcome.

          Show
          Ian Holsman added a comment - changes required for SVN/mailer configs to allow both to co-exist. I've never changed the mailer before.. I think it will work.. eyes welcome.
          Hide
          Doug Cutting added a comment -

          Ian, the entries you add look good, but I think we also need to remove the old entries. Here's a patch that instead updates the old entries to the new paths.

          Show
          Doug Cutting added a comment - Ian, the entries you add look good, but I think we also need to remove the old entries. Here's a patch that instead updates the old entries to the new paths.
          Hide
          Owen O'Malley added a comment -

          I commented over on general, but it will cause a lot less disruption if we leave the common repository in place and merge everything back into common.

          common/trunk/* -> common/trunk/common/*
          hdfs/trunk -> common/trunk/hdfs
          mapreduce/trunk -> common/trunk/mapreduce
          

          All of the 0.21 and 0.22 branches and tags need to be handled similarly.

          The subversion script is out of date with respect to the current branches.

          As Paul Davis suggested, setting up a temporary subversion server and running the git mirror scripts will enable the change to be tested, which is a very good idea.

          Show
          Owen O'Malley added a comment - I commented over on general, but it will cause a lot less disruption if we leave the common repository in place and merge everything back into common. common/trunk/* -> common/trunk/common/* hdfs/trunk -> common/trunk/hdfs mapreduce/trunk -> common/trunk/mapreduce All of the 0.21 and 0.22 branches and tags need to be handled similarly. The subversion script is out of date with respect to the current branches. As Paul Davis suggested, setting up a temporary subversion server and running the git mirror scripts will enable the change to be tested, which is a very good idea.
          Hide
          Nigel Daley added a comment -

          +1 to Owen's proposed layout change. I'll update the patch. Can someone step up to test the git mirror scripts?

          Show
          Nigel Daley added a comment - +1 to Owen's proposed layout change. I'll update the patch. Can someone step up to test the git mirror scripts?
          Hide
          Ian Holsman added a comment -

          Thanks Doug.
          do you see any harm to me doing the 'insert' changes now, and then removing the old entries when the move is done?
          that way you wouldn't be waiting for me to do anything

          Show
          Ian Holsman added a comment - Thanks Doug. do you see any harm to me doing the 'insert' changes now, and then removing the old entries when the move is done? that way you wouldn't be waiting for me to do anything
          Hide
          Doug Cutting added a comment -

          Ian, sure, inserting new rules and removing the old ones later should work fine.

          Show
          Doug Cutting added a comment - Ian, sure, inserting new rules and removing the old ones later should work fine.
          Hide
          Nigel Daley added a comment -

          Here's an updated patch that puts everything under common. Owen, can you try this out?

          Show
          Nigel Daley added a comment - Here's an updated patch that puts everything under common. Owen, can you try this out?
          Hide
          Ian Holsman added a comment -

          I have added the new paths to the subversion/mailer configs.
          once this has been committed, I will remove the legacy paths.

          Show
          Ian Holsman added a comment - I have added the new paths to the subversion/mailer configs. once this has been committed, I will remove the legacy paths.
          Hide
          Nigel Daley added a comment -

          New auth patch that correct paths now that everything is going under common.

          Show
          Nigel Daley added a comment - New auth patch that correct paths now that everything is going under common.
          Hide
          Todd Lipcon added a comment -

          Hey Nigel. I'm working on testing this against a local mirror of the ASF svn repository.

          I noticed that the svn:externals settings at the bottom are inconsistent - the src/test ones all use https:// URLs but the site/ ones use http://. Is that on purpose?

          Show
          Todd Lipcon added a comment - Hey Nigel. I'm working on testing this against a local mirror of the ASF svn repository. I noticed that the svn:externals settings at the bottom are inconsistent - the src/test ones all use https:// URLs but the site/ ones use http:// . Is that on purpose?
          Hide
          Todd Lipcon added a comment -

          This afternoon I performed the following tests:

          • I set up a local mirror from last month's SVN dump, and then used the ASF's git mirror scripts to create a local git mirror as well.
          • Modified Nigel's HADOOP-7106.sh script with following changes:
            • parameterized svn location (the version of svn on my rhel box didn't support the --depth argument)
            • parameterized SVN root, so I could point it at my local mirror
            • fixed the svn externals links to point at hadoop/common/trunk/common instead of hadoop/trunk/common
          • Ran Nigel's script and verified that trunk and branch-0.22 had the correct layout
          • Committed it to my local svn mirror
          • ran the "update-mirror.sh" git mirror script. This took 20 minutes or so as it pulled in all of the history from the new branches. It might take longer upstream.

          At this point, the git mirror showed a single commit in trunk that moved all of the files inside common/ and added hdfs/* and mapreduce/* as new files (rather than detecting any kind of merge). This is what I expected

          I tried a few things at this point, but ran into some limitations of git: namely, that git won't detect renames that happen as part of a merge commit. So, I took the following angle of attack in a local repo:

          • fetch trunk from hadoop-hdfs.git (this is the last commit before 7106 is committed – since 7106 removed the svn directory, the hdfs.git repo basically got frozen at this point)
          • add a new commit where I mv everything inside an hdfs/ directory
          • do the same thing for mapreduce
          • do the same thing for common (with the commit right before HADOOP-7106
          • create a new commit for "trunk" which has the above three branches as parents, and the same log message:
          commit 34f047ed9e435be5932d53165477064144f5961c
          Merge: 898037a 2ec2d49 0619a1a
          Author: Todd Lipcon <todd@cloudera.com>
          Date:   Sun May 29 18:35:31 2011 -0700
          
              HADOOP-7106. Re-organize layout
              
              git-svn-id: file:///data/1/todd/asf-load/hadoop/common/trunk@1098499 13f79535-47bb-0310-9956-ffa450edef68
          
          • verified that commands like "git log -M --follow hdfs/src/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java" properly follow the history through the merge
          • force push this new 'trunk' back into hadoop-common.git:refs/remotes/trunk

          Next I made some svn commits in the merged repo and verified that the 'update-mirror.sh' script pulled them in on top of the merge with no problems.

          A script to perform the above sequence is attached here as HADOOP-7106-git.sh.

          In order to do this on ASF, I'll need to have access to the box that does the git mirroring. I guess I need to talk to Infra people to get that.

          Show
          Todd Lipcon added a comment - This afternoon I performed the following tests: I set up a local mirror from last month's SVN dump, and then used the ASF's git mirror scripts to create a local git mirror as well. Modified Nigel's HADOOP-7106 .sh script with following changes: parameterized svn location (the version of svn on my rhel box didn't support the --depth argument) parameterized SVN root, so I could point it at my local mirror fixed the svn externals links to point at hadoop/common/trunk/common instead of hadoop/trunk/common Ran Nigel's script and verified that trunk and branch-0.22 had the correct layout Committed it to my local svn mirror ran the "update-mirror.sh" git mirror script. This took 20 minutes or so as it pulled in all of the history from the new branches. It might take longer upstream. At this point, the git mirror showed a single commit in trunk that moved all of the files inside common/ and added hdfs/* and mapreduce/* as new files (rather than detecting any kind of merge). This is what I expected I tried a few things at this point, but ran into some limitations of git: namely, that git won't detect renames that happen as part of a merge commit. So, I took the following angle of attack in a local repo: fetch trunk from hadoop-hdfs.git (this is the last commit before 7106 is committed – since 7106 removed the svn directory, the hdfs.git repo basically got frozen at this point) add a new commit where I mv everything inside an hdfs/ directory do the same thing for mapreduce do the same thing for common (with the commit right before HADOOP-7106 create a new commit for "trunk" which has the above three branches as parents, and the same log message: commit 34f047ed9e435be5932d53165477064144f5961c Merge: 898037a 2ec2d49 0619a1a Author: Todd Lipcon <todd@cloudera.com> Date: Sun May 29 18:35:31 2011 -0700 HADOOP-7106. Re-organize layout git-svn-id: file:///data/1/todd/asf-load/hadoop/common/trunk@1098499 13f79535-47bb-0310-9956-ffa450edef68 verified that commands like "git log -M --follow hdfs/src/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java" properly follow the history through the merge force push this new 'trunk' back into hadoop-common.git:refs/remotes/trunk Next I made some svn commits in the merged repo and verified that the 'update-mirror.sh' script pulled them in on top of the merge with no problems. A script to perform the above sequence is attached here as HADOOP-7106 -git.sh. In order to do this on ASF, I'll need to have access to the box that does the git mirroring. I guess I need to talk to Infra people to get that.
          Hide
          Todd Lipcon added a comment -

          Hi Nigel. I ran through my tests again with a clean mirror... one more thing came up: for branches like MR-279 and HDFS-1073, it seems like we want to create new merged branches as well - for MR279 it probably should be the "yahoo-merge" branches, and for HDFS-1073 it should be trunk.

          Do you agree?

          I don't think any of the other branches are "live".

          Show
          Todd Lipcon added a comment - Hi Nigel. I ran through my tests again with a clean mirror... one more thing came up: for branches like MR-279 and HDFS-1073 , it seems like we want to create new merged branches as well - for MR279 it probably should be the "yahoo-merge" branches, and for HDFS-1073 it should be trunk. Do you agree? I don't think any of the other branches are "live".
          Hide
          Jukka Zitting added a comment -

          As Todd already tested, the move as planned should work just fine from the perspective of the git.apache.org mirror. The HADOOP-7106-git.sh script looks nice. Todd, I'll sync up with you directly on how to best make this happen for git.apache.org.

          I suppose we should remove the hadoop-hdfs.git and hadoop-mapreduce.git mirrors once the svn tree has been reorganized.

          Do you want to also move the resulting shared svn structure one level up from hadoop/common/

          {trunk,branches,tags} to hadoop/{trunk,branches,tags}

          (and presumably rename the hadoop-common.git mirror to hadoop.git)? If yes, we'll need to figure out how to best do this without breaking history in the git mirror since our current move-svn-project.sh script can only handle cases where the entire svn structure is moved in a single svn move (like "svn move ^/incubator/project ^/project"). One possible solution (given help from svn admins) could be:

          Unable to find source-code formatter for language: sh. Available languages are: actionscript, html, java, javascript, none, sql, xhtml, xml
          $ svn move ^/hadoop ^/hadoop-tmp
          $ svn move ^/hadoop-tmp/common ^/hadoop
          $ svn move ^/hadoop-tmp/logos ^/hadoop/logos
          $ svn move ^/hadoop-tmp/nightly ^/hadoop/nightly
          $ svn delete ^/hadoop-tmp
          

          Though I'm not sure how that would look like to existing svn checkouts. Another alternative is to simply move the trunk, branches and tags separately, and try to patch the git mirror to properly follow such svn history. Todd, you think you could come up with a script to do that. See the existing move-svn-project.sh script [1] for an example of the kind of history patching we now do for more regular svn moves.

          [1] https://svn.apache.org/repos/infra/infrastructure/trunk/projects/git/bin/move-svn-project.sh

          Show
          Jukka Zitting added a comment - As Todd already tested, the move as planned should work just fine from the perspective of the git.apache.org mirror. The HADOOP-7106 -git.sh script looks nice. Todd, I'll sync up with you directly on how to best make this happen for git.apache.org. I suppose we should remove the hadoop-hdfs.git and hadoop-mapreduce.git mirrors once the svn tree has been reorganized. Do you want to also move the resulting shared svn structure one level up from hadoop/common/ {trunk,branches,tags} to hadoop/{trunk,branches,tags} (and presumably rename the hadoop-common.git mirror to hadoop.git)? If yes, we'll need to figure out how to best do this without breaking history in the git mirror since our current move-svn-project.sh script can only handle cases where the entire svn structure is moved in a single svn move (like "svn move ^/incubator/project ^/project"). One possible solution (given help from svn admins) could be: Unable to find source-code formatter for language: sh. Available languages are: actionscript, html, java, javascript, none, sql, xhtml, xml $ svn move ^/hadoop ^/hadoop-tmp $ svn move ^/hadoop-tmp/common ^/hadoop $ svn move ^/hadoop-tmp/logos ^/hadoop/logos $ svn move ^/hadoop-tmp/nightly ^/hadoop/nightly $ svn delete ^/hadoop-tmp Though I'm not sure how that would look like to existing svn checkouts. Another alternative is to simply move the trunk, branches and tags separately, and try to patch the git mirror to properly follow such svn history. Todd, you think you could come up with a script to do that. See the existing move-svn-project.sh script [1] for an example of the kind of history patching we now do for more regular svn moves. [1] https://svn.apache.org/repos/infra/infrastructure/trunk/projects/git/bin/move-svn-project.sh
          Hide
          Owen O'Malley added a comment -

          Jukka,
          I'd proposed not changing the svn url for common precisely to avoid those breaks. smile

          Show
          Owen O'Malley added a comment - Jukka, I'd proposed not changing the svn url for common precisely to avoid those breaks. smile
          Hide
          Todd Lipcon added a comment -

          Another revision of the shell script that makes combined branches for HDFS-1073 out of (trunk,trunk,HDFS-1073) and MR-279 out of (yahoo-merge,MR-279,yahoo-merge).

          Will also need to update the git fixer script for this.

          Show
          Todd Lipcon added a comment - Another revision of the shell script that makes combined branches for HDFS-1073 out of (trunk,trunk, HDFS-1073 ) and MR-279 out of (yahoo-merge,MR-279,yahoo-merge). Will also need to update the git fixer script for this.
          Hide
          Jukka Zitting added a comment -

          Right! Sorry for overlooking your comment, Owen. If keeping the "common" bit in the svn URL is not a problem, then I'd recommend keeping it there to avoid the extra complexity.

          Show
          Jukka Zitting added a comment - Right! Sorry for overlooking your comment, Owen. If keeping the "common" bit in the svn URL is not a problem, then I'd recommend keeping it there to avoid the extra complexity.
          Hide
          Todd Lipcon added a comment -

          I agree with Owen - let's postpone the "shifting up a level" at this point. The extra layer of path heirarchy is just a minor annoyance. Maybe we can tackle it some other time – but at this point I'm feeling pretty comfortable about the current plan and don't want to have to go through a bunch more testing.

          Jukka: do you do IRC? I'm usually idling in #asfinfra as tlipcon

          Show
          Todd Lipcon added a comment - I agree with Owen - let's postpone the "shifting up a level" at this point. The extra layer of path heirarchy is just a minor annoyance. Maybe we can tackle it some other time – but at this point I'm feeling pretty comfortable about the current plan and don't want to have to go through a bunch more testing. Jukka: do you do IRC? I'm usually idling in #asfinfra as tlipcon
          Hide
          Arun C Murthy added a comment -

          MR-279 out of (yahoo-merge,MR-279,yahoo-merge).

          +1, thanks Todd!

          Show
          Arun C Murthy added a comment - MR-279 out of (yahoo-merge,MR-279,yahoo-merge). +1, thanks Todd!
          Hide
          Nigel Daley added a comment -

          Todd agreed to take over this issue and coordinate with Jukka.

          Show
          Nigel Daley added a comment - Todd agreed to take over this issue and coordinate with Jukka.
          Hide
          Ian Holsman added a comment -

          the asf-authorization patch was committed in 790732.

          Show
          Ian Holsman added a comment - the asf-authorization patch was committed in 790732.
          Hide
          Todd Lipcon added a comment -

          Here are the final (I think) versions of the scripts to use. A few changes since previous one:

          • uses shopt -s dotglob since the previous version accidentally left common's .gitignore and .eclipse-templates in the root dir
          • does combined trees for MR-279, HDFS-1073, yahoo-merge
          • had to redo the order so those trees come before "trunk" - otherwise for some reason git-svn's tracking got messed up and HDFS-1073 ended up with a common subtree missing all of its subdirectories except for src

          Changes to the git script:

          • supports merging trees from upstream branches named different things (for MR-279 and HDFS-1073)
          • does a sanity check using git-ls-tree to make sure that the tree checksum in the combined repo matches exactly the tree checksum of the last pre-7106 commit in the old repo (this is how I found the problem with the dotfiles and the missing dirs)

          I've also attached a gitk screenshot showing what it looks like in the git mirror

          Show
          Todd Lipcon added a comment - Here are the final (I think) versions of the scripts to use. A few changes since previous one: uses shopt -s dotglob since the previous version accidentally left common's .gitignore and .eclipse-templates in the root dir does combined trees for MR-279, HDFS-1073 , yahoo-merge had to redo the order so those trees come before "trunk" - otherwise for some reason git-svn's tracking got messed up and HDFS-1073 ended up with a common subtree missing all of its subdirectories except for src Changes to the git script: supports merging trees from upstream branches named different things (for MR-279 and HDFS-1073 ) does a sanity check using git-ls-tree to make sure that the tree checksum in the combined repo matches exactly the tree checksum of the last pre-7106 commit in the old repo (this is how I found the problem with the dotfiles and the missing dirs) I've also attached a gitk screenshot showing what it looks like in the git mirror
          Hide
          Nigel Daley added a comment -

          Awesome! Thanks Todd.

          Show
          Nigel Daley added a comment - Awesome! Thanks Todd.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-trunk-Commit #651 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/651/)
          Add HADOOP-7106 to CHANGES.txt for trunk.

          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1135001
          Files :

          • /hadoop/common/trunk/hdfs/CHANGES.txt
          • /hadoop/common/trunk/mapreduce/CHANGES.txt
          • /hadoop/common/trunk/common/CHANGES.txt
          Show
          Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #651 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/651/ ) Add HADOOP-7106 to CHANGES.txt for trunk. todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1135001 Files : /hadoop/common/trunk/hdfs/CHANGES.txt /hadoop/common/trunk/mapreduce/CHANGES.txt /hadoop/common/trunk/common/CHANGES.txt
          Hide
          Todd Lipcon added a comment -

          I committed this this afternoon. I posted some instructions about how to migrate here:
          http://markmail.org/message/cmyx2ojtn6dj6wlp

          Next we need to remove the transitional lines from the auth template and mailer config, right? Then, we can resolve this?

          Show
          Todd Lipcon added a comment - I committed this this afternoon. I posted some instructions about how to migrate here: http://markmail.org/message/cmyx2ojtn6dj6wlp Next we need to remove the transitional lines from the auth template and mailer config, right? Then, we can resolve this?
          Hide
          Vinod Kumar Vavilapalli added a comment -

          Todd, the history for MR-279 branch (http://svn.apache.org/repos/asf/hadoop/common/branches/MR-279) is completely lost. OTOH, I just verified that mapreduce and hdfs history is (correctly) retained in both the trunk and branch-0.21 branches.

          Was this a mistake? I am hoping we can get back the lost history. Right?

          Show
          Vinod Kumar Vavilapalli added a comment - Todd, the history for MR-279 branch ( http://svn.apache.org/repos/asf/hadoop/common/branches/MR-279 ) is completely lost. OTOH, I just verified that mapreduce and hdfs history is (correctly) retained in both the trunk and branch-0.21 branches. Was this a mistake? I am hoping we can get back the lost history. Right?
          Hide
          Vinod Kumar Vavilapalli added a comment -

          Sorry, I take my comment back. The history is also split between the projects under MR-279, I see it under mapreduce. I was confused as MR-279 is supposed to be a branch of only mapreduce pre-project split

          False alarm!

          Thanks for the good work!

          Show
          Vinod Kumar Vavilapalli added a comment - Sorry, I take my comment back. The history is also split between the projects under MR-279, I see it under mapreduce. I was confused as MR-279 is supposed to be a branch of only mapreduce pre-project split False alarm! Thanks for the good work!
          Hide
          Todd Lipcon added a comment -

          Hey Vinod – yep, MR-279 is now a "cross-project branch" that includes the yahoo-merge versions of common and hdfs. I figured that will make it easier for you to develop since many of the yahoo-merge changes are specifically for MR-279. Glad to hear you found the history, too

          Show
          Todd Lipcon added a comment - Hey Vinod – yep, MR-279 is now a "cross-project branch" that includes the yahoo-merge versions of common and hdfs. I figured that will make it easier for you to develop since many of the yahoo-merge changes are specifically for MR-279. Glad to hear you found the history, too
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-trunk #719 (See https://builds.apache.org/job/Hadoop-Common-trunk/719/)
          Add HADOOP-7106 to CHANGES.txt for trunk.

          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1135001
          Files :

          • /hadoop/common/trunk/hdfs/CHANGES.txt
          • /hadoop/common/trunk/mapreduce/CHANGES.txt
          • /hadoop/common/trunk/common/CHANGES.txt
          Show
          Hudson added a comment - Integrated in Hadoop-Common-trunk #719 (See https://builds.apache.org/job/Hadoop-Common-trunk/719/ ) Add HADOOP-7106 to CHANGES.txt for trunk. todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1135001 Files : /hadoop/common/trunk/hdfs/CHANGES.txt /hadoop/common/trunk/mapreduce/CHANGES.txt /hadoop/common/trunk/common/CHANGES.txt
          Hide
          Todd Lipcon added a comment -

          Here's a diff for asf-mailer.conf for the new layout.

          I simplified it a bit by using a fancier regular expression in the for_paths config. According to http://opensource.perlig.de/svnmailer/doc-1.0/ this is allowed.

          Show
          Todd Lipcon added a comment - Here's a diff for asf-mailer.conf for the new layout. I simplified it a bit by using a fancier regular expression in the for_paths config. According to http://opensource.perlig.de/svnmailer/doc-1.0/ this is allowed.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #726 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/726/)

          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #726 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/726/ )
          Hide
          Ian Holsman added a comment -

          mailer-conf.diff has been applied. revision: 790962.

          Show
          Ian Holsman added a comment - mailer-conf.diff has been applied. revision: 790962.
          Hide
          Konstantin Shvachko added a comment -

          Jenkins paths need to be updated. Both PreCommit-HDFS-Build and PreCommit-MAPREDUCE-Build are failing. Other builds are probably affected as well.

          Show
          Konstantin Shvachko added a comment - Jenkins paths need to be updated. Both PreCommit-HDFS-Build and PreCommit-MAPREDUCE-Build are failing. Other builds are probably affected as well.
          Hide
          Todd Lipcon added a comment -

          Fixed the precommit builds and resubmitted all of the patches that had failed due to the problem. I did all of the other builds, but somehow missed these. Sorry about that!

          Show
          Todd Lipcon added a comment - Fixed the precommit builds and resubmitted all of the patches that had failed due to the problem. I did all of the other builds, but somehow missed these. Sorry about that!
          Hide
          Konstantin Shvachko added a comment -

          Thanks, Tom!

          Show
          Konstantin Shvachko added a comment - Thanks, Tom!
          Hide
          Konstantin Shvachko added a comment -

          Oops, I meant Todd

          Show
          Konstantin Shvachko added a comment - Oops, I meant Todd
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #728 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/728/)
          HADOOP-7106. Reorganize SVN layout to combine HDFS, Common, and MR in a single tree (project unsplit)

          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1134994
          Files :

          • /hadoop/common/branches/branch-0.22/.eclipse.templates
          • /hadoop/common/branches/branch-0.21-old/common/lib
          • /hadoop/common/branches/branch-0.21/LICENSE.txt
          • /hadoop/common/branches/branch-0.22/common
          • /hadoop/common/branches/branch-0.21-old/conf
          • /hadoop/common/branches/yahoo-merge/mapreduce
          • /hadoop/common/trunk/conf
          • /hadoop/common/site/hdfs
          • /hadoop/common/branches/branch-0.22/CHANGES.txt
          • /hadoop/common/site/author
          • /hadoop/common/branches/branch-0.22/common/ivy.xml
          • /hadoop/common/branches/branch-0.21-old/common
          • /hadoop/zookeeper
          • /hadoop/common/branches/HDFS-1073/common
          • /hadoop/pig
          • /hadoop/common/branches/branch-0.21-old/common/ivy.xml
          • /hadoop/common/trunk/README.txt
          • /hadoop/common/branches/branch-0.21/NOTICE.txt
          • /hadoop/common/branches/yahoo-merge/common/README.txt
          • /hadoop/common/branches/branch-0.22/common/LICENSE.txt
          • /hadoop/common/branches/yahoo-merge/conf
          • /hadoop/common/branches/branch-0.21/common/lib
          • /hadoop/common/trunk/lib
          • /hadoop/common/trunk/common/.eclipse.templates
          • /hadoop/common/branches/branch-0.21-old/common/CHANGES.txt
          • /hadoop/common/tags/release-0.21.0/mapreduce
          • /hadoop/common/branches/branch-0.22/mapreduce
          • /hadoop/common/tags/release-0.21.0/lib
          • /hadoop/common/branches/branch-0.21/common
          • /hadoop/common/branches/HDFS-265/src/test
          • /hadoop/site/build.xml
          • /hadoop/common/branches/branch-0.21/common/.eclipse.templates
          • /hadoop/common/branches/branch-0.22/common/conf
          • /hadoop/common/branches/branch-0.21-old/mapreduce/src/test
          • /hadoop/common/tags/release-0.21.0/README.txt
          • /hadoop/common/branches/branch-0.21/common/ivy.xml
          • /hadoop/common/branches/yahoo-merge/.gitignore
          • /hadoop/common/site/common/build.xml
          • /hadoop/common/trunk/build.xml
          • /hadoop/common/tags/release-0.21.0/common/README.txt
          • /hadoop/common/tags/release-0.21.0/ivy.xml
          • /hadoop/common/branches/branch-0.22/common/README.txt
          • /hadoop/common/branches/branch-0.21/build.xml
          • /hadoop/common/branches/yahoo-merge/common/src
          • /hadoop/common/trunk/NOTICE.txt
          • /hadoop/common/branches/branch-0.21/common/CHANGES.txt
          • /hadoop/common/site/main/build.xml
          • /hadoop/common/branches/branch-0.22/conf
          • /hadoop/common/trunk/CHANGES.txt
          • /hadoop/common/branches/branch-0.21-old/lib
          • /hadoop/common/branches/yahoo-merge/common/ivy
          • /hadoop/common/branches/HDFS-265
          • /hadoop/common/branches/yahoo-merge/common/NOTICE.txt
          • /hadoop/common/trunk/common/lib
          • /hadoop/common/branches/branch-0.21/hdfs
          • /hadoop/common/tags/release-0.21.0/hdfs/src/test
          • /hadoop/common/branches/branch-0.21/mapreduce/src/test
          • /hadoop/common/tags/release-0.21.0/CHANGES.txt
          • /hadoop/common/branches/branch-0.22/src
          • /hadoop/common/branches/yahoo-merge/lib
          • /hadoop/common/branches/branch-0.22/README.txt
          • /hadoop/common/site/common/author/src/documentation
          • /hadoop/common/branches/branch-0.22/ivy
          • /hadoop/common/branches/MAPREDUCE-233
          • /hadoop/common/branches/branch-0.21-old/ivy.xml
          • /hadoop/common/tags/release-0.21.0/NOTICE.txt
          • /hadoop/common/branches/branch-0.21-old/common/.gitignore
          • /hadoop/common/trunk/common/build.xml
          • /hadoop/common/branches/branch-0.21-old/.gitignore
          • /hadoop/common/branches/yahoo-merge/common/bin
          • /hadoop/common/trunk/mapreduce
          • /hadoop/common/branches/yahoo-merge/.eclipse.templates
          • /hadoop/common/tags/release-0.21.0/common/lib
          • /hadoop/common/tags/release-0.21.0/common/NOTICE.txt
          • /hadoop/common/branches/branch-0.22/common/NOTICE.txt
          • /hadoop/common/branches/branch-0.21-old/CHANGES.txt
          • /hadoop/site/publish
          • /hadoop/common/branches/branch-0.21-old/common/src
          • /hadoop/common/trunk/common/conf
          • /hadoop/common/branches/branch-0.21/mapreduce
          • /hadoop/common/branches/yahoo-merge/common
          • /hadoop/common/trunk/common/CHANGES.txt
          • /hadoop/common/branches/branch-0.21/lib
          • /hadoop/common/tags/release-0.21.0/common
          • /hadoop/common/branches/HDFS-1052
          • /hadoop/common/site/common/publish
          • /hadoop/common/site/common
          • /hadoop/common/branches/yahoo-merge/CHANGES.txt
          • /hadoop/common/branches/yahoo-merge/common/ivy.xml
          • /hadoop/common/tags/release-0.21.0/common/conf
          • /hadoop/common/branches/branch-0.22/bin
          • /hadoop/common/branches/branch-0.21-old/common/ivy
          • /hadoop/common/branches/yahoo-merge/common/build.xml
          • /hadoop/common/trunk/mapreduce/src/test
          • /hadoop/common/tags/release-0.21.0/common/ivy.xml
          • /hadoop/common/branches/HDFS-1073/hdfs
          • /hadoop/common/trunk/common/README.txt
          • /hadoop/common/site/publish
          • /hadoop/common/branches/branch-0.21/common/build.xml
          • /hadoop/common/site/hdfs/author/src/documentation
          • /hadoop/common/branches/branch-0.21/.gitignore
          • /hadoop/common/branches/branch-0.22/NOTICE.txt
          • /hadoop/common/branches/branch-0.21/common/README.txt
          • /hadoop/common/branches/branch-0.21/ivy.xml
          • /hadoop/common/branches/branch-0.22/ivy.xml
          • /hadoop/common/branches/yahoo-merge/common/LICENSE.txt
          • /hadoop/common/branches/branch-0.21/common/src
          • /hadoop/common/branches/HDFS-1073/hdfs/src/test
          • /hadoop/common/branches/branch-0.22/common/lib
          • /hadoop/common/tags/release-0.21.0/common/CHANGES.txt
          • /hadoop/common/trunk/src
          • /hadoop/common/site/main/author
          • /hadoop/common/branches/branch-0.21/common/ivy
          • /hadoop/common/branches/branch-0.21-old/common/.eclipse.templates
          • /hadoop/common/branches/branch-0.21-old/common/conf
          • /hadoop/common/branches/branch-0.21/hdfs/src/test
          • /hadoop/common/tags/release-0.21.0/hdfs
          • /hadoop/common/branches/branch-0.21-old/common/bin
          • /hadoop/common/tags/release-0.21.0/src
          • /hadoop/common/branches/branch-0.21-old/.eclipse.templates
          • /hadoop/mapreduce
          • /hadoop/common/branches/branch-0.22/LICENSE.txt
          • /hadoop/common/tags/release-0.21.0/mapreduce/src/test
          • /hadoop/common/trunk/ivy
          • /hadoop/common/branches/branch-0.21/CHANGES.txt
          • /hadoop/common/branches/HDFS-326
          • /hadoop/hive
          • /hadoop/common/branches/yahoo-merge/common/conf
          • /hadoop/common/tags/release-0.21.0/ivy
          • /hadoop/common/branches/branch-0.22/common/build.xml
          • /hadoop/common/branches/branch-0.21-old/build.xml
          • /hadoop/common/trunk/common/NOTICE.txt
          • /hadoop/common/trunk/.gitignore
          • /hadoop/common/branches/branch-0.22/common/CHANGES.txt
          • /hadoop/common/branches/yahoo-merge/common/.gitignore
          • /hadoop/common/branches/branch-0.21/common/bin
          • /hadoop/common/branches/branch-0.21/.eclipse.templates
          • /hadoop/common/branches/branch-0.21/conf
          • /hadoop/common/branches/branch-0.21-old/src
          • /hadoop/common/branches/branch-0.21/common/NOTICE.txt
          • /hadoop/common/branches/branch-0.21-old/common/LICENSE.txt
          • /hadoop/common/branches/HDFS-326/src/test
          • /hadoop/common/trunk/bin
          • /hadoop/common/trunk/common/src
          • /hadoop/common/branches/branch-0.22/mapreduce/src/test
          • /hadoop/common/branches/HDFS-1073
          • /hadoop/common/branches/branch-0.21-old/ivy
          • /hadoop/common/branches/yahoo-merge/README.txt
          • /hadoop/common/tags/release-0.21.0/bin
          • /hadoop/common/branches/yahoo-merge/src
          • /hadoop/common/branches/branch-0.21/common/conf
          • /hadoop/common/trunk/common/ivy
          • /hadoop/common/branches/branch-0.21-old/hdfs
          • /hadoop/common/trunk/hdfs
          • /hadoop/common/branches/HDFS-1073/mapreduce/src/test
          • /hadoop/common/tags/release-0.21.0/common/build.xml
          • /hadoop/common/trunk/ivy.xml
          • /hadoop/common/branches/yahoo-merge/ivy
          • /hadoop/common/tags/release-0.21.0/.gitignore
          • /hadoop/common/branches/MR-279/mapreduce
          • /hadoop/common/site/build.xml
          • /hadoop/common/branches/branch-0.21/common/LICENSE.txt
          • /hadoop/common/tags/release-0.21.0/common/.gitignore
          • /hadoop/common/tags/release-0.21.0/common/src
          • /hadoop/common/branches/branch-0.22/common/.gitignore
          • /hadoop/common/trunk/LICENSE.txt
          • /hadoop/common/branches/branch-0.21-old/mapreduce
          • /hadoop/common/site/common/publish/docs
          • /hadoop/common/branches/MR-279
          • /hadoop/common/branches/yahoo-merge/hdfs
          • /hadoop/common/branches/branch-0.21-old/bin
          • /hadoop/common/tags/release-0.21.0/common/ivy
          • /hadoop/common/tags/release-0.21.0/LICENSE.txt
          • /hadoop/common/branches/branch-0.21/src
          • /hadoop/common/trunk/common/bin
          • /hadoop/common/branches/branch-0.22/hdfs/src/test
          • /hadoop/common/trunk/.eclipse.templates
          • /hadoop/common/branches/yahoo-merge/bin
          • /hadoop/common/branches/yahoo-merge/common/.eclipse.templates
          • /hadoop/common/branches/branch-0.21/ivy
          • /hadoop/common/trunk/common
          • /hadoop/common/site/common/author
          • /hadoop/common/branches/branch-0.21-old/common/README.txt
          • /hadoop/common/branches/branch-0.22/.gitignore
          • /hadoop/common/branches/branch-0.21-old/README.txt
          • /hadoop/common/branches/yahoo-merge/NOTICE.txt
          • /hadoop/common/trunk/common/ivy.xml
          • /hadoop/common/branches/branch-0.21-old/common/build.xml
          • /hadoop/common/branches/MR-279/hdfs/src/test
          • /hadoop/common/branches/MR-279/common
          • /hadoop/site/author
          • /hadoop/common/branches/yahoo-merge/ivy.xml
          • /hadoop/common/branches/MAPREDUCE-233/src/test
          • /hadoop/common/branches/yahoo-merge/common/lib
          • /hadoop/common/branches/branch-0.22/common/src
          • /hadoop/common/branches/HDFS-1073/mapreduce
          • /hadoop/common/branches/yahoo-merge/build.xml
          • /hadoop/common/tags/release-0.21.0/common/bin
          • /hadoop/common/branches/branch-0.21-old/LICENSE.txt
          • /hadoop/common/branches/branch-0.21-old/hdfs/src/test
          • /hadoop/common/tags/release-0.21.0/conf
          • /hadoop/common/tags/release-0.21.0/.eclipse.templates
          • /hadoop/common/branches/HDFS-1052/src/test
          • /hadoop/common/site/mapreduce
          • /hadoop/common/trunk/common/LICENSE.txt
          • /hadoop/common/branches/branch-0.22/common/ivy
          • /hadoop/hdfs
          • /hadoop/common/branches/branch-0.22/hdfs
          • /hadoop/common/branches/yahoo-merge/LICENSE.txt
          • /hadoop/common/branches/branch-0.22/lib
          • /hadoop/common/branches/branch-0.21/bin
          • /hadoop/common/tags/release-0.21.0/common/.eclipse.templates
          • /hadoop/common/branches/branch-0.22/common/.eclipse.templates
          • /hadoop/common/branches/branch-0.21/README.txt
          • /hadoop/common/trunk/common/.gitignore
          • /hadoop/common/branches/MR-279/hdfs
          • /hadoop/common/site/mapreduce/author/src/documentation
          • /hadoop/common/branches/MR-279/mapreduce/src/test
          • /hadoop/common/site/main/publish
          • /hadoop/common/site/main
          • /hadoop/common/tags/release-0.21.0/build.xml
          • /hadoop/common/branches/branch-0.22/build.xml
          • /hadoop/common/branches/yahoo-merge/common/CHANGES.txt
          • /hadoop/common/branches/branch-0.21-old/common/NOTICE.txt
          • /hadoop/common/tags/release-0.21.0/common/LICENSE.txt
          • /hadoop/common/branches/branch-0.21-old/NOTICE.txt
          • /hadoop/common/branches/branch-0.21/common/.gitignore
          • /hadoop/common/branches/branch-0.22/common/bin
          • /hadoop/common/trunk/hdfs/src/test
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #728 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/728/ ) HADOOP-7106 . Reorganize SVN layout to combine HDFS, Common, and MR in a single tree (project unsplit) todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1134994 Files : /hadoop/common/branches/branch-0.22/.eclipse.templates /hadoop/common/branches/branch-0.21-old/common/lib /hadoop/common/branches/branch-0.21/LICENSE.txt /hadoop/common/branches/branch-0.22/common /hadoop/common/branches/branch-0.21-old/conf /hadoop/common/branches/yahoo-merge/mapreduce /hadoop/common/trunk/conf /hadoop/common/site/hdfs /hadoop/common/branches/branch-0.22/CHANGES.txt /hadoop/common/site/author /hadoop/common/branches/branch-0.22/common/ivy.xml /hadoop/common/branches/branch-0.21-old/common /hadoop/zookeeper /hadoop/common/branches/ HDFS-1073 /common /hadoop/pig /hadoop/common/branches/branch-0.21-old/common/ivy.xml /hadoop/common/trunk/README.txt /hadoop/common/branches/branch-0.21/NOTICE.txt /hadoop/common/branches/yahoo-merge/common/README.txt /hadoop/common/branches/branch-0.22/common/LICENSE.txt /hadoop/common/branches/yahoo-merge/conf /hadoop/common/branches/branch-0.21/common/lib /hadoop/common/trunk/lib /hadoop/common/trunk/common/.eclipse.templates /hadoop/common/branches/branch-0.21-old/common/CHANGES.txt /hadoop/common/tags/release-0.21.0/mapreduce /hadoop/common/branches/branch-0.22/mapreduce /hadoop/common/tags/release-0.21.0/lib /hadoop/common/branches/branch-0.21/common /hadoop/common/branches/ HDFS-265 /src/test /hadoop/site/build.xml /hadoop/common/branches/branch-0.21/common/.eclipse.templates /hadoop/common/branches/branch-0.22/common/conf /hadoop/common/branches/branch-0.21-old/mapreduce/src/test /hadoop/common/tags/release-0.21.0/README.txt /hadoop/common/branches/branch-0.21/common/ivy.xml /hadoop/common/branches/yahoo-merge/.gitignore /hadoop/common/site/common/build.xml /hadoop/common/trunk/build.xml /hadoop/common/tags/release-0.21.0/common/README.txt /hadoop/common/tags/release-0.21.0/ivy.xml /hadoop/common/branches/branch-0.22/common/README.txt /hadoop/common/branches/branch-0.21/build.xml /hadoop/common/branches/yahoo-merge/common/src /hadoop/common/trunk/NOTICE.txt /hadoop/common/branches/branch-0.21/common/CHANGES.txt /hadoop/common/site/main/build.xml /hadoop/common/branches/branch-0.22/conf /hadoop/common/trunk/CHANGES.txt /hadoop/common/branches/branch-0.21-old/lib /hadoop/common/branches/yahoo-merge/common/ivy /hadoop/common/branches/ HDFS-265 /hadoop/common/branches/yahoo-merge/common/NOTICE.txt /hadoop/common/trunk/common/lib /hadoop/common/branches/branch-0.21/hdfs /hadoop/common/tags/release-0.21.0/hdfs/src/test /hadoop/common/branches/branch-0.21/mapreduce/src/test /hadoop/common/tags/release-0.21.0/CHANGES.txt /hadoop/common/branches/branch-0.22/src /hadoop/common/branches/yahoo-merge/lib /hadoop/common/branches/branch-0.22/README.txt /hadoop/common/site/common/author/src/documentation /hadoop/common/branches/branch-0.22/ivy /hadoop/common/branches/ MAPREDUCE-233 /hadoop/common/branches/branch-0.21-old/ivy.xml /hadoop/common/tags/release-0.21.0/NOTICE.txt /hadoop/common/branches/branch-0.21-old/common/.gitignore /hadoop/common/trunk/common/build.xml /hadoop/common/branches/branch-0.21-old/.gitignore /hadoop/common/branches/yahoo-merge/common/bin /hadoop/common/trunk/mapreduce /hadoop/common/branches/yahoo-merge/.eclipse.templates /hadoop/common/tags/release-0.21.0/common/lib /hadoop/common/tags/release-0.21.0/common/NOTICE.txt /hadoop/common/branches/branch-0.22/common/NOTICE.txt /hadoop/common/branches/branch-0.21-old/CHANGES.txt /hadoop/site/publish /hadoop/common/branches/branch-0.21-old/common/src /hadoop/common/trunk/common/conf /hadoop/common/branches/branch-0.21/mapreduce /hadoop/common/branches/yahoo-merge/common /hadoop/common/trunk/common/CHANGES.txt /hadoop/common/branches/branch-0.21/lib /hadoop/common/tags/release-0.21.0/common /hadoop/common/branches/ HDFS-1052 /hadoop/common/site/common/publish /hadoop/common/site/common /hadoop/common/branches/yahoo-merge/CHANGES.txt /hadoop/common/branches/yahoo-merge/common/ivy.xml /hadoop/common/tags/release-0.21.0/common/conf /hadoop/common/branches/branch-0.22/bin /hadoop/common/branches/branch-0.21-old/common/ivy /hadoop/common/branches/yahoo-merge/common/build.xml /hadoop/common/trunk/mapreduce/src/test /hadoop/common/tags/release-0.21.0/common/ivy.xml /hadoop/common/branches/ HDFS-1073 /hdfs /hadoop/common/trunk/common/README.txt /hadoop/common/site/publish /hadoop/common/branches/branch-0.21/common/build.xml /hadoop/common/site/hdfs/author/src/documentation /hadoop/common/branches/branch-0.21/.gitignore /hadoop/common/branches/branch-0.22/NOTICE.txt /hadoop/common/branches/branch-0.21/common/README.txt /hadoop/common/branches/branch-0.21/ivy.xml /hadoop/common/branches/branch-0.22/ivy.xml /hadoop/common/branches/yahoo-merge/common/LICENSE.txt /hadoop/common/branches/branch-0.21/common/src /hadoop/common/branches/ HDFS-1073 /hdfs/src/test /hadoop/common/branches/branch-0.22/common/lib /hadoop/common/tags/release-0.21.0/common/CHANGES.txt /hadoop/common/trunk/src /hadoop/common/site/main/author /hadoop/common/branches/branch-0.21/common/ivy /hadoop/common/branches/branch-0.21-old/common/.eclipse.templates /hadoop/common/branches/branch-0.21-old/common/conf /hadoop/common/branches/branch-0.21/hdfs/src/test /hadoop/common/tags/release-0.21.0/hdfs /hadoop/common/branches/branch-0.21-old/common/bin /hadoop/common/tags/release-0.21.0/src /hadoop/common/branches/branch-0.21-old/.eclipse.templates /hadoop/mapreduce /hadoop/common/branches/branch-0.22/LICENSE.txt /hadoop/common/tags/release-0.21.0/mapreduce/src/test /hadoop/common/trunk/ivy /hadoop/common/branches/branch-0.21/CHANGES.txt /hadoop/common/branches/ HDFS-326 /hadoop/hive /hadoop/common/branches/yahoo-merge/common/conf /hadoop/common/tags/release-0.21.0/ivy /hadoop/common/branches/branch-0.22/common/build.xml /hadoop/common/branches/branch-0.21-old/build.xml /hadoop/common/trunk/common/NOTICE.txt /hadoop/common/trunk/.gitignore /hadoop/common/branches/branch-0.22/common/CHANGES.txt /hadoop/common/branches/yahoo-merge/common/.gitignore /hadoop/common/branches/branch-0.21/common/bin /hadoop/common/branches/branch-0.21/.eclipse.templates /hadoop/common/branches/branch-0.21/conf /hadoop/common/branches/branch-0.21-old/src /hadoop/common/branches/branch-0.21/common/NOTICE.txt /hadoop/common/branches/branch-0.21-old/common/LICENSE.txt /hadoop/common/branches/ HDFS-326 /src/test /hadoop/common/trunk/bin /hadoop/common/trunk/common/src /hadoop/common/branches/branch-0.22/mapreduce/src/test /hadoop/common/branches/ HDFS-1073 /hadoop/common/branches/branch-0.21-old/ivy /hadoop/common/branches/yahoo-merge/README.txt /hadoop/common/tags/release-0.21.0/bin /hadoop/common/branches/yahoo-merge/src /hadoop/common/branches/branch-0.21/common/conf /hadoop/common/trunk/common/ivy /hadoop/common/branches/branch-0.21-old/hdfs /hadoop/common/trunk/hdfs /hadoop/common/branches/ HDFS-1073 /mapreduce/src/test /hadoop/common/tags/release-0.21.0/common/build.xml /hadoop/common/trunk/ivy.xml /hadoop/common/branches/yahoo-merge/ivy /hadoop/common/tags/release-0.21.0/.gitignore /hadoop/common/branches/MR-279/mapreduce /hadoop/common/site/build.xml /hadoop/common/branches/branch-0.21/common/LICENSE.txt /hadoop/common/tags/release-0.21.0/common/.gitignore /hadoop/common/tags/release-0.21.0/common/src /hadoop/common/branches/branch-0.22/common/.gitignore /hadoop/common/trunk/LICENSE.txt /hadoop/common/branches/branch-0.21-old/mapreduce /hadoop/common/site/common/publish/docs /hadoop/common/branches/MR-279 /hadoop/common/branches/yahoo-merge/hdfs /hadoop/common/branches/branch-0.21-old/bin /hadoop/common/tags/release-0.21.0/common/ivy /hadoop/common/tags/release-0.21.0/LICENSE.txt /hadoop/common/branches/branch-0.21/src /hadoop/common/trunk/common/bin /hadoop/common/branches/branch-0.22/hdfs/src/test /hadoop/common/trunk/.eclipse.templates /hadoop/common/branches/yahoo-merge/bin /hadoop/common/branches/yahoo-merge/common/.eclipse.templates /hadoop/common/branches/branch-0.21/ivy /hadoop/common/trunk/common /hadoop/common/site/common/author /hadoop/common/branches/branch-0.21-old/common/README.txt /hadoop/common/branches/branch-0.22/.gitignore /hadoop/common/branches/branch-0.21-old/README.txt /hadoop/common/branches/yahoo-merge/NOTICE.txt /hadoop/common/trunk/common/ivy.xml /hadoop/common/branches/branch-0.21-old/common/build.xml /hadoop/common/branches/MR-279/hdfs/src/test /hadoop/common/branches/MR-279/common /hadoop/site/author /hadoop/common/branches/yahoo-merge/ivy.xml /hadoop/common/branches/ MAPREDUCE-233 /src/test /hadoop/common/branches/yahoo-merge/common/lib /hadoop/common/branches/branch-0.22/common/src /hadoop/common/branches/ HDFS-1073 /mapreduce /hadoop/common/branches/yahoo-merge/build.xml /hadoop/common/tags/release-0.21.0/common/bin /hadoop/common/branches/branch-0.21-old/LICENSE.txt /hadoop/common/branches/branch-0.21-old/hdfs/src/test /hadoop/common/tags/release-0.21.0/conf /hadoop/common/tags/release-0.21.0/.eclipse.templates /hadoop/common/branches/ HDFS-1052 /src/test /hadoop/common/site/mapreduce /hadoop/common/trunk/common/LICENSE.txt /hadoop/common/branches/branch-0.22/common/ivy /hadoop/hdfs /hadoop/common/branches/branch-0.22/hdfs /hadoop/common/branches/yahoo-merge/LICENSE.txt /hadoop/common/branches/branch-0.22/lib /hadoop/common/branches/branch-0.21/bin /hadoop/common/tags/release-0.21.0/common/.eclipse.templates /hadoop/common/branches/branch-0.22/common/.eclipse.templates /hadoop/common/branches/branch-0.21/README.txt /hadoop/common/trunk/common/.gitignore /hadoop/common/branches/MR-279/hdfs /hadoop/common/site/mapreduce/author/src/documentation /hadoop/common/branches/MR-279/mapreduce/src/test /hadoop/common/site/main/publish /hadoop/common/site/main /hadoop/common/tags/release-0.21.0/build.xml /hadoop/common/branches/branch-0.22/build.xml /hadoop/common/branches/yahoo-merge/common/CHANGES.txt /hadoop/common/branches/branch-0.21-old/common/NOTICE.txt /hadoop/common/tags/release-0.21.0/common/LICENSE.txt /hadoop/common/branches/branch-0.21-old/NOTICE.txt /hadoop/common/branches/branch-0.21/common/.gitignore /hadoop/common/branches/branch-0.22/common/bin /hadoop/common/trunk/hdfs/src/test
          Hide
          Todd Lipcon added a comment -

          I think all the pieces of this are complete now, so marking resolved. Thanks to the many people who contributed: Nigel, Owen, Doug, Ian, Jukka, etc.

          Show
          Todd Lipcon added a comment - I think all the pieces of this are complete now, so marking resolved. Thanks to the many people who contributed: Nigel, Owen, Doug, Ian, Jukka, etc.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #746 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/746/)

          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #746 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/746/ )
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #722 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/722/)

          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #722 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/722/ )

            People

            • Assignee:
              Todd Lipcon
              Reporter:
              Nigel Daley
            • Votes:
              0 Vote for this issue
              Watchers:
              23 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development