Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.15.0
    • Fix Version/s: 0.16.0
    • Component/s: build
    • Labels:
      None

      Description

      If you checkout the trunk to a folder long than /tmp (in my case it is "/home/adrian/workspace/hadoop-trunk") and you execute the command:

      ant clean package

      You get the following error:

      BUILD FAILED
      /home/adrian/workspace/hadoop-trunk/build.xml:730: Execute failed: java.io.IOException: Cannot run program "chmod": java.io.IOException: error=7, Argument list too long

      I also tried this from the folder "/tmp/trunk" and the package target worked fine so I imagine the argument list is becoming too long due to the folder being longer. A simple fix for this should be to set the "parallel" attribute on chmod to false.

      1. HADOOP-2271-1.patch
        0.4 kB
        Adrian Woodhead

        Activity

        Hide
        Adrian Woodhead added a comment -

        Code review please - simple one line fix to add parallel="false" to chmod call.

        Show
        Adrian Woodhead added a comment - Code review please - simple one line fix to add parallel="false" to chmod call.
        Hide
        Adrian Woodhead added a comment -

        Patch available.

        Show
        Adrian Woodhead added a comment - Patch available.
        Hide
        stack added a comment -

        +1 on patch. Looks good. Applied for me and it ran w/o issue. But, on my local machine at least, I do not have original problem of 'ant clean package' failing.

        Show
        stack added a comment - +1 on patch. Looks good. Applied for me and it ran w/o issue. But, on my local machine at least, I do not have original problem of 'ant clean package' failing.
        Hide
        stack added a comment -

        Path to my hadoop: /Users/stack/Documents/checkouts/hadoop-trunk.

        Show
        stack added a comment - Path to my hadoop: /Users/stack/Documents/checkouts/hadoop-trunk.
        Hide
        Adrian Woodhead added a comment -

        Interesting that you don't have the issue while having a longer path. Maybe it has something to do with version of chmod or shell? We experienced the error on both machines we tried it on here with similar length paths.

        Show
        Adrian Woodhead added a comment - Interesting that you don't have the issue while having a longer path. Maybe it has something to do with version of chmod or shell? We experienced the error on both machines we tried it on here with similar length paths.
        Hide
        stack added a comment -

        mac os x 10.4.11. Just tried it on Fedora Core 6 w/ path of /home/stack/hadoop-trunk and didn't have the prob. there either.

        Show
        stack added a comment - mac os x 10.4.11. Just tried it on Fedora Core 6 w/ path of /home/stack/hadoop-trunk and didn't have the prob. there either.
        Hide
        Adrian Woodhead added a comment -

        /home/stack/hadoop-trunk is too short to cause the problem (works here too), if u can, try with a path of at least 35 chars (not sure what the exact cut-off is). Machines we tested on were Ubuntu...

        Show
        Adrian Woodhead added a comment - /home/stack/hadoop-trunk is too short to cause the problem (works here too), if u can, try with a path of at least 35 chars (not sure what the exact cut-off is). Machines we tested on were Ubuntu...
        Hide
        stack added a comment -

        Maybe just ubuntu? I tried w/ 1.5 and 1.6.

        [stack@aa0-000-12 hadoop-trunk]$ pwd/home/stack/long-path/long-path/long-path/long-path/long-path/hadoop-trunk
        [stack@aa0-000-12 hadoop-trunk]$ ~/bin/ant/bin/ant clean package
        ...
         [copy] Copied 106 empty directories to 3 empty directories under /home/stack/long-path/long-path/long-path/long-path/long-path/hadoop-trunk/build/hadoop-0.16.0-dev/docs     [copy] Copying 4 files to /home/stack/long-path/long-path/long-path/long-path/long-path/hadoop-trunk/build/hadoop-0.16.0-dev     [copy] Copying 1200 files to /home/stack/long-path/long-path/long-path/long-path/long-path/hadoop-trunk/build/hadoop-0.16.0-dev/src     [copy] Copying 1 file to /home/stack/long-path/long-path/long-path/long-path/long-path/hadoop-trunk/build/hadoop-0.16.0-devBUILD SUCCESSFULTotal time: 43 seconds
        
        Show
        stack added a comment - Maybe just ubuntu? I tried w/ 1.5 and 1.6. [stack@aa0-000-12 hadoop-trunk]$ pwd/home/stack/ long -path/ long -path/ long -path/ long -path/ long -path/hadoop-trunk [stack@aa0-000-12 hadoop-trunk]$ ~/bin/ant/bin/ant clean package ... [copy] Copied 106 empty directories to 3 empty directories under /home/stack/ long -path/ long -path/ long -path/ long -path/ long -path/hadoop-trunk/build/hadoop-0.16.0-dev/docs [copy] Copying 4 files to /home/stack/ long -path/ long -path/ long -path/ long -path/ long -path/hadoop-trunk/build/hadoop-0.16.0-dev [copy] Copying 1200 files to /home/stack/ long -path/ long -path/ long -path/ long -path/ long -path/hadoop-trunk/build/hadoop-0.16.0-dev/src [copy] Copying 1 file to /home/stack/ long -path/ long -path/ long -path/ long -path/ long -path/hadoop-trunk/build/hadoop-0.16.0-devBUILD SUCCESSFULTotal time: 43 seconds
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12370130/HADOOP-2271-1.patch
        against trunk revision r597663.

        @author +1. The patch does not contain any @author tags.

        javadoc +1. The javadoc tool did not generate any warning messages.

        javac +1. The applied patch does not generate any new compiler warnings.

        findbugs -1. The patch appears to introduce new Findbugs warnings.

        core tests +1. The patch passed core unit tests.

        contrib tests +1. The patch passed contrib unit tests.

        Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1148/testReport/
        Findbugs warnings: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1148/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
        Checkstyle results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1148/artifact/trunk/build/test/checkstyle-errors.html
        Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1148/console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12370130/HADOOP-2271-1.patch against trunk revision r597663. @author +1. The patch does not contain any @author tags. javadoc +1. The javadoc tool did not generate any warning messages. javac +1. The applied patch does not generate any new compiler warnings. findbugs -1. The patch appears to introduce new Findbugs warnings. core tests +1. The patch passed core unit tests. contrib tests +1. The patch passed contrib unit tests. Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1148/testReport/ Findbugs warnings: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1148/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1148/artifact/trunk/build/test/checkstyle-errors.html Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1148/console This message is automatically generated.
        Hide
        Adrian Woodhead added a comment -

        Cancelling so can re-apply patch now that findbugs appears to be working again

        Show
        Adrian Woodhead added a comment - Cancelling so can re-apply patch now that findbugs appears to be working again
        Hide
        Adrian Woodhead added a comment -

        See if patch passes hudson now that findbugs appears to be working again

        Show
        Adrian Woodhead added a comment - See if patch passes hudson now that findbugs appears to be working again
        Hide
        Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12370130/HADOOP-2271-1.patch
        against trunk revision r598699.

        @author +1. The patch does not contain any @author tags.

        javadoc +1. The javadoc tool did not generate any warning messages.

        javac +1. The applied patch does not generate any new compiler warnings.

        findbugs +1. The patch does not introduce any new Findbugs warnings.

        core tests +1. The patch passed core unit tests.

        contrib tests +1. The patch passed contrib unit tests.

        Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1178/testReport/
        Findbugs warnings: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1178/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
        Checkstyle results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1178/artifact/trunk/build/test/checkstyle-errors.html
        Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1178/console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12370130/HADOOP-2271-1.patch against trunk revision r598699. @author +1. The patch does not contain any @author tags. javadoc +1. The javadoc tool did not generate any warning messages. javac +1. The applied patch does not generate any new compiler warnings. findbugs +1. The patch does not introduce any new Findbugs warnings. core tests +1. The patch passed core unit tests. contrib tests +1. The patch passed contrib unit tests. Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1178/testReport/ Findbugs warnings: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1178/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1178/artifact/trunk/build/test/checkstyle-errors.html Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1178/console This message is automatically generated.
        Hide
        Adrian Woodhead added a comment -

        Not sure why this has been re-assigned back to me.

        Hudson seems happy with it so surely someone with commit rights should do a review and decide whether my patch should be committed or not?

        Show
        Adrian Woodhead added a comment - Not sure why this has been re-assigned back to me. Hudson seems happy with it so surely someone with commit rights should do a review and decide whether my patch should be committed or not?
        Hide
        Adrian Woodhead added a comment -

        (see my previous comment)

        Show
        Adrian Woodhead added a comment - (see my previous comment)
        Hide
        Doug Cutting added a comment -

        Assigning it to you just gives you credit for providing the fix. It doesn't mean you're expected to do anything more right now.

        Show
        Doug Cutting added a comment - Assigning it to you just gives you credit for providing the fix. It doesn't mean you're expected to do anything more right now.
        Hide
        Owen O'Malley added a comment -

        Sorry, I was just trying to sweep through and assign owners so that later we can figure out who did what. I like to be able to get the list of contributers and how many patches they have submitted. It helps when looking for new committers if the fixed jiras are assigned to the person who submitted the patch.

        Show
        Owen O'Malley added a comment - Sorry, I was just trying to sweep through and assign owners so that later we can figure out who did what. I like to be able to get the list of contributers and how many patches they have submitted. It helps when looking for new committers if the fixed jiras are assigned to the person who submitted the patch.
        Hide
        Adrian Woodhead added a comment -

        Aah ok, that makes sense, I'll assign it back tomyself then, good to know how you guys work as when I've used Jira in the past the person who it is assigned it is the one who is responsible for whatever happens next. Thanks for the clarification.

        Show
        Adrian Woodhead added a comment - Aah ok, that makes sense, I'll assign it back tomyself then, good to know how you guys work as when I've used Jira in the past the person who it is assigned it is the one who is responsible for whatever happens next. Thanks for the clarification.
        Hide
        Owen O'Malley added a comment -

        I just committed this. Thanks, Adrian!

        Show
        Owen O'Malley added a comment - I just committed this. Thanks, Adrian!
        Hide
        Hudson added a comment -
        Show
        Hudson added a comment - Integrated in Hadoop-Nightly #326 (See http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/326/ )

          People

          • Assignee:
            Adrian Woodhead
            Reporter:
            Adrian Woodhead
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development