Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: service/hadoop
    • Labels:
      None

      Description

      See WHIRR-612 for details.

      1. yarn-whirr-on-aws-failed-test-cdh.txt
        346 kB
        Tom White
      2. yarn-whirr-on-aws-failed-test.txt
        157 kB
        Tom White
      3. WHIRR-629.patch
        2 kB
        Tom White
      4. WHIRR-629.patch
        8 kB
        Tom White
      5. WHIRR-629.patch
        9 kB
        Tom White
      6. WHIRR-629.patch
        10 kB
        Tom White

        Activity

        Hide
        Andrew Bayer added a comment -

        Committed for Tom.

        Show
        Andrew Bayer added a comment - Committed for Tom.
        Hide
        Andrew Bayer added a comment -

        +1

        Show
        Andrew Bayer added a comment - +1
        Hide
        Tom White added a comment -

        That error is the 64 bit problem - Andrew said he had a patch for that, so I'll wait for that.

        This updated patch fixes Apache YARN on AWS which was failing because the /user/history directory was not being created with the correct permissions.

        Show
        Tom White added a comment - That error is the 64 bit problem - Andrew said he had a patch for that, so I'll wait for that. This updated patch fixes Apache YARN on AWS which was failing because the /user/history directory was not being created with the correct permissions.
        Hide
        Tom White added a comment -

        The YARN tests are failing on AWS unfortunately.

        One error that looks relevant is

        W: Failed to fetch http://archive.cloudera.com/cdh4/ubuntu/lucid/amd64/cdh/dists/lucid-cdh4/Release  Unable to find expected entry  contrib/binary-i386/Packages in Meta-index file (malformed Release file?)
        
        E: Some index files failed to download, they have been ignored, or old ones used instead.
        

        (See attached logs for more.)

        Show
        Tom White added a comment - The YARN tests are failing on AWS unfortunately. One error that looks relevant is W: Failed to fetch http://archive.cloudera.com/cdh4/ubuntu/lucid/amd64/cdh/dists/lucid-cdh4/Release Unable to find expected entry contrib/binary-i386/Packages in Meta-index file (malformed Release file?) E: Some index files failed to download, they have been ignored, or old ones used instead. (See attached logs for more.)
        Hide
        Tom White added a comment -

        With this patch all YARN tests now pass on Rackspace.

        Show
        Tom White added a comment - With this patch all YARN tests now pass on Rackspace.
        Hide
        Andrew Bayer added a comment -

        Ok. I'll put off the RC 'til Saturday so that you can get this all figured out.

        Show
        Andrew Bayer added a comment - Ok. I'll put off the RC 'til Saturday so that you can get this all figured out.
        Hide
        Tom White added a comment -

        This patch brings the cluster up correctly so that the client can communicate with it, however running a job fails with a yarn.application.classpath error.

        Next step is to set 'yarn.nodemanager.delete.debug-delay-sec' to something large to allow inspection of the logs to see why the classpath is wrong. I'll try that tomorrow.

        Show
        Tom White added a comment - This patch brings the cluster up correctly so that the client can communicate with it, however running a job fails with a yarn.application.classpath error. Next step is to set 'yarn.nodemanager.delete.debug-delay-sec' to something large to allow inspection of the logs to see why the classpath is wrong. I'll try that tomorrow.

          People

          • Assignee:
            Tom White
            Reporter:
            Tom White
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development