Infrastructure
  1. Infrastructure
  2. INFRA-4081

Thrift compiler install on ubuntu jenkins slaves

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Fix Version/s: Initial Clearing
    • Component/s: Jenkins
    • Labels:
      None

      Description

      Flume uses thrift internally for RPC. The build process currently requires the thrift compiler to be available to generate Java bindings. Could we get thrift 0.6.0 and 0.7.0 installed on (at least) the ubuntu build slaves?

      Thanks in advance.

        Issue Links

          Activity

          Hide
          Niklas Gustavsson added a comment -
          Please provide instructions for how to set it up, and I'll get to it.
          Show
          Niklas Gustavsson added a comment - Please provide instructions for how to set it up, and I'll get to it.
          Hide
          E. Sammer added a comment -
          Niklas:

          Versions 0.6.1 and 0.7.0 are available at http://www.apache.org/dist/thrift/ and simply use autotools for their build. The build process has support for various languages (Java, C/C++, ruby, etc.) but I'm primarily interested in Java. You may or may not need to specify JAVA_HOME to get the build process to find the JDK (which should be 1.6.x). Otherwise, it should just be a standard configure, make, make install. Not sure if there are packages that make this easier but those would be fine too, provided we can get parallel versions installed to support multiple branches of the build.

          Let me know if I can help. Thanks again!
          Show
          E. Sammer added a comment - Niklas: Versions 0.6.1 and 0.7.0 are available at http://www.apache.org/dist/thrift/ and simply use autotools for their build. The build process has support for various languages (Java, C/C++, ruby, etc.) but I'm primarily interested in Java. You may or may not need to specify JAVA_HOME to get the build process to find the JDK (which should be 1.6.x). Otherwise, it should just be a standard configure, make, make install. Not sure if there are packages that make this easier but those would be fine too, provided we can get parallel versions installed to support multiple branches of the build. Let me know if I can help. Thanks again!
          Hide
          Jake Farrell added a comment -
          We have deb packages available for use which should be used rather than doing a full make/make install. let me know if you would like me to help with this
          Show
          Jake Farrell added a comment - We have deb packages available for use which should be used rather than doing a full make/make install. let me know if you would like me to help with this
          Hide
          Niklas Gustavsson added a comment -
          deb packages would be great, are they available in some repo somewhere?
          Show
          Niklas Gustavsson added a comment - deb packages would be great, are they available in some repo somewhere?
          Hide
          Jake Farrell added a comment -
          We just released 0.8, are you going to be needing that as well? Why the need for so many versions of the compiler? it would be easier for infra to manage if just the latest version was on the servers installed as a deb rather than having to maintain separate paths for multiple versions of thrift
          Show
          Jake Farrell added a comment - We just released 0.8, are you going to be needing that as well? Why the need for so many versions of the compiler? it would be easier for infra to manage if just the latest version was on the servers installed as a deb rather than having to maintain separate paths for multiple versions of thrift
          Hide
          Niklas Gustavsson added a comment -
          Where could we find the deb packages?
          Show
          Niklas Gustavsson added a comment - Where could we find the deb packages?
          Hide
          #asfinfra IRC Bot added a comment -
          <gmcdonald> dont worry nilkas, got it in hand
          Show
          #asfinfra IRC Bot added a comment - <gmcdonald> dont worry nilkas, got it in hand
          Hide
          Gavin added a comment -
          Ok, so far then I've installed the latest 0.80 deb package onto Ubuntu1 only (Minerva) , tied the Flume Trunk job to that slave for now, fixed the path to thrift , and ran a test build , which failed with error : "...message : No goals have been specified for this build..." . See https://builds.apache.org/view/A-F/view/Flume/job/flume-trunk/2/console for details.

          Please check the build, tweak your pom as required, re-run the build MANUALLY for now until we get it right. Please give feedback as to what else might be required on the slave. Once we have this one done, I'll then install thrift on the remaining Ubuntu slaves once you have a passing build.
          Show
          Gavin added a comment - Ok, so far then I've installed the latest 0.80 deb package onto Ubuntu1 only (Minerva) , tied the Flume Trunk job to that slave for now, fixed the path to thrift , and ran a test build , which failed with error : "...message : No goals have been specified for this build..." . See https://builds.apache.org/view/A-F/view/Flume/job/flume-trunk/2/console for details. Please check the build, tweak your pom as required, re-run the build MANUALLY for now until we get it right. Please give feedback as to what else might be required on the slave. Once we have this one done, I'll then install thrift on the remaining Ubuntu slaves once you have a passing build.
          Hide
          Tony Stevenson added a comment -
          Transitioning to waiting for Infra
          Show
          Tony Stevenson added a comment - Transitioning to waiting for Infra
          Hide
          Jake Farrell added a comment -
          Latest version installed on Ubuntu1 and working

          jfarrell@minerva:~$ dpkg -l |grep thrift
          ii thrift-compiler 0.9.0 Compiler for Thrift definition files
          jfarrell@minerva:~$ thrift -version
          Thrift version 0.9.0
          Show
          Jake Farrell added a comment - Latest version installed on Ubuntu1 and working jfarrell@minerva :~$ dpkg -l |grep thrift ii thrift-compiler 0.9.0 Compiler for Thrift definition files jfarrell@minerva :~$ thrift -version Thrift version 0.9.0
          Hide
          Gavin added a comment -
          pctony/jake, lets make this deb package available via pkgrepo.a.o to make things easier. (?)
          Show
          Gavin added a comment - pctony/jake, lets make this deb package available via pkgrepo.a.o to make things easier. (?)
          Hide
          Jake Farrell added a comment -
          installed on vesta now
          Show
          Jake Farrell added a comment - installed on vesta now
          Hide
          Jake Farrell added a comment -
          Installed on hemera
          Show
          Jake Farrell added a comment - Installed on hemera
          Hide
          Jake Farrell added a comment -
          Janus and Juno now done. All build slaves that you are using now have latest thrift compiler available
          Show
          Jake Farrell added a comment - Janus and Juno now done. All build slaves that you are using now have latest thrift compiler available

            People

            • Assignee:
              Jake Farrell
              Reporter:
              E. Sammer
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development