Whirr
  1. Whirr
  2. WHIRR-573

Allow specification of REPO_HOST for RPMs/debs

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: None
    • Labels:
      None

      Description

      This would allow use of e.g. nightly.cloudera.com, not just archive.cloudera.com.

        Activity

        Hide
        Karel Vervaeke added a comment -

        I would take this a step further. Something along these lines:

        whirr.env.CDH_HOST=archive.cloudera.com
        whirr.env.CDH_RELEASE=cdh3

        whirr.env.CDH_DEB_REPO=http://$

        {whirr.env.CDH_HOST}/debian
        whirr.env.CDH_DEB_DISTRO=@DISTRO@-${whirr.env.CDH_RELEASE}
        whirr.env.CDH_DEB_KEY_URL=http://${whirr.env.CDH_HOST}

        /debian/archive.key

        whirr.env.CDH_RPM_REPO=http://$

        {whirr.env.CDH_HOST}

        /redhat
        whirr.env.CDH_RPM_MIRRORLIST=http://$

        {whirr.env.CDH_RPM_REPO}/cdh/@REPO_NUMBER@/mirrors
        whirr.env.CDH_RPM_GPGKEY=http://${whirr.env.CDH_RPM_REPO}

        /cdh/RPM-GPG-KEY-cloudera

        The @DISTRO@ part and the @REPO_NUMBER@ would be calculated by the shell scripts.

        Bonus points for using a template (WHIRR-370) to generate the cloudera.list/.repo file instead
        of duplicating the content in different shell scripts. (We still need to replace the @DISTRO@ and @REPO_NUMBER@, but a simple 'sed' will do the trick).

        Show
        Karel Vervaeke added a comment - I would take this a step further. Something along these lines: whirr.env.CDH_HOST=archive.cloudera.com whirr.env.CDH_RELEASE=cdh3 whirr.env.CDH_DEB_REPO= http://$ {whirr.env.CDH_HOST}/debian whirr.env.CDH_DEB_DISTRO=@DISTRO@-${whirr.env.CDH_RELEASE} whirr.env.CDH_DEB_KEY_URL= http://$ {whirr.env.CDH_HOST} /debian/archive.key whirr.env.CDH_RPM_REPO= http://$ {whirr.env.CDH_HOST} /redhat whirr.env.CDH_RPM_MIRRORLIST= http://$ {whirr.env.CDH_RPM_REPO}/cdh/@REPO_NUMBER@/mirrors whirr.env.CDH_RPM_GPGKEY= http://$ {whirr.env.CDH_RPM_REPO} /cdh/RPM-GPG-KEY-cloudera The @DISTRO@ part and the @REPO_NUMBER@ would be calculated by the shell scripts. Bonus points for using a template ( WHIRR-370 ) to generate the cloudera.list/.repo file instead of duplicating the content in different shell scripts. (We still need to replace the @DISTRO@ and @REPO_NUMBER@, but a simple 'sed' will do the trick).
        Hide
        Karel Vervaeke added a comment -

        Use case:
        For whirr development, where you download the packages over and over, it makes sense to set up a caching proxy (e.g. apt-cacher).
        In this case CDH_DEB_REPO should look like this: http://aptcacher01.example.com/apt-cacher/archive.cloudera.org/debian

        Show
        Karel Vervaeke added a comment - Use case: For whirr development, where you download the packages over and over, it makes sense to set up a caching proxy (e.g. apt-cacher). In this case CDH_DEB_REPO should look like this: http://aptcacher01.example.com/apt-cacher/archive.cloudera.org/debian
        Hide
        Karel Vervaeke added a comment -

        Also see WHIRR-562

        Show
        Karel Vervaeke added a comment - Also see WHIRR-562
        Hide
        Tom White added a comment -

        That looks like a good improvement to me. I agree that ideally we would use a template, but we could add that later.

        Show
        Tom White added a comment - That looks like a good improvement to me. I agree that ideally we would use a template, but we could add that later.
        Hide
        Tom White added a comment -

        Here's the simplest version of this which supports REPO_HOST.

        Show
        Tom White added a comment - Here's the simplest version of this which supports REPO_HOST.
        Hide
        Andrew Bayer added a comment -

        +1, once it's tweaked to fit with what's in now (i.e., the CDH4 Debian URLs). I'll hold off on my 12.04/RHEL6 support patch 'til after this is in.

        Show
        Andrew Bayer added a comment - +1, once it's tweaked to fit with what's in now (i.e., the CDH4 Debian URLs). I'll hold off on my 12.04/RHEL6 support patch 'til after this is in.
        Hide
        Andrew Bayer added a comment -

        I'm committing this.

        Show
        Andrew Bayer added a comment - I'm committing this.
        Hide
        Andrew Bayer added a comment -

        In.

        Show
        Andrew Bayer added a comment - In.

          People

          • Assignee:
            Tom White
            Reporter:
            Tom White
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development