Infrastructure
  1. Infrastructure
  2. INFRA-6361

Configure email on allura-vm.apache.org

    Details

    • Type: Task Task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Fix Version/s: Initial Clearing
    • Component/s: VMWare
    • Labels:
      None

      Description

      Our app needs to be able to send and receive email.

      WHY

      We intend to move our daily development to this Apache-hosted Allura instance, and therefore need email handling to be working correctly.

      SENDING

      Outbound email is for sending notifications to subscribed users when tickets and other artifacts are updated. At this time, Allura does not have a mechanism for detecting or otherwise handling bounced email.

      RECEIVING

      Inbound email is parsed and used to automatically updated discussions on tickets and other artifacts. We have a custom python smtp server for handling inbound email to the app (port is configurable). The inbound addresses will need to be wild cards all the way down to the sub-domain level. Here's an example inbound address:

      123@tickets.allura.p.allura-vm.apache.org

      Email sent to that address will update artifact 123 on the tool named 'tickets' in the project 'allura' in the neighborhood 'p'.
      1. postfix.patch
        0.6 kB
        Tim Van Steenburgh

        Activity

        Hide
        #asfinfra Bot added a comment -
        <danielsh> For the record, can you please spell out what kind of MX records you are requesting? i.e., what are _all_ @foo values you want to support?
        Show
        #asfinfra Bot added a comment - <danielsh> For the record, can you please spell out what kind of MX records you are requesting? i.e., what are _all_ @foo values you want to support?
        Hide
        Tim Van Steenburgh added a comment -
        *.allura-vm.apache.org 86400 IN MX 10 allura-vm.apache.org.
        Show
        Tim Van Steenburgh added a comment - *.allura-vm.apache.org 86400 IN MX 10 allura-vm.apache.org.
        Hide
        #asfinfra Bot added a comment -
        <danielsh> No. We don't hard code service names into externally-visible stuff (that includes the URLs to the service, btw). 'allura.issues.apache.org' as the service name (in URLs and email addresses)?
        Show
        #asfinfra Bot added a comment - <danielsh> No. We don't hard code service names into externally-visible stuff (that includes the URLs to the service, btw). 'allura.issues.apache.org' as the service name (in URLs and email addresses)?
        Hide
        Dave Brondsema added a comment -
        Hi, I'm a bit confused as to exactly what you mean. Is allura-vm the "service name", and it shouldn't being used publicly? I'm not real sure how allura.issues.apache.org is different.

        I had thought we sorted this out on the infra mailing list (thread "Configuring email on allura-vm.apache.org"), but perhaps the end of that discussion wasn't consensus.

        At the end of the day I think we (the Allura podling) would be fine with whatever is easiest for Infra to set up for us. If using allura-vm.a.o is okay while we dogfood in incubation, that'd be my preference, but I'm fine with whatever works. My preference after graduation, as a foundation-wide offering would be forge.apache.org (since allura features are much broader than just issues)
        Show
        Dave Brondsema added a comment - Hi, I'm a bit confused as to exactly what you mean. Is allura-vm the "service name", and it shouldn't being used publicly? I'm not real sure how allura.issues.apache.org is different. I had thought we sorted this out on the infra mailing list (thread "Configuring email on allura-vm.apache.org"), but perhaps the end of that discussion wasn't consensus. At the end of the day I think we (the Allura podling) would be fine with whatever is easiest for Infra to set up for us. If using allura-vm.a.o is okay while we dogfood in incubation, that'd be my preference, but I'm fine with whatever works. My preference after graduation, as a foundation-wide offering would be forge.apache.org (since allura features are much broader than just issues)
        Hide
        Dave Brondsema added a comment -
        Per infrastructure@ thread, domain will be allura.forge.apache.org
        Show
        Dave Brondsema added a comment - Per infrastructure@ thread, domain will be allura.forge.apache.org
        Hide
        #asfinfra Bot added a comment -
        <danielsh> I believe this has been done, can you confirm?
        Show
        #asfinfra Bot added a comment - <danielsh> I believe this has been done, can you confirm?
        Hide
        Tim Van Steenburgh added a comment -
        Outbound email (generated by Allura) is working well. Still some issues with inbound. Replying to a ticket notification, my email bounced with the following error:

        Delivery to the following recipient failed permanently:

        1@tickets.test.p.allura.forge.apache.org

        Technical details of permanent failure:
        DNS Error: Domain name not found
        ---

        Full email contents:

        Delivered-To: tvansteenburgh@gmail.com
        Received: by 10.52.30.104 with SMTP id r8csp97845vdh;
                Fri, 23 Aug 2013 10:07:33 -0700 (PDT)
        DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
                d=googlemail.com; s=20120113;
                h=mime-version:from:to:subject:message-id:date:content-type
                 :content-transfer-encoding;
                bh=vE4p6+/4ra3mo2gKPnM0bZO9DBlcZ8gjBC8VH/KVtno=;
                b=CubxYAbB27YgB0jZBaPRqYdxI4U+t6uQDNLPCL2aHl7AaKGWmv8Ggxtg/9jSD3BtoC
                 28chm1GCoNR2Z3HyUlDoMSiBumofO03rwB3HzbxygHw5IKMvnpz25F/N6BfpaL2Nn5mK
                 X8nbL6quSsfxJCvd+mIZRw+UmRMpYo5hy2s7Q/dZCWZUrRxRNYoI0/OFXrVEY8iljjTD
                 vS6hguoMA7TIplqiLeqqyaro4bwFqFbv5qMC0bZEXY6JnD2sIoHGG+n6yMGDFwJfW13K
                 fgeRJe5XNkl2AXpccSm7j+U9nB6meTnJWuFfnT4R4aT8Bk6v7DZwN8OCf8RGsG+Gzkh3
                 PZlA==
        X-Received: by 10.60.141.225 with SMTP id rr1mr559282oeb.55.1377277653337;
                Fri, 23 Aug 2013 10:07:33 -0700 (PDT)
        MIME-Version: 1.0
        Return-Path: <>
        Received: by 10.60.141.225 with SMTP id rr1mr626193oeb.55; Fri, 23 Aug 2013
         10:07:33 -0700 (PDT)
        From: Mail Delivery Subsystem <mailer-daemon@googlemail.com>
        To: tvansteenburgh@gmail.com
        X-Failed-Recipients: 1@tickets.test.p.allura.forge.apache.org
        Subject: Delivery Status Notification (Failure)
        Message-ID: <047d7b472a4048c4fb04e4a07187@google.com>
        Date: Fri, 23 Aug 2013 17:07:33 +0000
        Content-Type: text/plain; charset=windows-1252
        Content-Transfer-Encoding: quoted-printable

        Delivery to the following recipient failed permanently:

             1@tickets.test.p.allura.forge.apache.org

        Technical details of permanent failure:=20
        DNS Error: Domain name not found

        ----- Original message -----

        DKIM-Signature: v=3D1; a=3Drsa-sha256; c=3Drelaxed/relaxed;
                d=3Dgmail.com; s=3D20120113;
                h=3Ddate:from:to:message-id:in-reply-to:references:subject:mime-ver=
        sion
                 :content-type;
                bh=3DTVsntCyXux2H6HXgE7BEHHYsgz/nFZG2znXcbr/oaaA=3D;
                b=3Dn5yftOS3sm2Vh8dQTY3dq8UmWhMfCdo13PX2rz+U4RyGmmHP6cSeinLbzLUKuQN=
        ZFR
                 snnbzo7fj81W08KYCZ0UCXoYui/FTfjrla5zu2Lpr8+1O8Ssr/0sdJNPSLGHleVn/R=
        eJ
                 Uyhu87MsWYTYR7EtCf/U1ICjB36P4MrE/k78fd+NtBmWIMk3MWm++M7JcgZNgMAf/A=
        av
                 CBJz5PyYwc8Q91zbAIANtcAJJq/ee9x8VdJ4Y+Vi8J17qHAwOpPYelWjrhPaDqq8/S=
        vH
                 gwn9WBiej9A6EbDk5vUrvxwGOcX+BtrAtn3H5TwizW4ccVmI2CBMMqlw6Olb3WBQra=
        U2
                 2tUQ=3D=3D
        X-Received: by 10.60.141.225 with SMTP id rr1mr559272oeb.55.1377277653100;
                Fri, 23 Aug 2013 10:07:33 -0700 (PDT)
        Return-Path: <tvansteenburgh@gmail.com>
        Received: from [192.168.1.110] (ip98-180-8-47.ga.at.cox.net. [98.180.8.47])
                by mx.google.com with ESMTPSA id hl3sm701378obb.0.1969.12.31.16.00.=
        00
                (version=3DTLSv1 cipher=3DRC4-SHA bits=3D128/128);
                Fri, 23 Aug 2013 10:07:32 -0700 (PDT)
        Date: Fri, 23 Aug 2013 13:07:30 -0400
        From: Tim Van Steenburgh <tvansteenburgh@gmail.com>
        To: =3D?utf-8?Q?=3D5Btest=3D3Atickets=3D5D?=3D
         <1@tickets.test.p.allura.forge.apache.org>
        Message-ID: <D415ABD5001F4332BCC6B2F5BDF7A46B@gmail.com>
        In-Reply-To: </p/test/tickets/1/aabebfe6d68d27e920becb8ff167044f3376b67c.ti=
        ckets@test.p.sourceforge.net>
        References: </p/test/tickets/1/aabebfe6d68d27e920becb8ff167044f3376b67c.tic=
        kets@test.p.sourceforge.net>
        Subject: Re: [test:tickets] #1 Email Test
        X-Mailer: sparrow 1.6.4 (build 1176)
        MIME-Version: 1.0
        Content-Type: multipart/alternative; boundary=3D"521796d2_7672bd23_33c"

        Testing inbound email=85


        On Friday, August 23, 2013 at 1:01 PM, Tim Van Steenburgh wrote:

        > Test comment...
        > [tickets:#1] (https://forge-allura.apache.org/p/test/tickets/1/) Email Te=
        st
        > Status: open
        > Created: Fri Aug 23, 2013 04:17 PM UTC by Tim Van Steenburgh
        > Last Updated: Fri Aug 23, 2013 04:17 PM UTC
        > Owner: nobody =20
        > Sent from sourceforge.net (http://sourceforge.net) because you indicated =
        interest in https://forge-allura.apache.org/p/test/tickets/1/
        > To unsubscribe from further messages, please visit https://forge-allura.a=
        pache.org/auth/subscriptions/
        > =20
        > =20
        > =20
        Show
        Tim Van Steenburgh added a comment - Outbound email (generated by Allura) is working well. Still some issues with inbound. Replying to a ticket notification, my email bounced with the following error: Delivery to the following recipient failed permanently: 1@tickets.test.p.allura.forge.apache.org Technical details of permanent failure: DNS Error: Domain name not found --- Full email contents: Delivered-To: tvansteenburgh@gmail.com Received: by 10.52.30.104 with SMTP id r8csp97845vdh;         Fri, 23 Aug 2013 10:07:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;         d=googlemail.com; s=20120113;         h=mime-version:from:to:subject:message-id:date:content-type          :content-transfer-encoding;         bh=vE4p6+/4ra3mo2gKPnM0bZO9DBlcZ8gjBC8VH/KVtno=;         b=CubxYAbB27YgB0jZBaPRqYdxI4U+t6uQDNLPCL2aHl7AaKGWmv8Ggxtg/9jSD3BtoC          28chm1GCoNR2Z3HyUlDoMSiBumofO03rwB3HzbxygHw5IKMvnpz25F/N6BfpaL2Nn5mK          X8nbL6quSsfxJCvd+mIZRw+UmRMpYo5hy2s7Q/dZCWZUrRxRNYoI0/OFXrVEY8iljjTD          vS6hguoMA7TIplqiLeqqyaro4bwFqFbv5qMC0bZEXY6JnD2sIoHGG+n6yMGDFwJfW13K          fgeRJe5XNkl2AXpccSm7j+U9nB6meTnJWuFfnT4R4aT8Bk6v7DZwN8OCf8RGsG+Gzkh3          PZlA== X-Received: by 10.60.141.225 with SMTP id rr1mr559282oeb.55.1377277653337;         Fri, 23 Aug 2013 10:07:33 -0700 (PDT) MIME-Version: 1.0 Return-Path: <> Received: by 10.60.141.225 with SMTP id rr1mr626193oeb.55; Fri, 23 Aug 2013  10:07:33 -0700 (PDT) From: Mail Delivery Subsystem < mailer-daemon@googlemail.com > To: tvansteenburgh@gmail.com X-Failed-Recipients: 1@tickets.test.p.allura.forge.apache.org Subject: Delivery Status Notification (Failure) Message-ID: < 047d7b472a4048c4fb04e4a07187@google.com > Date: Fri, 23 Aug 2013 17:07:33 +0000 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Delivery to the following recipient failed permanently:       1@tickets.test.p.allura.forge.apache.org Technical details of permanent failure:=20 DNS Error: Domain name not found ----- Original message ----- DKIM-Signature: v=3D1; a=3Drsa-sha256; c=3Drelaxed/relaxed;         d=3Dgmail.com; s=3D20120113;         h=3Ddate:from:to:message-id:in-reply-to:references:subject:mime-ver= sion          :content-type;         bh=3DTVsntCyXux2H6HXgE7BEHHYsgz/nFZG2znXcbr/oaaA=3D;         b=3Dn5yftOS3sm2Vh8dQTY3dq8UmWhMfCdo13PX2rz+U4RyGmmHP6cSeinLbzLUKuQN= ZFR          snnbzo7fj81W08KYCZ0UCXoYui/FTfjrla5zu2Lpr8+1O8Ssr/0sdJNPSLGHleVn/R= eJ          Uyhu87MsWYTYR7EtCf/U1ICjB36P4MrE/k78fd+NtBmWIMk3MWm++M7JcgZNgMAf/A= av          CBJz5PyYwc8Q91zbAIANtcAJJq/ee9x8VdJ4Y+Vi8J17qHAwOpPYelWjrhPaDqq8/S= vH          gwn9WBiej9A6EbDk5vUrvxwGOcX+BtrAtn3H5TwizW4ccVmI2CBMMqlw6Olb3WBQra= U2          2tUQ=3D=3D X-Received: by 10.60.141.225 with SMTP id rr1mr559272oeb.55.1377277653100;         Fri, 23 Aug 2013 10:07:33 -0700 (PDT) Return-Path: < tvansteenburgh@gmail.com > Received: from [192.168.1.110] (ip98-180-8-47.ga.at.cox.net. [98.180.8.47])         by mx.google.com with ESMTPSA id hl3sm701378obb.0.1969.12.31.16.00.= 00         (version=3DTLSv1 cipher=3DRC4-SHA bits=3D128/128);         Fri, 23 Aug 2013 10:07:32 -0700 (PDT) Date: Fri, 23 Aug 2013 13:07:30 -0400 From: Tim Van Steenburgh < tvansteenburgh@gmail.com > To: =3D?utf-8?Q?=3D5Btest=3D3Atickets=3D5D?=3D  < 1@tickets.test.p.allura.forge.apache.org > Message-ID: < D415ABD5001F4332BCC6B2F5BDF7A46B@gmail.com > In-Reply-To: </p/test/tickets/1/aabebfe6d68d27e920becb8ff167044f3376b67c.ti= ckets@test.p.sourceforge.net > References: </p/test/tickets/1/aabebfe6d68d27e920becb8ff167044f3376b67c.tic= kets@test.p.sourceforge.net > Subject: Re: [test:tickets] #1 Email Test X-Mailer: sparrow 1.6.4 (build 1176) MIME-Version: 1.0 Content-Type: multipart/alternative; boundary=3D"521796d2_7672bd23_33c" Testing inbound email=85 On Friday, August 23, 2013 at 1:01 PM, Tim Van Steenburgh wrote: > Test comment... > [tickets:#1] ( https://forge-allura.apache.org/p/test/tickets/1/ ) Email Te= st > Status: open > Created: Fri Aug 23, 2013 04:17 PM UTC by Tim Van Steenburgh > Last Updated: Fri Aug 23, 2013 04:17 PM UTC > Owner: nobody =20 > Sent from sourceforge.net ( http://sourceforge.net ) because you indicated = interest in https://forge-allura.apache.org/p/test/tickets/1/ > To unsubscribe from further messages, please visit https://forge-allura.a= pache.org/auth/subscriptions/ > =20 > =20 > =20
        Hide
        #asfinfra Bot added a comment -
        <danielsh> Which address did you email? We'd expect *.forge-allura.apache.org, not *.forge.apache.org
        Show
        #asfinfra Bot added a comment - <danielsh> Which address did you email? We'd expect *.forge-allura.apache.org, not *.forge.apache.org
        Hide
        Tim Van Steenburgh added a comment -
        Aha, good point. Will retry, thanks.
        Show
        Tim Van Steenburgh added a comment - Aha, good point. Will retry, thanks.
        Hide
        Tim Van Steenburgh added a comment -
        Okay, one more thing. Can we get inbound email forwarded to port 8825 (or another unused port of your choosing) on our host? We'll run our customer email handler on that port. Can't use port 25 as it's already in use.
        Show
        Tim Van Steenburgh added a comment - Okay, one more thing. Can we get inbound email forwarded to port 8825 (or another unused port of your choosing) on our host? We'll run our customer email handler on that port. Can't use port 25 as it's already in use.
        Hide
        #asfinfra Bot added a comment -
        <danielsh> "customer email handler"? What customer?
        Show
        #asfinfra Bot added a comment - <danielsh> "customer email handler"? What customer?
        Hide
        Tim Van Steenburgh added a comment -
        s/customer/custom/
        Show
        Tim Van Steenburgh added a comment - s/customer/custom/
        Hide
        #asfinfra Bot added a comment -
        <danielsh> (We thought so, thanks for clarifying.) Can't you achieve what you want by having postfix forward to your custom daemon? main.cf is
        Show
        #asfinfra Bot added a comment - <danielsh> (We thought so, thanks for clarifying.) Can't you achieve what you want by having postfix forward to your custom daemon? main.cf is
        Hide
        #asfinfra Bot added a comment -
        <danielsh> .. managed by puppet, but we can have puppet add a directive that includes your "forward <these> mails to <localhost:8825>" functionality. (Also do you want to just join #asfinfra IRC? Will be faster that way)
        Show
        #asfinfra Bot added a comment - <danielsh> .. managed by puppet, but we can have puppet add a directive that includes your "forward <these> mails to <localhost:8825>" functionality. (Also do you want to just join #asfinfra IRC? Will be faster that way)
        Hide
        #asfinfra Bot added a comment -
        <danielsh> tvansteenburgh mail to *@*.forge-allura.a.o should work now
        Show
        #asfinfra Bot added a comment - <danielsh> tvansteenburgh mail to *@*.forge-allura.a.o should work now
        Hide
        #asfinfra Bot added a comment -
        <danielsh> Setting WFU pending main.cf patch
        Show
        #asfinfra Bot added a comment - <danielsh> Setting WFU pending main.cf patch
        Hide
        Tim Van Steenburgh added a comment -
        This is what I *think* we need, although I haven't been able to test it since puppet resets the config. Note that `postmap /etc/postfix/transport` will need to be run after the transport file is created.
        Show
        Tim Van Steenburgh added a comment - This is what I *think* we need, although I haven't been able to test it since puppet resets the config. Note that `postmap /etc/postfix/transport` will need to be run after the transport file is created.
        Hide
        Tony Stevenson added a comment -
        Show
        Tony Stevenson added a comment - https://paste.apache.org/1Izm
        Hide
        Tony Stevenson added a comment -
        I dont recall off hand the frequency at which we pull qmail config changes into the MXs, but I will check again when I get home to see if it has come over. if niot I will figure out the manual steps needed.
        Show
        Tony Stevenson added a comment - I dont recall off hand the frequency at which we pull qmail config changes into the MXs, but I will check again when I get home to see if it has come over. if niot I will figure out the manual steps needed.
        Hide
        #asfinfra Bot added a comment -
        <pctony> this is now working, and puppet/svn have been updated accordingly. Thanks for the help tvansteenburgh.
        Show
        #asfinfra Bot added a comment - <pctony> this is now working, and puppet/svn have been updated accordingly. Thanks for the help tvansteenburgh.

          People

          • Assignee:
            Tony Stevenson
            Reporter:
            Tim Van Steenburgh
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development