Bug 6689 - SVN Snapshots Appear to be very out of Date
Summary: SVN Snapshots Appear to be very out of Date
Status: RESOLVED FIXED
Alias: None
Product: Spamassassin
Classification: Unclassified
Component: Building & Packaging (show other bugs)
Version: SVN Trunk (Latest Devel Version)
Hardware: PC Windows 7
: P2 normal
Target Milestone: Undefined
Assignee: SpamAssassin Developer Mailing List
URL:
Whiteboard:
Keywords:
: 6738 (view as bug list)
Depends on:
Blocks:
 
Reported: 2011-11-02 17:44 UTC by Kevin A. McGrail
Modified: 2014-02-05 07:55 UTC (History)
4 users (show)



Attachment Type Modified Status Actions Submitter/CLA Status

Note You need to log in before you can comment on or make changes to this bug.
Description Kevin A. McGrail 2011-11-02 17:44:15 UTC
Snapshots are being built but appear to be very out of date:

Downloading the latest tar from http://svn.apache.org/snapshots/spamassassin/ and comparing to trunk shows:

Snapshot:
-rwxr-xr-x    1 kmcgrail wheel       51449 Jul 26 23:12 sa-update.raw

Trunk via SVN:
-rwxr-xr-x    1 root     root        55928 Oct 29 00:47 sa-update.raw
Comment 1 Kevin A. McGrail 2011-11-02 17:45:31 UTC
After getting trunk snapshots to work again, make sure that sa-update works with the DNS changes in bug 6644.
Comment 2 Kevin A. McGrail 2011-11-02 18:26:11 UTC
Snapshots are phased out by ASFINFRA (Quoted with Permission):

(2:17:32 PM) joes4: well that depends.  the whole reason snapshots were provided originally was to allow developers who weren't svn-saavy to work on/test the development code. they were never intended to be publicized to non-devs.
(2:18:12 PM) joes4: if your dev community still needs such a service then I suggest you setup buildbot or jenkins to provide it
(2:19:44 PM) joes4: but if you want something you'd like to continue to offer to random members of the public, snapshots are not it.
(2:21:14 PM) kmcgrail: Understood.  can we shutdown / delete / stop new snapshots on http://svn.apache.org/snapshots/spamassassin/

Things to Do:

1 - Shutdown / delete / stop new snapshots - Joes4 with ASF Infra is handling this.

2 - Remove any references on website to http://svn.apache.org/snapshots/spamassassin/, http://cvs.apache.org/snapshots/spamassassin/ or snapshots in general

3 - Add a note that snapshots are no longer provided and to use svn
Comment 3 Kevin A. McGrail 2011-11-02 18:35:53 UTC
(In reply to comment #2)
> Snapshots are phased out by ASFINFRA (Quoted with Permission):
> 
> (2:17:32 PM) joes4: well that depends.  the whole reason snapshots were
> provided originally was to allow developers who weren't svn-saavy to work
> on/test the development code. they were never intended to be publicized to
> non-devs.
> (2:18:12 PM) joes4: if your dev community still needs such a service then I
> suggest you setup buildbot or jenkins to provide it
> (2:19:44 PM) joes4: but if you want something you'd like to continue to offer
> to random members of the public, snapshots are not it.
> (2:21:14 PM) kmcgrail: Understood.  can we shutdown / delete / stop new
> snapshots on http://svn.apache.org/snapshots/spamassassin/
> 
> Things to Do:
> 
> 1 - Shutdown / delete / stop new snapshots - Joes4 with ASF Infra is handling
> this.
> 
> 2 - Remove any references on website to
> http://svn.apache.org/snapshots/spamassassin/,
> http://cvs.apache.org/snapshots/spamassassin/ or snapshots in general
> 
> 3 - Add a note that snapshots are no longer provided and to use svn

4 - Check wiki for the same thing.
Comment 4 Kevin A. McGrail 2011-11-02 19:33:06 UTC
Things to Do:

DONE- 1 - Shutdown / delete / stop new snapshots - Joes4 with ASF Infra is handling
this.

2 - Remove any references on website to
http://svn.apache.org/snapshots/spamassassin/,
http://cvs.apache.org/snapshots/spamassassin/ or snapshots in general

3 - Add a note that snapshots are no longer provided and to use svn

4 - Check wiki for the same thing.

DONE - 5 - Send note to users and dev mailing list
Comment 5 Darxus 2011-11-22 20:52:03 UTC
(In reply to comment #4)
> DONE- 1 - Shutdown / delete / stop new snapshots - Joes4 with ASF Infra is
> handling
> this.

> 2 - Remove any references on website to
> http://svn.apache.org/snapshots/spamassassin/,
> http://cvs.apache.org/snapshots/spamassassin/ or snapshots in general

Only one remaining is on http://spamassassin.apache.org/downloads.cgi

> 3 - Add a note that snapshots are no longer provided and to use svn

Where?

> 4 - Check wiki for the same thing.

Done.  Was only on http://wiki.apache.org/spamassassin/DevelopmentStuff

> DONE - 5 - Send note to users and dev mailing list


I just did a "wget -m --no-parent http://spamassassin.apache.org http://wiki.apache.org" and did "grep -rl 'snapshots/spamassassin' .".  If anybody's curious:
$ du -sh *
25M     spamassassin.apache.org (doesn't include release tarballs)
684K    wiki.apache.org
Comment 6 Kevin A. McGrail 2011-11-22 20:57:36 UTC
> > 2 - Remove any references on website to
> > http://svn.apache.org/snapshots/spamassassin/,
> > http://cvs.apache.org/snapshots/spamassassin/ or snapshots in general
> 
> Only one remaining is on http://spamassassin.apache.org/downloads.cgi
> 
> > 3 - Add a note that snapshots are no longer provided and to use svn
> 
> Where?

Anywhere you think it would help users.

> I just did a "wget -m --no-parent http://spamassassin.apache.org
> http://wiki.apache.org" and did "grep -rl 'snapshots/spamassassin' .".  If
> anybody's curious:
> $ du -sh *
> 25M     spamassassin.apache.org (doesn't include release tarballs)
> 684K    wiki.apache.org

Brilliant. I never thought to svn the wiki.
Comment 7 Karsten Bräckelmann 2011-11-22 21:14:36 UTC
(In reply to comment #5)
> Only one remaining is on http://spamassassin.apache.org/downloads.cgi
> 
> > 3 - Add a note that snapshots are no longer provided and to use svn
> 
> Where?

I'd say the only place it has been mentioned before -- the downloads page. Basically, removing the link and changing the text, just in case someone recalls the reference to snapshots and comes back looking.
Comment 8 Darxus 2011-11-22 21:19:57 UTC
Yeah, the wiki definitely started rejecting my requests, resulting in an incomplete download.  Not sure about the non-wiki stuff.  I'll try again throttled if it ever lets me back in.  

Steps 2 and 4 are not done.
Comment 9 Karsten Bräckelmann 2011-11-22 21:43:14 UTC
(In reply to comment #8)
> Yeah, the wiki definitely started rejecting my requests, resulting in an
> incomplete download.  Not sure about the non-wiki stuff.  I'll try again
> throttled if it ever lets me back in.  

Uhm, maybe better not? ASF infra team might get quite upset, and I would perfectly understand why.

The *fulltext* search of the wiki does the job. I just verified it includes the URIs for non-wiki links.

(In reply to comment #5)
> I just did a "wget -m --no-parent http://spamassassin.apache.org
> http://wiki.apache.org" and did "grep -rl 'snapshots/spamassassin' .".  If
> anybody's curious:
> $ du -sh *
> 25M     spamassassin.apache.org (doesn't include release tarballs)

Out of curiosity, and since you already have the wget harvested data -- what's so large there? Most links are referring some wiki page.
Comment 10 Karsten Bräckelmann 2011-11-22 21:46:55 UTC
FWIW, the wiki fulltext search quickly shows there are no references to 'snapshots/spamassassin', nor a plain 'snapshots'.
Comment 11 Darxus 2011-11-22 21:55:06 UTC
Step 4 is done.  The only remaining link from the wiki or main site to the snapshots is now on the downloads page.

(In reply to comment #9)
> Uhm, maybe better not? ASF infra team might get quite upset, and I would
> perfectly understand why.

I doubt it, I'm clearly hitting a feature built into moinmoin:
http://moinmo.in/SurgeProtection

But as you pointed out later, it's nolonger necessary.  But I need it :P

> The *fulltext* search of the wiki does the job. I just verified it includes the
> URIs for non-wiki links.

Verified, and then searched for "snapshots" - it doesn't exist anywhere on the wiki, including external links.

> (In reply to comment #5)
> > I just did a "wget -m --no-parent http://spamassassin.apache.org
> > http://wiki.apache.org" and did "grep -rl 'snapshots/spamassassin' .".  If
> > anybody's curious:
> > $ du -sh *
> > 25M     spamassassin.apache.org (doesn't include release tarballs)
> 
> Out of curiosity, and since you already have the wget harvested data -- what's
> so large there? Most links are referring some wiki page.

spamassassin.apache.org/full$ du -sh *
7.4M    2.6x
7.2M    3.0.x
2.7M    3.1.x
1.5M    3.2.x
1.5M    3.3.x

For 2.6 and 3.0, looks like those contain full uncompressed copies of the release.  After that it's docs.
Comment 12 Kevin A. McGrail 2011-12-28 14:44:39 UTC
*** Bug 6738 has been marked as a duplicate of this bug. ***
Comment 13 Michael Scheidell 2012-04-04 15:50:48 UTC
I am (aka scheidell@FreeBSD.org), the official port maintainer for the FreeBSD spamassassin port.

I am also on the development team, and have commit bit.

I have had a lot of requests for a -devel branch in ports, for 3.4.

I can pull it our of trunk/svn, make a tarball and put it in http://people.freebsd.org/~scheidell/Mail-SpamAssassin-3.4.0.tar.gz, but this is not considered 'best practices'.

We like to see it come from an authoritative source.

Can I get a snapshot/rc/tarball, either emailed to scheidell@FreeBSD.org, so I can put it into ~/  or, better yet, can you make a snapshot tarball and send me a link that will survive (until you change it)?

Since I have commit bit, I can change sha256 sigs in ports tree, nightly if I have to.

thanks, and keep up the good work!
Comment 14 Kevin A. McGrail 2012-04-11 12:57:56 UTC
As a follow-up to Joes4: "if your dev community still needs such a service then I suggest you setup buildbot or jenkins to provide it"., I have emailed builds asking for assistance setting up an SVN snapshot for developers because my skill with hudson/jenkins/buildbot is fairly minimal.
Comment 15 Kevin A. McGrail 2014-02-05 07:55:01 UTC
SVN Snapshots are no longer provided and the website has been updated.