Mailing List Archive

[Spamassassin Wiki] Update of "RulesProjectPlan" by JustinMason
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Spamassassin Wiki" for change notification.

The following page has been changed by JustinMason:
http://wiki.apache.org/spamassassin/RulesProjectPlan

The comment on the change is:
update status

------------------------------------------------------------------------------

* PMC vote to approve the sandboxes project (RulesProjSandboxes).
* ''VOTE: passed!''
+ * ''Done''

* reorganise the rules directory into core/ , sandbox/, and extra/; link that rules project SVN repository to 3.2.0's 'rules' dir; use SVN externals to do this.
* ''VOTE: passed''
- * ''now we need someone crazy enough to actually do this ;)''
+ * ''Done''
+
+ * move current ruleset into a new "core" area
+ * ''Happening soon...''

* write scripts to test, filter, and pull rules from sandboxes automatically into core/ production ruleset
* ''VOTE: not approved -- Daniel says 'I'd like more details'.''
* see RulesProjPromotion
-
- * move current ruleset into a new "legacy" sandbox
- * ''VOTE: vetoed by Daniel.''
- * alternative proposal looks good though

* start using the above scripts to generate core/ ruleset in svn
* ''VOTE: not approved -- Daniel says 'I'd like more details'.''
[Spamassassin Wiki] Update of "RulesProjectPlan" by JustinMason [ In reply to ]
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Spamassassin Wiki" for change notification.

The following page has been changed by JustinMason:
http://wiki.apache.org/spamassassin/RulesProjectPlan

------------------------------------------------------------------------------

* move current ruleset into a new "core" area
* ''Happening soon...''
+ * ''Done''

* write scripts to test, filter, and pull rules from sandboxes automatically into core/ production ruleset
* ''VOTE: not approved -- Daniel says 'I'd like more details'.''
[Spamassassin Wiki] Update of "RulesProjectPlan" by JustinMason [ In reply to ]
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Spamassassin Wiki" for change notification.

The following page has been changed by JustinMason:
http://wiki.apache.org/spamassassin/RulesProjectPlan

The comment on the change is:
update status

------------------------------------------------------------------------------
* ''Done''

* write scripts to test, filter, and pull rules from sandboxes automatically into core/ production ruleset
+ * ''Dropped in favour of:''
- * ''VOTE: not approved -- Daniel says 'I'd like more details'.''
- * see RulesProjPromotion

+ * write scripts to test, filter, and pull rules from sandboxes and core, as a compilation step, into an output directory (see RulesProjPromotion)
+ * ''Done''
+
- * start using the above scripts to generate core/ ruleset in svn
+ * start using the above scripts to generate ruleset in svn
- * ''VOTE: not approved -- Daniel says 'I'd like more details'.''
- * see RulesProjPromotion
+ * ''Done!''
+

Second step -- list-driven mass-checks:
[Spamassassin Wiki] Update of "RulesProjectPlan" by JustinMason [ In reply to ]
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Spamassassin Wiki" for change notification.

The following page has been changed by JustinMason:
http://wiki.apache.org/spamassassin/RulesProjectPlan

------------------------------------------------------------------------------
* Speeding up the release cycle for rules: SaUpdatePlan
* the secrecy problem: RulesProjSecrecy
* the language problem: RulesNotEnglish
+ * a continuous mass-checking system: RulesProjBuildBot

== Outstanding Tasks/Votes ==
[Spamassassin Wiki] Update of "RulesProjectPlan" by JustinMason [ In reply to ]
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Spamassassin Wiki" for change notification.

The following page has been changed by JustinMason:
http://wiki.apache.org/spamassassin/RulesProjectPlan

------------------------------------------------------------------------------
* start using the above scripts to generate ruleset in svn
* ''Done!''

+ Phase two -- mass-checking systems:

- Second step -- list-driven mass-checks:
+ * Weekly mass-check
+ * ''DONE: all rules, with --net''

- * set up the mailing list; get subscribers. (RulesProjMoreInput)
+ * Nightly mass-check: web-based user interface for the following data:
+ * ''DONE: freqs for all rules''
+ * ''DONE: freqs collated across all users' corpora, or individually''
+ * ''DONE: overlaps between rules''
+ * TODO: rule-by-rule comparative performance figures?
+ * TODO: historical rule hits data?
+ * TODO: promotion criteria as defined in RulesProjPromotion, so rules that can be promoted can be identified at a glance

- * implement scripts, or get them from SARE. (RulesProjMoreInput)
+ Phase three:

+ * TODO: the RulesProjBuildBot system, comprising these tasks:
+ * set up new buildbot master
+ * set up user in zone
+ * set up new buildbot slave
+ * set up chroot jail
+ * get mass-check running in chroot
+ * copy in corpus
+ * write mass-check wrapper script to:
+ * mass-check that corpus, using rules from .../rulesrc/sandbox/ only
+ * implement strict ulimits
+ * write mass-check-completed script to:
+ * output freqs so it's visible through the Buildbot UI
+ * write mail-handling script to extract mail-submitted rule attachments
+
[Spamassassin Wiki] Update of "RulesProjectPlan" by JustinMason [ In reply to ]
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Spamassassin Wiki" for change notification.

The following page has been changed by JustinMason:
http://wiki.apache.org/spamassassin/RulesProjectPlan

------------------------------------------------------------------------------
Phase three:

* TODO: the RulesProjBuildBot system, comprising these tasks:
- * set up new buildbot master
+ * DONE: set up new buildbot master
- * set up user in zone
+ * DONE: set up user in zone
- * set up new buildbot slave
+ * DONE: set up new buildbot slave
* set up chroot jail
* get mass-check running in chroot
* copy in corpus
+ * set up additional slaves for additional corpora
* write mass-check wrapper script to:
* mass-check that corpus, using rules from .../rulesrc/sandbox/ only
* implement strict ulimits
[Spamassassin Wiki] Update of "RulesProjectPlan" by JustinMason [ In reply to ]
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Spamassassin Wiki" for change notification.

The following page has been changed by JustinMason:
http://wiki.apache.org/spamassassin/RulesProjectPlan

The comment on the change is:
add the link

------------------------------------------------------------------------------
Phase three:

* TODO: the RulesProjBuildBot system, comprising these tasks:
- * DONE: set up new buildbot master
+ * DONE: set up new buildbot master - http://buildbot.spamassassin.org:8011/
* DONE: set up user in zone
* DONE: set up new buildbot slave
* set up chroot jail