The mailing list for listmasters using Sympa

[Michael Howe <address@concealed>]

Hello,

I'm hoping someone here can provide some pointers, because I'm rather
stuck.  We're running Sympa 6.1.17 (as packaged by Debian), plus a few
backports/local tweaks.  We've got 3 robots and just over 6000 lists,
2 servers running bulk.pl, and one running all the other daemons and web
interface.  The database is Postgres.

In the last couple of days, we've had people reporting that mails to
their lists haven't been getting through, despite having been logged as
being sent.  Looking at the logs shows that Sympa has accepted the
message, and listed the correct number of recipients, but the message
then just seems to have disappeared - there's no entries from bulk.pl
about picking it up, and it's not in the database (bulkmailer_table or
bulkspool_table).

On the lists that I've seen, this seems to happen a couple of days after
messages bounce and the bounce state is reset.

minimum_bouncing_count and minimum_bouncing_period are the default (of
10), and looking in the database, the subscribers don't have bounce
scores (although they do have bounce_address set).

Removing and re-adding the subscribers fixes things - messages are then
sent out.

The logs look something like:

#---8<-----------------------------------------------------------------
2014-12-11 10:29:16 +0000 1Xz0zk-0008JG-Hz <= address@concealed 
H=relay16.mail.ox.ac.uk [163.1.2.166] P=esmtp S=1292 
address@concealed
2014-12-11 10:29:17 +0000 1Xz0zk-0008JG-Hz => list-name-elided 
<address@concealed> R=sympa_router_other_domain 
T=sympa_transport_queue
2014-12-11 10:29:17 +0000 1Xz0zk-0008JG-Hz Completed
#---8<-----------------------------------------------------------------

#---8<-----------------------------------------------------------------
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.debug sympa[30275]: 
debug Processing 
/address@concealed 
with priority 5
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.debug sympa[30275]: 
debug main::DoFile() 
DoFile(/address@concealed)
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.debug sympa[30275]: 
debug2 Message::new() 
Message::new(/address@concealed,)
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.debug sympa[30275]: 
debug Scenario::request_action() List::request_action 
spam_status,smtp,maillist.ox.ac.uk
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.debug sympa[30275]: 
debug2 Scenario::new() 
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.debug sympa[30275]: 
debug2 Scenario::new() 
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.debug sympa[30275]: 
debug2 Scenario::verify() (match([msg_header->x-oxmail-spam-level], /\*{10}/))
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.debug sympa[30275]: 
debug2 Scenario::verify() (match([msg_header->x-oxmail-spam-level], /\*{5}/))
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.debug sympa[30275]: 
debug2 Scenario::verify() (true())
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.debug sympa[30275]: 
debug3 Scenario::request_action() rule true(),smtp,ham accepted
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.debug sympa[30275]: 
debug2 List::new() List::new(list-name-elided, maillist.ox.ac.uk, )
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.debug sympa[30275]: 
debug2 List::load() List::load(list-name-elided, maillist.ox.ac.uk, )
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.notice 
sympa[30275]: notice main::DoFile() Processing 
/address@concealed 
; sender: Michael Howe <address@concealed>
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.debug sympa[30275]: 
debug main::DoFile() Setting log level with maillist.ox.ac.uk configuration 
(or sympa.conf) : 4
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.debug sympa[30275]: 
debug2 List::new() List::new(list-name-elided, maillist.ox.ac.uk, )
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.debug sympa[30275]: 
debug2 List::load() List::load(list-name-elided, maillist.ox.ac.uk, )
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.info sympa[30275]: 
info main::DoMessage() Processing message for list-name-elided with priority 
5, <address@concealed>
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.notice 
sympa[30275]: notice Scenario::verify_custom() Use module 
/etc/sympa/custom_conditions/oxlistnottocc.pm for custom condition
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.info sympa[30275]: 
info CustomCondition::oxlistnottocc::verify() listname: list-name-elided, 
robot: maillist.ox.ac.uk, sender: address@concealed, is_bcc: 0, 
require_to_cc: off
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.notice 
sympa[30275]: notice Scenario::verify_custom() Use module 
/etc/sympa/custom_conditions/oxspamhigher.pm for custom condition
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.info sympa[30275]: 
info CustomCondition::oxspamhigher::verify() listname: list-name-elided, 
robot: maillist.ox.ac.uk, sender: address@concealed, spam score: , 
reject score: 5
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.notice 
sympa[30275]: notice Scenario::verify_custom() Use module 
/etc/sympa/custom_conditions/oxmimeblack.pm for custom condition
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.info sympa[30275]: 
info CustomCondition::oxmimeblack::verify() listname: list-name-elided, 
robot: maillist.ox.ac.uk, sender: address@concealed
2014-12-11T10:29:21+00:00 listserver-1.it.ox.ac.uk local1.info sympa[30275]: 
info main::DoMessage() Message for list-name-elided from 
address@concealed accepted (0 seconds, 0 sessions, 4 subscribers), 
message-id=<address@concealed>
#---8<-----------------------------------------------------------------

I'm going to try and reproduce this on our development system, but since
I'm not entirely sure what's caused it, it's not a task I'm relishing.
(Debugging on the live system is a bit hard as it processes a bit of
mail - it sent 141k messages yesterday.)

Does anyone have any suggestions as to where I should be looking to fix
this, or more information that would be useful?

Best wishes,

Michael

-- 
Michael Howe, Systems Development and Support Section
IT Services, University of Oxford