The mailing list for listmasters using Sympa

[Micah Anderson <address@concealed>]

I'm actually looking to do the opposite of what was originally posted on
this thread.

In our setup, we have a few lists with a very large number of
subscribers. When a post is sent to one of these lists, any other
sympa processing is blocked until it completes delivery to the MTA (in
our case, postfix). On the below example, there are almost 60k
subscribers, and the hand-off from sympa to postfix takes 2843 seconds
(about 47 minutes):

Oct  8 21:01:57 parrot sympa[29909]: main::DoFile() Processing
/address@concealed ;
sender: "MO" <address@concealed>  ; message-id: 
<000601c929c3$bdc2c6b0$0a40a8c0@SERVIDOR>
Oct  8 21:01:57 parrot sympa[29909]: main::DoMessage() Processing
message for pd-mo with priority 0, <000601c929c3$bdc2c6b0$0a40a8c0@SERVIDOR>
Oct  8 21:49:12 parrot sympa[29909]: List::send_msg() Multipart message
changed to singlepart
Oct  8 21:49:14 parrot sympa[29909]: List::send_msg() Multipart message
changed to singlepart
Oct  8 21:49:20 parrot sympa[29909]: main::DoMessage() Message for
pd-mo from address@concealed accepted (2843 seconds, 7264 sessions,59761 
subscribers), message-id=<000601c929c3$bdc2c6b0$0a40a8c0@SERVIDOR> ,
size=23444

During the period where sympa logs the first two messages at 21:01,
there are no more sympa messages logged to the sympa.log until this
hand-off has finished, about 47 minutes later. In otherwords, for 47
minutes sympa is doing nothing but feeding this list to postfix, I've
crawled my logs and averaged the times for this list, and they are are
averaging out to be 2459 seconds, approximately 40 minutes.

If I am correct, what this means is that for 40 minutes there are no
other sympa operations, so all other messages that are in the queue,
or that arrive in the queue during this period are blocked by this
process.


Why does it take so long, and how can I either speed up this process
or parallelize it?

I have increased sympa.conf's maxsmtp 200 from 100 (as well as
postfix's smtp process limits), but that didn't change anything in the
times.

Thanks for any ideas,
Micah

Attachment: signature.asc
Description: Digital signature