The mailing list for listmasters using Sympa

[David Verdin <address@concealed>]

Le 05/02/13 17:08, YANG ChengFu a écrit :

Hello David,

thanks for your reply, the busy mailing list will receive about 4000 mails per hour, the size of mails varies from 100KB to 5MB,

Wow... That's some mighty busy list you got there...

after I created it, in 1 day, in sympa spool outgoing folder there will about 1000 mails waiting for achive, so I had to stop the mailing list, and I waited for 6 hours before all the mails in outgoing folder got achived !.

And that can't go any better the more you wait, the worst it will be...

I don't use Network disk !

Darn...
Well, you reached some limits of the archiver... In future releases, we want to allow listmasters to run as many Sympa processes as they want but the archiver is simply not fit for this right now. It is taylored to run in a single instance, period. It doesn't lock files before accessing them, for example. I could give you a hack to run several archived.pl, but you could have collisions when moving / deleting files. So that's not the solution.

One could try to use the custom archiver. It is a feature in Sympa that allows you to call another program to handle archiving: https://www.sympa.org/manual/web-interface#custom_archiver
Here is an example of such a custom archiver that stores archives in an RDBMS: https://www.sympa.org/contribs/custom_web_archiver
Having this kind of plug can allow you to get rid of your problems.
Another solution could be to have a script regularly moving archives out of the outgoing spool and replace them nightly, when a lower level of activity allows to archive the messages you had to quarantine.

Sorry, I don't see another solution right now.

Regards,

David

--
Yang

Orange Key: 35745318S1

On Tue, Feb 5, 2013 at 4:28 AM, David Verdin <address@concealed> wrote:

Hi,

Le 04/02/13 23:05, YANG ChengFu a écrit :

Hello,

I have set Sympa up on our environment as a newsgroup and I disabled mail sending, everything seems good. But after I create a very busy mailing list, I found Web Archive is too slow to catch up the speed of mail arriving.

How busy are we talking about exactly?

For example, in sympa spool outgoing folder, there are many mails waiting for achive!

Looks weird to me. Do you store archives on a network disk? Sometimes, network connection can impair the archived.pl performances, because it needs to move the message to the remote disk.

The version I have is sympa 6.1.4(Debian Squeeze Backport Version), OS is Debian Squeeze, and I have upgraded Mhonarc to latest version(2.6.18), can you tell me if there is a way to speed up Web Archive?

--
Yang

--
A bug in Sympa? Quick! To the bug tracker!

David Verdin Services Applicatifs aux Utilisateurs Tel. +33 2 23 23 69 71 GIP RENATER

--
A bug in Sympa? Quick! To the bug tracker!

David Verdin Services Applicatifs aux Utilisateurs Tel. +33 2 23 23 69 71 GIP RENATER

Attachment: pngHsu1jCkPPx.png
Description: PNG image