The mailing list for listmasters using Sympa

[David Verdin <address@concealed>]

Hi Alex,

Which version of Sympa are you running? Your problem comes as a susprise to me because we host lists with more than 10 000 messages a month and the messages are archived in less than a second.

So how large is the number of messages for the lists that have this problem?

Best regards,

David

On 05/11/2020 23:03, Alex West wrote:

It seems there is a severe bottleneck in the archive(outgoing) spool processing. What I am seeing is that the time required to process a message from the archive spool into the archive is very dependent on the size of the existing archive. Every message processed seems to require a stat of every file in that lists archive. For lists with large archives, this causes the processing to take over a minute per message, which causes a backlog.

Can anyone clue me in on what part of the code would be requiring this stat of every single file in the list archive? I could understand some requirement to check for old directories so that they can be removed per archive max_month limitations, but I'm not sure I understand why this is happening for every message. Or even why finding the directories needing cleaned out per max_month would require such an extensive stat of the files.

Obviously this means that this problem is going to be exponential, since some lists archives continue to grow.

Thanks

--

Alex West - Operations

www.bossnine.com

www.pantek.com

216-344-1614 x301

Improving Your Speed to Market 

by Embracing Cloud and Linux Services

-- 
"Mieux vaut viser la perfection et la rater que viser la médiocrité et l'atteindre."
- Francis Blanche

David Verdin
Chef de Projet Collaboratif
Département PROduits NUMériques
Direction des Services Applicatifs
RENATER - Rennes

Attachment: smime.p7s
Description: S/MIME Cryptographic Signature