Skip to Content.
Sympa Menu

en - [sympa-users] Re: Sympa processing messages very slow

Subject: The mailing list for listmasters using Sympa

List archive

Chronological Thread  
  • From: Olivier Salaün - CRU <address@concealed>
  • To: Patrick von der Hagen <address@concealed>
  • Cc: address@concealed
  • Subject: [sympa-users] Re: Sympa processing messages very slow
  • Date: Mon, 20 Nov 2006 13:22:26 +0100

Hi Patrick,

Patrick von der Hagen wrote:
looks like sympa-daemon died when my harddisk was full Friday evening.
Actually, that's strange since sympa has its own partition which was not
affected.
Sympa might have died because of a message it failed to process. If so, sympa.pl might die again.
If it happens, please restart sympa.pl in debug mode ( '-d' option) ; this way you'll get STDERR printed on the terminal.
Anyway. This morning I found about 9500 messages in sympa/spool/msg. I
restarted sympa and waited for the queue to be processed. However, speed is a
nightmare. Sympa is processing less than one message/second, it took about 2
hours to process the first 3000 messages. That's about one message every 2
seconds. Since mail is continually delivered to sympa, the message-count
shrinks even slower and I estimate it might get midnight, before the queue is
completed. :-(

Now, the cpu isn't idle, but there are plenty of cycles left. Memory is still
availabe, no swapping. I reniced sympa.pl and task_manager, but it doesn't
really help.

Any ideas how to improve speed? Or how to identify the reason?
The queue processing deals with messages priorities (defined on a per list basis). This is very time consuming because after each message has been processed, sympa.pl scans the spool again to find out about new files.

The process could be optimized if sympa.pl scans its spool once only. But currently you'd have to patch sympa.pl.



Archive powered by MHonArc 2.6.19+.

Top of Page