The mailing list for listmasters using Sympa

[David Verdin <address@concealed>]

Hi Asbed,

Le 04/02/15 02:20, Asbed Bedrossian a écrit :

We use the include_file feature to auto-populate lists here. Essentially, a few times a day we scp an updated subscriber file to the Sympa VM. Some of our lists are large, over 75K addresses. I haven’t yet experienced the timeout issues you refer to. Running 6.1.24.

I think that what take time is that, when you disaply the list of list memebers, Sympa tries to update it on the fly with the datasources.
You could simply disable on the fly sync_include by setting the 'distribution_ttl' parameter to a very large value.
Then display the list in the web interface or run a SOAP request to review it. This will be the starting point of the wait between two on-the-fly sync includes. The second one will never happen, as you will have put a very long delay.

Then, to keep your list up-to-date with datasources, each time you update the file used as source, delete the sync_include task for this list. One minute later, the task_manager will find the task missing and execute it.
This way, your list will be up-to-date and wont' try to update it each time you review it.

Best regards,

David

Asbed

On Feb 2, 2015, at 10:40 AM, Amos <address@concealed> wrote:

(Currently on 6.1.x)

We're using include_file to "auto-populate" some lists with data from our account management and business process systems.  One list, including members that have been manually added, is getting to be 60K members.  Sometimes attempting to get to the Manage Subscribers section of the web interface causes timeout-related errors.  Not sure if a faster box would help, or perhaps there would be a more efficient way to auto-populate this list.

Would it be better to use the SOAP interface to add the members directly into the Sympa db for that list?

Thanks,
Amos

--
A bug in Sympa? Quick! To the bug tracker!

David Verdin Études et projets applicatifs
Tél : +33 2 23 23 69 71 Fax : +33 2 23 23 71 21   www.renater.fr	RENATER 263 Avenue du Gal Leclerc 35042 Rennes Cedex

Attachment: smime.p7s
Description: Signature cryptographique S/MIME