The mailing list for listmasters using Sympa

[Steve Shipway <address@concealed>]

We have some pretty big lists here; what I had to do to make the web interface work effectively was –

 

1.       Get the latest version of Sympa; it incorporates the Riseup patches which really help with large numbers of lists and so on

2.       Tuning of the underlying (mysql) database.  This has made a huge difference, as indexes are being held in memory and queries run far faster.  You can also increase query timeouts.

3.       Checking indexes on tables.

 

Since the web page only shows a subset of the users, it should not matter that there are thousands of them.  Possibly you are missing an index on the subscribers table, or would benefit from adding an addition one?  Switch on slow query logging for mysql (or whatever database you use) to identify which are the queries that time out, and see if you can identify an index that is missing or that would improve performance.

 

You may also want to adjust the cache timeouts for external datasources on this list, so that it does not need to re-read in the file so often.  Using the web interface can trigger an external datasource synch which may take some time.

 

Steve

 

Steve Shipway

address@concealed

 

From: address@concealed [mailto:address@concealed] On Behalf Of Amos
Sent: Tuesday, 3 February 2015 7:41 a.m.
To: address@concealed
Subject: [sympa-users] auto-population of very large lists

 

(Currently on 6.1.x)

 

We're using include_file to "auto-populate" some lists with data from our account management and business process systems.  One list, including members that have been manually added, is getting to be 60K members.  Sometimes attempting to get to the Manage Subscribers section of the web interface causes timeout-related errors.  Not sure if a faster box would help, or perhaps there would be a more efficient way to auto-populate this list.

 

Would it be better to use the SOAP interface to add the members directly into the Sympa db for that list?

 

Thanks,

Amos

 

 

Attachment: smime.p7s
Description: S/MIME cryptographic signature