The mailing list for listmasters using Sympa

[IKEDA Soji <address@concealed>]

Hi Markus,

2021/02/05 0:19、Markus Jylhaenkangas <address@concealed>のメール:



Hi all,

 

I’m currently experimenting with synchronizing Sympa data from external data source. We have service which has all the information about lists with members, owners and administrators, and these should be synchronized from this source to Sympa (only one way).

 

I have understood that data sources (SQL) for member/owner/admin synchronization and SOAP API for list creation could be used to achieve this. But we have 60k lists with members anywhere between 1 and 40k per list and there should be max 1 hour delay with the sync, preferably faster.

 

So I am wondering how well does the SQL data sources scale? Or does it scale?

And also if there is already better way of doing this that I have missed?

 

I would love to hear some feedback on this and experiences in scaling this.

In the first place, what is the version of Sympa you are using?

Feature of inclusion (synchronization with external data source) with Sympa prior to 6.2.48 was a bit slow and memory-consuming.

If you are planning to run large lists with synchronization, you would be better to upgrade to recent version (at today 6.2.60 is the best) at first.

Not only memory usage, recent version may suppress delay of delivery.  One piece of advice for large lists with synchronization is that:

  - on large lists with synchronization, distribution_ttl parameter of the list config (by default undefined) should be set as larger than the value of ttl parameter (by default 3600 seconds) so that synchronization won’t be launched when delivery starts.

Regards,

— Soji

Thanks

 

Best regards,

Markus