Skip to Content.
Sympa Menu

en - Re: [sympa-users] do_search_list times out with large number of lists

Subject: The mailing list for listmasters using Sympa

List archive

Chronological Thread  
  • From: David Verdin <address@concealed>
  • To: address@concealed
  • Subject: Re: [sympa-users] do_search_list times out with large number of lists
  • Date: Thu, 29 Nov 2012 17:20:49 +0100


Le 29/11/12 16:47, Etienne MELEARD a écrit :
Le 29/11/12 16:26, IKEDA Soji a écrit :
Kristina, Steve and all,

On Thu, 29 Nov 2012 07:39:19 +0000
Steve Shipway <address@concealed> wrote:

Riseup upgraded to sympa-6.1.15 which includes the database caching
patch - yay!

We found an issue with do_search_list, though -- this function was
still regularly timing out for us, since it was still iterating over
all lists.
We found the same on our system (6.1.14), too, since with 30,000+ lists the search times out completely. I added the same patch to the appropriate places (the search-by-category also needs to do this).

I believe it was omitted from the release because it uses RLIKE which is not available in every database. However, I would think that it would be preferable if the release code checked for use of MySQL and used the database method if mysql and the slower code method otherwise...
Brave users might want to check the current development branch,
Sympa-6.2. It is originally based on Riseup patch and performs
search for lists accessing database directly by portable way
(NOTE that development branch does not expect production use).

We also have had to add a patch to allow use of ODBC database for external datasources (which means you can use MSSQL), and another to have a second param for subscriber name in LDAP and database external datasources.
I added a way to get gecos from sql/ldap/ldap2 inclusion 4 month ago in 6.2 (commit 7483).
And, yes, Sympa 6.2 will go beta soon. Probably next January.
Still a few crutches to work out before putting it in production on our own server. This server reprensents 200k users, 350k subscriptions, 1000 lists, 12 virtuals hosts. Just saying it so that you know that, once you install the beta at home, it will have been previously tested amongst a very wide variety of configurations; old / twisted / wacky / you name it.

Cheers,

David
Interesting. Would you please inform your experiences using ODBC?

Regards,

Steve
-- Soji
Etienne



Attachment: smime.p7s
Description: Signature cryptographique S/MIME




Archive powered by MHonArc 2.6.19+.

Top of Page