Subject: The mailing list for listmasters using Sympa
List archive
[en@sympa] how to get Google crawler to index public mail archives
- From: Patrick Cernko <address@concealed>
- To: address@concealed
- Subject: [en@sympa] how to get Google crawler to index public mail archives
- Date: Tue, 11 Aug 2026 15:06:43 +0200
Hi list,
I'm struggling with having Google index the public mail archives on our Sympa servers.
I already removed the "I am not a spammer" barrier, which did not help.
We also tried to force Google crawler to index the corresponding domain via their site-admin tool. But even after waiting several days, searching for "site:sympa.mpi-klsb.mpg.de Some-Keyword" where some unique keyword was picked from an older mail in the archive, Google still presents no results. When using "Archive powered by MHonArc" as keyword it finds the lists that have a public archive but only the start page of the archive although this text can be found on every page of the archive. Forcing Google to index a specific message page results in only this specific message page to be indexed, but we cannot do this for all the mails in the archives obviously.
Does anyone have some tips how to convince Google crawler to follow all the links to the different mail messages in the archive and index all these pages? Tips for the same problem with other search engines are also welcome of course.
Best regards,
--
Patrick Cernko <address@concealed> +49 681 9325 5815
Joint Scientific IT and Technical Service
Max-Planck-Institute für Informatik & Software Systems
Attachment:
smime.p7s
Description: S/MIME Cryptographic Signature
- [en@sympa] how to get Google crawler to index public mail archives, Patrick Cernko, 08/11/2026
Archive powered by MHonArc 2.6.19+.