The mailing list for listmasters using Sympa

["Goltz, Immo [Extern]" <address@concealed>]

Hello David,

 

after some deep digging i fixed the problems i encountered. Now all 3 interfaces - WebGUI, soap, mail - are working together and generating same output.

 

Please find attached the changes i made as patches against 6.1.17.

- The changes in sympasoap.pm provide correct input/output of data submitted via soap.

- The one-line change in mail.pm fixed the problem that welcome mail to via soap subscribed user was not encoded correctly and if listinfo contained some cyrillic text the mailbody was concatenated thrice.

This part was most disturbing as debugging showed no differences in data provided to the subroutines. Maybe the lib MIME::Parser (used here: $msg = $parser->parse_data($message);) uses some %ENV vars which are different in GUI and soap. But i could not figure out which an if this true.

 

I still wonder why i have these problems (running on CentOS 6.4) and if this could be some issue with my installation.

 

For the sake of completeness, my first approach to see if all files are UTF8 encoded and if not recode them did not change the behavoir.

changed encoding of following files to utf8 with iconv -f WINDOWS-1252 -t UTF-8

arc2webarc.pl

archived.pl

bounced.pl

Commands.pm

LDAPSource.pm

List.pm

Message.pm

sympa.pl

sympa_wizard.pl

Upgrade.pm

wwsympa.fcgi

 

 

Best regards,

Immo

 

Von: address@concealed [mailto:address@concealed] Im Auftrag von David Verdin
Gesendet: Dienstag, 26. November 2013 14:40
An: address@concealed
Betreff: Re: [sympa-users] problems with soap interface (probably all utf8 related)

 

Hi,

We will investigate this problem. I'am particularly disturbed by the discrepancy between the different fields - submitted in a single SOAP request.

I'll keep you informed as soon as we solve this problem.

For your information, we're using this SOAP server between several servers using different OS without any encoding problem. I'll try to stick to your setting to find relevant misbehaviours.

Cheers,

David

Le 19/11/13 14:23, Goltz, Immo [Extern] a écrit :

Hello sympa users,

 

i am evaluating sympa with the intention to replace a lyris listmanger installation.

So far so good, but when it comes to soap, which is mandatory for our environment, sympa fails.

 

That the provided functions are limited is not the point, i found some patches to enhance this. But using soap, web gui (and mail) leads to encoding problems. An broken welcome mails. I hope someone can point me into the right direction how to fix this.

 

Base system is CentOS 6.4 / 64 bit. soap::lite, mime:: and other packages via cpan, all other perl from centos or epel/rpmforge. MySQl as DB.

sympa is version 6.1.17

 

Creation of a list with UTF8 characters inside subject and info

* Using Web-GUI

  -> correctly encoded in DB and in the 2 files (config, info)

  -> correct view in Web-GUI

  -> incorrect subject view in soap

* Using soap

  -> correctly encoded in DB

  -> wrong (and different) encoding in the 2 files (config: Ä becomes C4, info: Ä becomes EFBFBD)

  -> incorrect view in Web-GUI

  -> correct subject view in soap

 

Adding a user with uf8 comment_subscriber  to a list

* Using Web-GUI

  -> (add user first, then edit user) correctly encoded in DB

  -> correct view in Web-GUI

  -> welcome mail correctly encoded

* Using soap

  -> correctly encoded in DB

  -> correct view in Web-GUI

  -> welcome mail incorrectly encoded (and body repeated 3 times if list info contains cyrillic text)

 

 

I had a look at different sourcesup entries and did fiddly with sympasoap.pm. But i couldnt fully solve these errors.

Most disturbing, the problem of the broken welcome mail. This happens in mail.pm, in sub reformat_message.

It has something to do with MIME::Parser here: $msg = $parser->parse_data($message);

But as far as i could debug, the function is called with identical values from soap and from web. So why is ist broken via soap?

(with perl-MIME-tools-5.427-4.el6.noarch and MIME-tools-5.504 from cpan)

 

Any help is appreciated

Thank you in advance

 

Immo Goltz

 

 

 

--
A bug in Sympa? Quick! To the bug tracker!

David Verdin Études et projets applicatifs
Tél : +33 2 23 23 69 71 Fax : +33 2 23 23 71 21   www.renater.fr	RENATER 263 Avenue du Gal Leclerc 35042 Rennes Cedex

 

Attachment: mail.pm.patch
Description: mail.pm.patch

Attachment: sympasoap.pm.patch
Description: sympasoap.pm.patch