FUDforum: Bug Reports » maillist import from html to utf-8 incorrect

Home » FUDforum Development » Bug Reports » maillist import from html to utf-8 incorrect

Show: Today's Messages :: Polls :: Message Navigator

maillist import from html to utf-8 incorrect [message #158521]

Sun, 01 March 2009 17:19

Peter Vendike

Messages: 65
Registered: February 2009
Location: Denmark

Karma: 0

Member
Translator

This problem for maillist.php at least v 1.73 to 1.77

Looking at the danish special letters.

My messages are saved in utf-8 format.
Import of quoted-printable text/plain works fine to utf-8

But in text/html messages quoted-printable are converted to ISO-8859 (I think) 8-bit symbols.

after stripping html codes maillist.php should use the (new?) procedure for text/plain ????

Report message to a moderator

Re: maillist import from html to utf-8 incorrect [message #158522 is a reply to message #158521]

Sun, 01 March 2009 17:46

naudefj

Messages: 3771
Registered: December 2004

Karma: 28

Senior Member
Administrator
Core Developer

Not sure I understand. Here's the difference between 1.73 and 1.75.

Your theme's charset and database charset may also play a role.

Report message to a moderator

Re: maillist import from html to utf-8 incorrect [message #158525 is a reply to message #158522]

Sun, 01 March 2009 19:22

Peter Vendike

Messages: 65
Registered: February 2009
Location: Denmark

Karma: 0

Member
Translator

OK, its not special for html. Using maillist.php v.173:

this message was imported correctly from Gmail:

Subject: =?UTF-8?B?RndkOiBkYW5za2UgdGVnbiDDpiDDuCDDpQ==?=
From: Peter Vendike <@mygmailadress.com>
To: Peter Vendike <@myotheradress.dk>
Content-Type: text/plain;
charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Status: R
X-Status: NC
X-KMail-EncryptionState:
X-KMail-SignatureState:
X-KMail-MDN-Sent:

---------- Forwarded message ----------
From: Peter Vendike <v(at)mygmailadress(dot)com>
Date: Sun, 1 Mar 2009 19:57:01 +0100
Subject: danske tegn =C3=A6 =C3=B8 =C3=A5
To: forum <import(at)myforum(dot)com>

De danske bogstaver =C3=A6 =C3=B8 =C3=A5

This one not correctly imported, neither subject nor text:

From: Peter Vendike <@myotheraddress.dk>
To: import(at)myforum(dot)com
Subject: test af =?iso-8859-1?b?5vjl?=
Date: Sun, 1 Mar 2009 19:54:11 +0100
User-Agent: KMail/1.9.5
MIME-Version: 1.0
Content-Type: text/plain;
charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline
Message-Id: <200903011954(dot)11779(dot)xxxx(at)xxxx(dot)dk>
Status: RO
X-Status: RSC
X-KMail-EncryptionState:
X-KMail-SignatureState:
X-KMail-MDN-Sent:

dette er en test af danske tegn
The danish letters: =E6 =F8 =E5 =C6 =D8 =C5

Report message to a moderator

Re: maillist import from html to utf-8 incorrect [message #158526 is a reply to message #158525]

Sun, 01 March 2009 19:58

naudefj

Messages: 3771
Registered: December 2004

Karma: 28

Senior Member
Administrator
Core Developer

Do you think this is a new problem? I don't think the previous release could've loaded both these messages successfully either.

Report message to a moderator

Re: maillist import from html to utf-8 incorrect [message #158527 is a reply to message #158526]

Sun, 01 March 2009 20:18

Peter Vendike

Messages: 65
Registered: February 2009
Location: Denmark

Karma: 0

Member
Translator

No, I think it's the the same with all versions I tried, must be old.

naudefj wrote on Sun, 01 March 2009 20:58

Do you think this is a new problem? I don't think the previous release could've loaded both these messages successfully either.

Report message to a moderator

Re: maillist import from html to utf-8 incorrect [message #158534 is a reply to message #158527]

Mon, 02 March 2009 11:31

Peter Vendike

Messages: 65
Registered: February 2009
Location: Denmark

Karma: 0

Member
Translator

Reading and trying to understand the program file "maillist.php" i believe the text conversion is made by one ore more functions from the include directory, but as I'm not a programmer it would take me realy some time to understand what to change.

Some type af table for character translation is selected wrongly, but is not so bad at all, as the translation is "nearly" right, as I can see by inspecting the forum-message file "msg_10000" with a hex-editor. In the "mistaken" translations the characters are still there, only 8-bit instead off utf-8.
When the forum is set up to utf-8, it should not be possible for this function (wich I don't know) to use a 8-bit translation table

Report message to a moderator

Previous Topic:	Issues with compacting messages
Next Topic:	Parse error: syntax error, unexpected '?' in

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

]

Current Time: Thu Nov 21 15:13:29 GMT 2024

Total time taken to generate the page: 0.04412 seconds