GNOME Bugzilla – Bug 317156
UTF-8 in news messages not handled correct
Last modified: 2005-12-30 23:43:57 UTC
Distribution/Version: Debian Sid Read a message written in UTF-8 Example - text is in danish:-) Approved: news@sslug.dk Date: Sun, 25 Sep 2005 13:33:46 +0200 Delivered-To: mail2news@sslug.dk Delivered-To: mailing list sslug-novice@sslug.dk From: Michael Rasmussen <mir@miras.org> Lines: 14 Mailing-List: contact sslug-novice-help@sslug.dk; run by ezmlm Message-ID: <pan.2005.09.25.11.33.46.544934@miras.org> NNTP-Posting-Date: Sun, 25 Sep 2005 11:33:33 +0000 (UTC) Newsgroups: sslug.novice Organization: SSLUG Path: news.sslug.dk!sslug.dk!not-for-mail Precedence: bulk References: <43367B8E.7040301@Basic.dk> Return-Path: <sslug-novice-return-35767-mail2news=sslug.dk@sslug.dk> Subject: Re: [NOVICE] * WordPerfect for Ubuntu * User-Agent: Pan/0.14.2.91 (As She Crawled Across the Table (Debian GNU/Linux)) X-No-Archive: yes Xref: news.sslug.dk sslug.novice:35282 errors-to: sslug-error@sslug.dk list-help: <mailto:sslug-novice-help@sslug.dk> list-unsubscribe: <mailto:sslug-novice-unsubscribe@sslug.dk> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit On Sun, 25 Sep 2005 12:27:26 +0200, Claus B. Hansen wrote: > Og i givet fald ... Hvorledes installerer jeg den sÃ¥ i min Ubuntu 5.04 > :-) ? > Det gør du ikke! WP er et binært program oversat til en bestemt kerne- og glibversion. Den kerne og glib WP er oversat til, er ikke den samme som i Ubuntu. -- Hilsen/Regards Michael Rasmussen http://keyserver.veridis.com:11371/pks/lookup?op=get&search=0xE3E80917 sslug-novice: Listen for begynder-relaterede spørgsmål
This should work. Can you point me to a recent message for me to test against ?
Seems this message was posted on a public server, so could access it directly. Looking at the message, it's posted with a Content-Type header of 'utf-8'. However, the test itself is NOT valid UTF-8. This explains why the message appears as you see it. More interestingly (worryingly ?), the message was posted with Pan 0.14.2.91. Maybe that release had some issue posting in UTF-8 ? I'm able to post in UTF-8 using current CVS version.
The message was posted by me. I have discovered that the problem seems to origin when the original message is a mixture of utf-8 and some other charset. Pan then disregards the charset header for some reason unknown to me and falls back to the system default charset. However, the error does not show up that much anymore. I will return with another example as soon as I see one.
Hi, Here is another posting with wrong character encoding: Approved: news@sslug.dk Date: Sun, 25 Dec 2005 19:13:34 +0100 Delivered-To: mail2news@sslug.dk Delivered-To: mailing list sslug-novice@sslug.dk From: Hans Christian Andersen <np5b@get2net.dk> Mailing-List: contact sslug-novice-help@sslug.dk; run by ezmlm Message-Id: <1135534415.10195.6.camel@localhost.localdomain> Newsgroups: sslug.novice Path: news.sslug.dk!sslug.dk!not-for-mail Precedence: bulk Return-Path: <sslug-novice-return-36859-mail2news=sslug.dk@sslug.dk> Subject: [NOVICE] ingen lyd ubuntu (5.10) xmms X-Cloudmark-Score: 0.000000 [] X-Mailer: Evolution 2.4.1 X-No-Archive: yes X-Spam-Status: No, hits=0.0 required=5.0 X-T2-Posting-ID: 0zZGZGS0OMYemCG9qnjQiQ== Xref: news.sslug.dk sslug.novice:36373 errors-to: sslug-error@sslug.dk list-help: <mailto:sslug-novice-help@sslug.dk> list-unsubscribe: <mailto:sslug-novice-unsubscribe@sslug.dk> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hvorfor fÃ¥r jeg ingen lyd, nÃ¥r jeg prøver at afspille en cd i xmms. Jeg kan se pÃ¥ playlist og pÃ¥ hovedvinduets progress indikator, at xmms finder mine filer. Det virker fint at fÃ¥ lyd, hvis jeg afspiller cd'en i ubuntu's cd-afspiller men altsÃ¥ ikke i xmms. Nogle gode ideer??? sslug-novice: Listen for begynder-relaterede spørgsmål
Hi, And here is another: Approved: news@sslug.dk Date: Tue, 27 Dec 2005 13:51:22 +0100 Delivered-To: mail2news@sslug.dk Delivered-To: mailing list sslug-novice@sslug.dk From: Mogens Jaeger <mogensjaeger@get2net.dk> Mailing-List: contact sslug-novice-help@sslug.dk; run by ezmlm Message-ID: <43B138CA.6090203@get2net.dk> Newsgroups: sslug.novice Path: news.sslug.dk!sslug.dk!not-for-mail Precedence: bulk Return-Path: <sslug-novice-return-36864-mail2news=sslug.dk@sslug.dk> Subject: [NOVICE] Rettigheder til brug af skanner User-Agent: Mozilla Thunderbird 1.0.7 (X11/20050923) X-Accept-Language: en-us, en X-Cloudmark-Score: 0.000000 [] X-No-Archive: yes X-Spam-Status: No, hits=0.0 required=5.0 X-T2-Posting-ID: xVsxd7oycAB6pIFnIFtmrg== Xref: news.sslug.dk sslug.novice:36378 errors-to: sslug-error@sslug.dk list-help: <mailto:sslug-novice-help@sslug.dk> list-unsubscribe: <mailto:sslug-novice-unsubscribe@sslug.dk> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Hej Jeg har en Epson skanner, der er tilsluttet boxen via et FireWire kabel. Jeg har ikke tidligere haft problemet, men her efter jeg har opgraderet til SuSE10.0 skal jeg hver gang jeg vil bruge skanneren, som root ændre rettigheder til bruger for at fÃ¥ adgang til skanneren. Den bliver/er placeret pÃ¥ /dev/sg5. Under opstart har jeg set at den konfigurer = helt i start før lilo starter - et USB mass storage device, selvom der kun er 2 slukkede printere tilsluttet pÃ¥ USB'en. Hvad skal der til for at den bevarer brugers rettigheder til porten, ogsÃ¥ efter en gang sluk/tænd? Kan jeg lave et link, og hvor skal det sÃ¥ anbringes for at XSane kan bruge det? jeg gÃ¥r ikke ud fra, at det nytter at placere det i /dev kataloget, nÃ¥r /dev/sg5 bliver ændret. PÃ¥ forhÃ¥nd tak for hjælp -- mvh Mogens Jæger sslug-novice: Listen for begynder-relaterede spørgsmål
Thanks for the samples. You're correct: this happens when the body's a mixture of UTF-8 and some other charset. In your examples, the message is posted in UTF-8, but the sslug.dk maillist appends a signature in ISO-8859-1. Writing a patch for this now.
Fixed in CVS: http://cvs.gnome.org/bonsai/cvsview2.cgi?subdir=pan/pan/base&files=pan-glib-extensions.c&command=DIRECTORY&branch=HEAD&root=/cvs/gnome http://cvs.gnome.org/bonsai/cvsview2.cgi?subdir=pan&files=ChangeLog&command=DIRECTORY&branch=HEAD&root=/cvs/gnome