After an evaluation, GNOME has moved from Bugzilla to GitLab. Learn more about GitLab.
No new issues can be reported in GNOME Bugzilla anymore.
To report an issue in a GNOME project, go to GNOME GitLab.
Do not go to GNOME Gitlab for: Bluefish, Doxygen, GnuCash, GStreamer, java-gnome, LDTP, NetworkManager, Tomboy.
Bug 317156 - UTF-8 in news messages not handled correct
UTF-8 in news messages not handled correct
Status: RESOLVED FIXED
Product: Pan
Classification: Other
Component: general
0.14.2.91
Other Linux
: Normal major
: 0.14.3
Assigned To: Christophe Lambin
Pan QA Team
Depends on:
Blocks:
 
 
Reported: 2005-09-25 12:06 UTC by Michael Rasmussen
Modified: 2005-12-30 23:43 UTC
See Also:
GNOME target: ---
GNOME version: 2.9/2.10



Description Michael Rasmussen 2005-09-25 12:06:38 UTC
Distribution/Version: Debian Sid

Read a message written in UTF-8

Example - text is in danish:-)
Approved:                   news@sslug.dk
Date:                       Sun, 25 Sep 2005 13:33:46 +0200
Delivered-To:               mail2news@sslug.dk
Delivered-To:               mailing list sslug-novice@sslug.dk
From:                       Michael Rasmussen <mir@miras.org>
Lines:                      14
Mailing-List:               contact sslug-novice-help@sslug.dk; run by ezmlm
Message-ID:                 <pan.2005.09.25.11.33.46.544934@miras.org>
NNTP-Posting-Date:          Sun, 25 Sep 2005 11:33:33 +0000 (UTC)
Newsgroups:                 sslug.novice
Organization:               SSLUG
Path:                       news.sslug.dk!sslug.dk!not-for-mail
Precedence:                 bulk
References:                 <43367B8E.7040301@Basic.dk>
Return-Path:                <sslug-novice-return-35767-mail2news=sslug.dk@sslug.dk>
Subject:                    Re: [NOVICE] * WordPerfect for Ubuntu *
User-Agent:                 Pan/0.14.2.91 (As She Crawled Across the Table
(Debian GNU/Linux))
X-No-Archive:               yes
Xref:                       news.sslug.dk sslug.novice:35282
errors-to:                  sslug-error@sslug.dk
list-help:                  <mailto:sslug-novice-help@sslug.dk>
list-unsubscribe:           <mailto:sslug-novice-unsubscribe@sslug.dk>
MIME-Version:               1.0
Content-Type:               text/plain; charset=UTF-8
Content-Transfer-Encoding:  8bit

On Sun, 25 Sep 2005 12:27:26 +0200, Claus B. Hansen wrote:

> Og i givet fald ... Hvorledes installerer jeg den så i min Ubuntu 5.04
> :-) ?
> 
Det gør du ikke! WP er et binært program oversat til en bestemt kerne-
og glibversion. Den kerne og glib WP er oversat til, er ikke den samme som
i Ubuntu.

-- 
Hilsen/Regards
Michael Rasmussen
http://keyserver.veridis.com:11371/pks/lookup?op=get&search=0xE3E80917


sslug-novice: Listen for begynder-relaterede spørgsmål
Comment 1 Christophe Lambin 2005-12-19 00:19:43 UTC
This should work. Can you point me to a recent message for me to test against ?
Comment 2 Christophe Lambin 2005-12-19 22:43:15 UTC
Seems this message was posted on a public server, so could access it directly.

Looking at the message, it's posted with a Content-Type header of 'utf-8'. However, the test itself is NOT valid UTF-8. This explains why the message appears as you see it.

More interestingly (worryingly ?), the message was posted with Pan 0.14.2.91. Maybe that release had some issue posting in UTF-8 ? I'm able to post in UTF-8 using current CVS version.
Comment 3 Michael Rasmussen 2005-12-19 22:58:45 UTC
The message was posted by me.

I have discovered that the problem seems to origin when the original message is a mixture of utf-8 and some other charset. Pan then disregards the charset header for some reason unknown to me and falls back to the system default charset. However, the error does not show up that much anymore. I will return with another example as soon as I see one.
Comment 4 Michael Rasmussen 2005-12-25 18:36:11 UTC
Hi,

Here is another posting with wrong character encoding:

Approved:                   news@sslug.dk
Date:                       Sun, 25 Dec 2005 19:13:34 +0100
Delivered-To:               mail2news@sslug.dk
Delivered-To:               mailing list sslug-novice@sslug.dk
From:                       Hans Christian Andersen <np5b@get2net.dk>
Mailing-List:               contact sslug-novice-help@sslug.dk; run by ezmlm
Message-Id:                 <1135534415.10195.6.camel@localhost.localdomain>
Newsgroups:                 sslug.novice
Path:                       news.sslug.dk!sslug.dk!not-for-mail
Precedence:                 bulk
Return-Path:                <sslug-novice-return-36859-mail2news=sslug.dk@sslug.dk>
Subject:                    [NOVICE] ingen lyd ubuntu (5.10) xmms
X-Cloudmark-Score:          0.000000 []
X-Mailer:                   Evolution 2.4.1
X-No-Archive:               yes
X-Spam-Status:              No, hits=0.0 required=5.0
X-T2-Posting-ID:            0zZGZGS0OMYemCG9qnjQiQ==
Xref:                       news.sslug.dk sslug.novice:36373
errors-to:                  sslug-error@sslug.dk
list-help:                  <mailto:sslug-novice-help@sslug.dk>
list-unsubscribe:           <mailto:sslug-novice-unsubscribe@sslug.dk>
MIME-Version:               1.0
Content-Type:               text/plain; charset=UTF-8
Content-Transfer-Encoding:  quoted-printable

Hvorfor får jeg ingen lyd, når jeg prøver at afspille en cd i xmms. Jeg
kan se på playlist og på hovedvinduets progress indikator, at xmms
finder mine filer.
Det virker fint at få lyd, hvis jeg afspiller cd'en i ubuntu's
cd-afspiller men altså ikke i xmms.
Nogle gode ideer???


sslug-novice: Listen for begynder-relaterede spørgsmål
Comment 5 Michael Rasmussen 2005-12-27 13:54:56 UTC
Hi,

And here is another:

Approved:                   news@sslug.dk
Date:                       Tue, 27 Dec 2005 13:51:22 +0100
Delivered-To:               mail2news@sslug.dk
Delivered-To:               mailing list sslug-novice@sslug.dk
From:                       Mogens Jaeger <mogensjaeger@get2net.dk>
Mailing-List:               contact sslug-novice-help@sslug.dk; run by ezmlm
Message-ID:                 <43B138CA.6090203@get2net.dk>
Newsgroups:                 sslug.novice
Path:                       news.sslug.dk!sslug.dk!not-for-mail
Precedence:                 bulk
Return-Path:                <sslug-novice-return-36864-mail2news=sslug.dk@sslug.dk>
Subject:                    [NOVICE] Rettigheder til brug af skanner
User-Agent:                 Mozilla Thunderbird 1.0.7 (X11/20050923)
X-Accept-Language:          en-us, en
X-Cloudmark-Score:          0.000000 []
X-No-Archive:               yes
X-Spam-Status:              No, hits=0.0 required=5.0
X-T2-Posting-ID:            xVsxd7oycAB6pIFnIFtmrg==
Xref:                       news.sslug.dk sslug.novice:36378
errors-to:                  sslug-error@sslug.dk
list-help:                  <mailto:sslug-novice-help@sslug.dk>
list-unsubscribe:           <mailto:sslug-novice-unsubscribe@sslug.dk>
MIME-Version:               1.0
Content-Type:               text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding:  8bit

Hej

Jeg har en Epson skanner, der er tilsluttet boxen via et FireWire kabel.
Jeg har ikke tidligere haft problemet, men her efter jeg har opgraderet
til SuSE10.0 skal jeg hver gang jeg vil bruge skanneren, som root ændre
rettigheder til bruger for at få adgang til skanneren. Den bliver/er
placeret på /dev/sg5.
Under opstart har jeg set at den konfigurer = helt i start før lilo
starter - et USB mass storage device, selvom der kun er 2 slukkede
printere tilsluttet på USB'en.
Hvad skal der til for at den bevarer brugers rettigheder til porten, også
efter en gang sluk/tænd?
Kan jeg lave et link, og hvor skal det så anbringes for at XSane kan
bruge det? jeg går ikke ud fra, at det nytter at placere det i /dev
kataloget, når /dev/sg5 bliver ændret. På forhånd tak for hjælp

-- 
mvh Mogens Jæger


sslug-novice: Listen for begynder-relaterede spørgsmål

Comment 6 Christophe Lambin 2005-12-30 23:20:30 UTC
Thanks for the samples. You're correct: this happens when the body's a mixture of UTF-8 and some other charset.  In your examples, the message is posted in UTF-8, but the sslug.dk maillist appends a signature in ISO-8859-1.

Writing a patch for this now.