After an evaluation, GNOME has moved from Bugzilla to GitLab. Learn more about GitLab.
No new issues can be reported in GNOME Bugzilla anymore.
To report an issue in a GNOME project, go to GNOME GitLab.
Do not go to GNOME Gitlab for: Bluefish, Doxygen, GnuCash, GStreamer, java-gnome, LDTP, NetworkManager, Tomboy.
Bug 794965 - Non-English Characters don't display properly in reports.
Non-English Characters don't display properly in reports.
Status: RESOLVED FIXED
Product: GnuCash
Classification: Other
Component: Reports
3.0
Other Windows
: Normal normal
: future
Assigned To: gnucash-reports-maint
gnucash-reports-maint
Depends on:
Blocks:
 
 
Reported: 2018-04-04 06:36 UTC by asomkin
Modified: 2018-06-30 00:07 UTC
See Also:
GNOME target: ---
GNOME version: ---


Attachments
'š' char (633 bytes, image/png)
2018-04-04 06:36 UTC, asomkin
Details
TEST account name (2.79 KB, image/png)
2018-04-05 06:14 UTC, asomkin
Details
System Error in nightly build (16.29 KB, image/png)
2018-04-17 06:04 UTC, asomkin
Details
Nightly build's TEST account name (3.21 KB, image/png)
2018-04-17 13:13 UTC, asomkin
Details
Problems with ru_RU (16.19 KB, image/png)
2018-05-07 09:14 UTC, asomkin
Details

Description asomkin 2018-04-04 06:36:54 UTC
Created attachment 370515 [details]
'š' char

It shows uppercase 'Š', but do not lowercase 'š'. Instead of it shows "�?".
Comment 1 Frank H. Ellenberger 2018-04-04 13:45:51 UTC
The https://en.wikipedia.org/wiki/Specials_(Unicode_block)#Replacement_character often appears, if a text encoded as ISO-8859-1 (or Windows-1252) is interpreted as https://en.wikipedia.org/wiki/UTF-8.

Please try to follow https://wiki.gnucash.org/wiki/FAQ#Q:_How_get_I_rid_of_strange_unreadable_characters_or_adjust_the_font_size
and report your result.
Comment 2 asomkin 2018-04-05 06:13:19 UTC
Tried to change to "Times New Roman Normal". It did not help. Tried to rename an account to "TEST ąčęėįšųūž ĄČĘĖĮŠŲŪŽ". The account name in any report shows as "TEST ąčęėį�?ųūž Ą�?�?ĖĮŠŲŪŽ".
Comment 3 asomkin 2018-04-05 06:14:25 UTC
Created attachment 370541 [details]
TEST account name

"TEST ąčęėįšųūž ĄČĘĖĮŠŲŪŽ" -> "TEST ąčęėį�?ųūž Ą�?�?ĖĮŠŲŪŽ"
Comment 4 asomkin 2018-04-06 07:15:40 UTC
Tried to change \gnucash\etc\gnucash\environment to:

LANG=ru_RU
LANGUAGE={LANG}

And report become even worse. Now it does not show any non-English characters in labels.
Comment 5 John Ralls 2018-04-16 23:38:02 UTC
There's a nightly build at https://wiki.gnucash.org/builds/win32/maint/gnucash-3.0-2018-04-16-git-3.0-75-g87f94abc8+.setup.exe that includes a change to converting characters from Scheme to UTF8 that I think resolves this issue. Please test it.
Comment 6 asomkin 2018-04-17 06:03:47 UTC
I can't lunch gnucash. It shows "System Error".
Comment 7 asomkin 2018-04-17 06:04:39 UTC
Created attachment 371009 [details]
System Error in nightly build
Comment 8 Geert Janssens 2018-04-17 12:45:38 UTC
I have just now created a new installer to fix the missing dll issue:
https://wiki.gnucash.org/builds/win32/maint/gnucash-3.0-2018-04-17-git-3.0-75-g87f94abc8+.setup.exe
Please test with that one and report back.
Comment 9 asomkin 2018-04-17 13:13:16 UTC
Created attachment 371041 [details]
Nightly build's TEST account name

It become even worse
Comment 10 Chris 2018-04-18 07:09:32 UTC
asomkin - are you finding the non-english characters in account names wrong in normal reports (eg Transaction Report, Income Statement), or in charts only (eg piechart/barchart)?

I know that the charts are currently rather hackish and should be upgraded very soon.
Comment 11 asomkin 2018-04-18 07:32:16 UTC
Yes, all reports have issues with characters.
Comment 12 Chris 2018-04-18 15:23:52 UTC
asomkin - experiments

CONFIRM bug exists on Gnucash 3.0 on Windows 10 (English, Australian)
CONFIRM bug is worse on Gnucash 3.0 on Ubuntu (locale=C)
->(shows "TEST ?????????????????? ??????????????????")
doesn't exist on Gnucash 3.0 on Ubuntu (locale=en_AU.utf8)

doesn't exist on Gnucash-maint on Ubuntu (locale=en_AU.utf8)
CONFIRM bug on Gnucash-maint on Ubuntu (locale=C)
->as above

all tests on a simple datafile with "TEST ąčęėįšųūž ĄČĘĖĮŠŲŪŽ" account and running account-summary report. guile-2.0 locale is not happy somewhere!
Comment 13 John Ralls 2018-04-22 23:19:05 UTC
We think this is a bug in Swig, fixed by https://github.com/swig/swig/commit/46ab0c252da9ab846265a60517ca462e5256cd24.
While we're waiting for that to get released I've modified GnuCash's guile-mappings.h to undo the damage. It will be in the next nightly build at https://code.gnucash.org/builds/win32/maint/.
Comment 14 Chris 2018-04-23 11:03:06 UTC
Latest nightly
gnucash-3.0-2018-04-23-git-3.0-87-g14c30344c+.setup

- in text reports - this is fixed
- in charts - this is buggy - but it will be interesting for charts to be upgraded then retested

https://imgur.com/a/e5ztRS5

Locale: English (Australia)

It would be interesting for the chartjs to be built for windows then retested.
Comment 15 Geert Janssens 2018-04-27 12:56:22 UTC
As discussed on IRC and PR#344 the remaining issues are caused by using guile's built-in regular expressions to html-escape account names and other data.

We have the foundation for a fix ready (https://github.com/Gnucash/gnucash/pull/344), it just needs to be integrated in the current code still.
Comment 16 Geert Janssens 2018-04-27 17:18:33 UTC
This problem has been fixed in our software repository. The fix will go into the next software release 3.1.
Comment 17 Chris 2018-05-07 08:14:37 UTC
asomkin - would you mind testing, on your locale, what happens with accented characters in account-names when running Balance Sheet (eguile) on Gnucash 3.1?
Comment 18 asomkin 2018-05-07 09:13:32 UTC
With lt_LT locale everything is OK. But there are some problems with ru_RU.
Comment 19 asomkin 2018-05-07 09:14:08 UTC
Created attachment 371767 [details]
Problems with ru_RU
Comment 20 asomkin 2018-05-07 09:19:03 UTC
There are problems with Cyrillic letters in legend.
Comment 21 Chris 2018-05-16 06:44:32 UTC
Sorry for delay; didn't see there was an attachment.
This is a similar but separate issue specific for chart-legend.
Feel free to file another bug.
Comment 22 John Ralls 2018-06-30 00:07:06 UTC
GnuCash bug tracking has moved to a new Bugzilla host. This bug has been copied to https://bugs.gnucash.org/show_bug.cgi?id=794965. Please update any external references or bookmarks.