After an evaluation, GNOME has moved from Bugzilla to GitLab. Learn more about GitLab.
No new issues can be reported in GNOME Bugzilla anymore.
To report an issue in a GNOME project, go to GNOME GitLab.
Do not go to GNOME Gitlab for: Bluefish, Doxygen, GnuCash, GStreamer, java-gnome, LDTP, NetworkManager, Tomboy.
Bug 781933 - Translation statistics are not accurated
Translation statistics are not accurated
Status: RESOLVED OBSOLETE
Product: damned-lies
Classification: Infrastructure
Component: l10n.gnome.org
unspecified
Other Linux
: Normal normal
: ---
Assigned To: damned-lies Maintainer(s)
damned-lies Maintainer(s)
Depends on:
Blocks:
 
 
Reported: 2017-04-29 08:20 UTC by Jordi Mas
Modified: 2018-05-22 12:21 UTC
See Also:
GNOME target: ---
GNOME version: ---



Description Jordi Mas 2017-04-29 08:20:40 UTC
In the git repository you have a translation like this:

#~ msgctxt "shortcut window"
#~ msgid "View"
#~ msgstr "Visualitza"

that when an application is built is not showed.

However, dammed lies process the PO file in a way that the string is:

msgctxt "shortcut window"
msgid "View"
msgstr "Visualitza"

and the string that in the application will not show as translated is shown as such as the translation statistics.

This is really misleading because you think that the file is completely translated according to the statistics but it is not true.

This behaviour caused the Catalan translate team two miss updates two applications already.
Comment 1 Alexandre Franke 2017-04-29 11:37:11 UTC
Please provide a link to an example.
Comment 2 Jordi Mas 2017-04-29 13:05:39 UTC
For example the ca.po before this commit:

https://git.gnome.org/browse/epiphany/commit/?h=gnome-3-24&id=2bd4624bee40ff3f4154526ca93037cc8fc8fde5

It was reported to be fully translated except for 15 fuzzy strings by Dammed Lies.

Unfortunally most of the menus were showing in English when the app was ran.

I committed the file from Dammed files with the commit referenced at the top.

My suggest fix: do stats on the original PO from Git not with the PO file  that you provide for people to download.

Jordi,
Comment 3 Claude Paroz 2017-04-29 13:18:36 UTC
> (In reply to Jordi Mas from comment #2)
> My suggest fix: do stats on the original PO from Git not with the PO file 
> that you provide for people to download.

That's not an option, as the stats have to be computed after being merged with the latest generated pot file. There is no value in simply giving stats for the committed po from Git.

What we could imagine is doing two different merges, one with a po file stripped from any obsolete msgstr value and an other with the "normal" po file.

That would double the merge computing load on the server, for a marginal benefit. I think I still have to make my mind about it.
Comment 4 Jordi Mas 2017-04-30 07:04:51 UTC
If it helps to clarify, my use case is simple. I look at Damned Lies to understand if we have to update the translations in a file. If Damned Lies  tells me that the file is 100% translated but then the application is not showing 100% translated, it is not reliable.

In the case of the Catalan translation, in 3.24 cycle, we missed the update of Nautilus (a key component of the user experience) and Epiphany browser due to this.

Thanks Claude
Comment 5 Claude Paroz 2017-04-30 20:01:25 UTC
I understand the issue and I'm sorry for the missing deadline.

However, the probability for that to happen is still relatively low. The package must have new translatable strings which have 100% matches in the obsolete strings of a language, and no new translatable strings with no match have been introduced. The fact you are the first reporter for such an issue in years of GNOME translations is also confirming the low probability.

That doesn't mean we shouldn't try to fix it, of course, but the solution I currently imagine is quite "heavy".
Comment 6 Claude Paroz 2017-05-02 07:35:35 UTC
I created a related issue in gettext tracker: https://savannah.gnu.org/bugs/index.php?50910
Comment 7 Jordi Mas 2017-05-05 20:18:59 UTC
Hello,

I want to comment that this is happening in more cases.

For Catalan is also happen for mutter project:

What was in Git

msgfmt -c --statistics ca.po
34 translated messages.

What was in Damned Lies:

https://l10n.gnome.org/POT/mutter.master/mutter.master.da.po
124 translated messages, 5 fuzzy translations, 2 untranslated messages.

But the same problem happens with DA:

(look for string "Switch windows of an application") in these files:

https://l10n.gnome.org/POT/mutter.master/mutter.master.da.po
https://git.gnome.org/browse/mutter/tree/po/da.po

And also for pt_BR and BG languages
Comment 8 Claude Paroz 2017-05-05 22:01:32 UTC
Jordi, this is totally expected. String modules are moving all the time, and it can happen that a translator commit happen at a time where some strings are obsoleted, then the module maintainer fixes something and the day after, stats are completely different.

I accepted the ticket because the problem is when the stats show 100% translated, while some of these translations are strings that are retrieved from obsoleted strings.

The discussion with Bruno in the gettext bug was interesting. In the standard gettext workflow, it was expected that the build system should get a fresh pot file and merge it with committed translations (make update-po). In this case, the problem you mention about missing deadline because of apparent 100% translation status would not have happened. However many modules currently merely compile existing po files during their build process without any merging process. In other words, they trust DL too much!
Comment 9 GNOME Infrastructure Team 2018-05-22 12:21:22 UTC
-- GitLab Migration Automatic Message --

This bug has been migrated to GNOME's GitLab instance and has been closed from further activity.

You can subscribe and participate further through the new bug through this link to our GitLab instance: https://gitlab.gnome.org/GNOME/damned-lies/issues/68.