After an evaluation, GNOME has moved from Bugzilla to GitLab. Learn more about GitLab.
No new issues can be reported in GNOME Bugzilla anymore.
To report an issue in a GNOME project, go to GNOME GitLab.
Do not go to GNOME Gitlab for: Bluefish, Doxygen, GnuCash, GStreamer, java-gnome, LDTP, NetworkManager, Tomboy.
Bug 659122 - UnicodeDecodeError and UnicodeEncodeError keep cropping up since introspection
UnicodeDecodeError and UnicodeEncodeError keep cropping up since introspection
Status: RESOLVED FIXED
Product: orca
Classification: Applications
Component: speech
3.1.x
Other All
: Normal normal
: ---
Assigned To: Joanmarie Diggs (IRC: joanie)
Orca Maintainers
: 661382 (view as bug list)
Depends on:
Blocks:
 
 
Reported: 2011-09-15 05:41 UTC by Hammer Attila
Modified: 2012-02-20 19:54 UTC
See Also:
GNOME target: ---
GNOME version: ---


Attachments
Debug file with shows why happening this bug (221.04 KB, application/octet-stream)
2011-09-15 05:41 UTC, Hammer Attila
Details
An another debug.out file with shows little different problem (303.03 KB, application/octet-stream)
2011-09-15 12:36 UTC, Hammer Attila
Details
This debug.out file show what happening if I try handling Firefox with bugzilla webpage forms (344.23 KB, application/octet-stream)
2011-09-15 14:39 UTC, Hammer Attila
Details
Two interesting traceback error message for gedit (587.04 KB, application/octet-stream)
2011-09-15 15:15 UTC, Hammer Attila
Details
Unicode decode error traceback error messages if I using Firefox7 the Bugzilla File a bug form elements (356.88 KB, application/octet-stream)
2011-09-16 11:53 UTC, Hammer Attila
Details
Debug file with an unicode decode error for \x00c3 character (438.74 KB, application/octet-stream)
2011-09-19 10:03 UTC, Hammer Attila
Details
This file created Orca application-specific preferences dialog when Firefox are launched and focused (2.14 KB, text/x-python)
2011-09-19 10:10 UTC, Hammer Attila
Details
Found an another Unicode encode error traceback error message with Orca time presenting function (151.18 KB, application/octet-stream)
2011-09-30 10:17 UTC, Hammer Attila
Details
This debug.out file shows an another Unicode decode related traceback error message (251.00 KB, application/octet-stream)
2011-11-01 06:32 UTC, Hammer Attila
Details
This is my orca-customizations.py file (26.71 KB, text/x-python)
2011-11-01 09:39 UTC, Hammer Attila
Details
Debug file with show a unicode decode error related traceback message with Thunderbird usage (247.05 KB, application/octet-stream)
2011-12-06 05:29 UTC, Hammer Attila
Details
An another debug.out file with show an another unicode decode error (84.42 KB, application/octet-stream)
2011-12-07 06:19 UTC, Hammer Attila
Details
This is my Orca user-settings.conf file (8.63 KB, application/octet-stream)
2011-12-07 06:21 UTC, Hammer Attila
Details

Description Hammer Attila 2011-09-15 05:41:01 UTC
Created attachment 196587 [details]
Debug file with shows why happening this bug

Dear Developers,

If I using Orca 3.1.91 Ubuntu oneiric latest packaged version with hungarian locale, Orca producing unicode decode traceback error for example when Orca main window is displaying.
This error resulting following problems:
1. When I moving Orca main window with TAB and SHIFT+TAB key combination, Orca doesn't spokening actual highlighted hungarian language translated button.
2. When I try presenting Orca preferences dialog, the preferences dialog doesn't presenting the screen. Of course to determine why happening this problem, I removed first the Ubuntu shipped preconfigured Orca user-settings.conf file with the ~/.local/share/orca directory.

Debug.out file containing speech generation related following important informations:
PREPARATION TIME: 0.0179
generate speech for unfocused app.name='orca' name='Beállítások' role='push button' state='enabled focusable focused sensitive showing visible' relations='' (args={'recursing': True, 'priorObj': <Accessible object at 0x987e20c (AtspiAccessible at 0x9895d68)>, 'role': <enum ATSPI_ROLE_PUSH_BUTTON of type Role>, 'mode': 'speech', 'formatType': 'unfocused'}) using 'newAncestors + newRowHeader + newColumnHeader + newRadioButtonGroup + labelAndName + roleName + availability + (mnemonic and (pause + mnemonic + lineBreak) or []) + accelerator + newNodeLevel + unselectedCell + (tutorial and (pause + tutorial) or [])'
script_utilities.commonAncestor...
...script_utilities.commonAncestor
Object deemed to be for layout purposes only: [panel | ]
GENERATION  TIME: 0.0308  ---->  newAncestors=[]
GENERATION  TIME: 0.0068  ---->  newRowHeader=[]
GENERATION  TIME: 0.0069  ---->  newColumnHeader=[]
GENERATION  TIME: 0.0018  ---->  newRadioButtonGroup=[]
GENERATION  TIME: 0.0018  ---->  labelAndName=['Be\xc3\xa1ll\xc3\xadt\xc3\xa1sok', {}]
GENERATION  TIME: 0.0033  ---->  roleName=['gomb', {}]
GENERATION  TIME: 0.0018  ---->  availability=[]
GENERATION  TIME: 0.0005  ---->  mnemonic=[]
script_utilities.getKeyBinding: ['', u'Alt e', '']
GENERATION  TIME: 0.0037  ---->  accelerator=[]
GENERATION  TIME: 0.0019  ---->  newNodeLevel=[]
GENERATION  TIME: 0.0067  ---->  unselectedCell=[]
GENERATION  TIME: 0.0019  ---->  tutorial=[]
COMPLETION  TIME: 0.0870
generate speech results:
  Beállítások
  {}
  gomb
  {}
bad content sent to speech.speak: '{}'
bad content sent to speech.speak: '{}'

Traceback (most recent call last):
  • File "/usr/lib/python2.7/dist-packages/orca/event_manager.py", line 238 in _dequeue
    self._processObjectEvent(event)
  • File "/usr/lib/python2.7/dist-packages/orca/event_manager.py", line 499 in _processObjectEvent
    script.processObjectEvent(event)
  • File "/usr/lib/python2.7/dist-packages/orca/script.py", line 397 in processObjectEvent
    self.listeners[key](event)
  • File "/usr/lib/python2.7/dist-packages/orca/scripts/default.py", line 3092 in onFocus
    orca.setLocusOfFocus(event, newFocus)
  • File "/usr/lib/python2.7/dist-packages/orca/orca.py", line 674 in setLocusOfFocus
    event, oldLocusOfFocus, orca_state.locusOfFocus)
  • File "/usr/lib/python2.7/dist-packages/orca/scripts/default.py", line 1331 in locusOfFocusChanged
    speech.speak(utterances, voice, not shouldNotInterrupt)
  • File "/usr/lib/python2.7/dist-packages/orca/speech.py", line 256 in speak
    _speak(string, activeVoice, interrupt)
  • File "/usr/lib/python2.7/dist-packages/orca/speech.py", line 181 in _speak
    debug.println(debug.LEVEL_INFO, logLine + extraDebug)
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 18: ordinal not in range(128)

So, Orca sending bad content with speech.speak function with Speech-dispatcher built in Espeak module. If I remember right, this bad content sending type problem is fixed with orca-xdesktop branch.
I tested this bug with Orca latest master version, unfortunately this bug is affected with master version too.

I attached the debug.out file.
Hopefuly I setting right the importance this bug, now I setted critical status, because only speech output I unable to use Orca main window for hungarian language and Orca preferences dialog.

Attila
Comment 1 Joanmarie Diggs (IRC: joanie) 2011-09-15 10:19:23 UTC
Probably a duplicate of bug 658781 (Some text not spoken at all since gobject introspection changes in orca 3.1.9x.) I'll set up Hungarian locale and test to be sure.
Comment 2 Joanmarie Diggs (IRC: joanie) 2011-09-15 10:26:00 UTC
Argh. Make that another instance of that problem but which I did not catch whilst fixing bug 658781. Confirmed. I'll get these fixed now. Thanks!!!
Comment 3 Hammer Attila 2011-09-15 11:12:38 UTC
Joanie, if I understand right, I morning experienced issue is a duplication for bug 658781 related fix with missing an important case handling?

If yes, I setting this bug status with duplicated.
Thank you the future fix,

Attila
Comment 4 Joanmarie Diggs (IRC: joanie) 2011-09-15 11:27:03 UTC
(In reply to comment #3)
> Joanie, if I understand right, I morning experienced issue is a duplication for
> bug 658781 related fix with missing an important case handling?

You're sort of right. Basically there is an overarching bug which could be roughly described as "Porting to introspection has resulted in huge, huge problems with text encoding and decoding." Bug 658781 being one of those bugs and one I had just fixed yesterday. So I thought that perhaps you hadn't pulled master since I committed that fix. But I was able to confirm your bug when I switched to the Hungarian locale. So it's not a dup after all.

Anyhoo, I have just tabbed through every last widget in the fully localized Hungarian Orca Preferences dialog. I think I've fixed this bug. Mind pulling master and testing?

http://git.gnome.org/browse/orca/commit/?id=a7e1f5379e1cac23b448aaa855a3df43d493b6cd
Comment 5 Hammer Attila 2011-09-15 11:44:47 UTC
Ok, I now see master source the update, with you uploaded thu, 15 sep 2011 07:17:56.
When I downloaded master version my Oneiric live CD, I think the time is before this time.
I used following command:
git clone git://git.gnome.org/orca.

Btv, I think forgot customize the hungarian timezone with my live Cd, so possible this is the problem why not I see this commit.
I going now Oneiric and look the results.

Attila
Comment 6 Hammer Attila 2011-09-15 12:36:19 UTC
Created attachment 196620 [details]
An another debug.out file with shows little different problem

Hy Joanie,

I have little good news and one bad news:
1. Orca main window present wonderful with actual master version, and Orca preferences dialog working great. This is the good news.

The bad news is following:
When I browse the debug.out file with Gedit, some textual lines Orca doesn't spokening before following traceback error message:
Traceback (most recent call last):
  • File "/usr/local/lib/python2.7/dist-packages/orca/event_manager.py", line 238 in _dequeue
    self._processObjectEvent(event)
  • File "/usr/local/lib/python2.7/dist-packages/orca/event_manager.py", line 499 in _processObjectEvent
    script.processObjectEvent(event)
  • File "/usr/local/lib/python2.7/dist-packages/orca/script.py", line 397 in processObjectEvent
    self.listeners[key](event)
  • File "/usr/local/lib/python2.7/dist-packages/orca/scripts/apps/gedit/script.py", line 576 in onCaretMoved
    default.Script.onCaretMoved(self, event)
  • File "/usr/local/lib/python2.7/dist-packages/orca/scripts/default.py", line 3027 in onCaretMoved
    self._presentTextAtNewCaretPosition(event)
  • File "/usr/local/lib/python2.7/dist-packages/orca/scripts/default.py", line 3862 in _presentTextAtNewCaretPosition
    self.sayLine(obj)
  • File "/usr/local/lib/python2.7/dist-packages/orca/scripts/default.py", line 4490 in sayLine
    line = self.utilities.adjustForRepeats(line)
  • File "/usr/local/lib/python2.7/dist-packages/orca/script_utilities.py", line 2511 in adjustForRepeats
    newLine = self._addRepeatSegment(segment, newLine)
  • File "/usr/local/lib/python2.7/dist-packages/orca/script_utilities.py", line 2350 in _addRepeatSegment
    % {"count" : count, "repeatChar": repeatChar}
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 4: ordinal not in range(128)

I think Orca following lines doesn't spokening, but presenting the braille display:
PREPARATION TIME: 0.0009
generate braille for focused app.name='gedit' name='None' role='text' state='editable enabled focusable focused multi line sensitive showing visible' relations='' (args={'formatType': 'focused', 'role': <enum ATSPI_ROLE_TEXT of type Role>, 'mode': 'braille', 'recursing': True}) using '(includeContext                           and (ancestors                                + (rowHeader and [Region(" " + asString(rowHeader))])                                + (columnHeader and [Region(" " + asString(columnHeader))])                                + (radioButtonGroup and [Region(" " + asString(radioButtonGroup))])                                + [Region(" ")])                           or []) + [Text(obj, asString(label + placeholderText), asString(eol))]                + (required and [Region(" " + asString(required))])                + (readOnly and [Region(" " + asString(readOnly))]) + (nodeLevel and [Region(" " + asString(nodeLevel))])'
GENERATION  TIME: 0.0013  ---->  includeContext=False
GENERATION  TIME: 0.0009  ---->  label=[]
GENERATION  TIME: 0.0009  ---->  placeholderText=[]
GENERATION  TIME: 0.0004  ---->  eol=[u' ']
GENERATION  TIME: 0.0033  ---->  required=[]
isReadOnlyTextArea=False for app.name='gedit' name='None' role='text' state='editable enabled focusable focused multi line sensitive showing visible' relations=''
GENERATION  TIME: 0.0041  ---->  readOnly=[]
GENERATION  TIME: 0.0033  ---->  nodeLevel=[]
COMPLETION  TIME: 0.0184
generate braille results:
  Text: '^^^^^ PROCESS OBJECT EVENT object:state-changed:showing ^^^^^ ', 1
BRAILLE LINE:  '^^^^^ PROCESS OBJECT EVENT object:state-changed:showing ^^^^^ '
     VISIBLE:  '^^^^^ PROCESS OBJECT EVENT object:state-changed:showing ^^^^^ ', cursor=2
sayLine: line=<^^^^^ PROCESS OBJECT EVENT object:state-changed:showing ^^^^^>, len=61, start=140704, 
caret=140705, speakBlankLines=True

Look this attached debug.out file, I doed some up and down arrow test with silent lines.
All muted lines I proper seeing the braille display.

Attila
Comment 7 Joanmarie Diggs (IRC: joanie) 2011-09-15 12:50:30 UTC
Argh. I was afraid of that and so I arrowed through and did a sayAll of a large chunk of hungarian debug.out -- all with no trouble. But, with your traceback I should be able to solve that.

Thanks again!
Comment 8 Joanmarie Diggs (IRC: joanie) 2011-09-15 13:25:16 UTC
Attila, please pull master and keep testing. With any luck we'll have all of these silly errors destroyed by the end of the day. <smiles>

Thanks!!
Comment 9 Hammer Attila 2011-09-15 13:36:51 UTC
Thank you the new fix, I going testing the new changes.
I hope tomorrow my friend have enough free time to help me install new Oneiric testing environment with a Virtual machine if perhaps Ubiquity installer still have inaccessible dialog parts.
Comment 10 Hammer Attila 2011-09-15 14:31:15 UTC
Joanie, you will be not like me. :-):-)
The test results begin good, but I will be sending two debug.out attachment with show interesting unicode decode errors and unicode encode errors with various application usage tests.

The first application is Gedit with I tested, I simple try saving a file, and delete the characters with the wrote filename with Backspace key. Orca this situation doesn't spokened me the deleted characters for hungarian language environment.

Attila
Comment 11 Joanmarie Diggs (IRC: joanie) 2011-09-15 14:32:46 UTC
Ha! On the contrary Attila: You are now my favorite person *ever*. Thanks to your thorough testing, Orca 3.2 should be pretty darned bug free.
Comment 12 Hammer Attila 2011-09-15 14:39:20 UTC
Created attachment 196640 [details]
This debug.out file show what happening if I try handling Firefox with bugzilla webpage forms

If I try doing basic Orca form field jump with Firefox 7.0B5 version, Orca producing following traceback error messages, this situation Tab key doesn't jump the next object, or the next object not spokened:
PREPARATION TIME: 0.0021
generate braille for unfocused app.name='Firefox' name='Severity:' role='combo box' state='enabled expandable focusable horizontal opaque sensitive showing visible' relations='labelled by' (args={'formatType': 'unfocused', 'useDefaultFormatting': False, 'includeContext': False, 'role': <enum ATSPI_ROLE_COMBO_BOX of type Role>, 'mode': 'braille', 'recursing': True}) using '[Component(obj,                                     asString(label + name + roleName),                                     asString(label) and (len(asString(label)) + 1) or 0)]'
GENERATION  TIME: 0.0088  ---->  label=[u'Severity:']
GENERATION  TIME: 0.0045  ---->  name=['normal']
GENERATION  TIME: 0.0007  ---->  roleName=['Kombin\xc3\xa1lt listamez\xc5\x91']

Traceback (most recent call last):
  • File "/usr/local/lib/python2.7/dist-packages/orca/generator.py", line 240 in generate
    result = eval(format, globalsDict)
  • File "<string>", line 1 in <module>
  • File "/usr/local/lib/python2.7/dist-packages/orca/braille_generator.py", line 360 in asString
    combined, prior, delimiter)
  • File "/usr/local/lib/python2.7/dist-packages/orca/script_utilities.py", line 2615 in appendString
    return text + delimiter + newText
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 6: ordinal not in range(128)

Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/orca/event_manager.py", line 238, in _dequeue
    self._processObjectEvent(event)
  File "/usr/local/lib/python2.7/dist-packages/orca/event_manager.py", line 499, in _processObjectEvent
    script.processObjectEvent(event)
  File "/usr/local/lib/python2.7/dist-packages/orca/script.py", line 397, in processObjectEvent
    self.listeners[key](event)
  File "/usr/local/lib/python2.7/dist-packages/orca/scripts/toolkits/Gecko/script.py", line 1790, in onStateFocused
    default.Script.onStateChanged(self, event)
  File "/usr/local/lib/python2.7/dist-packages/orca/scripts/default.py", line 3294, in onStateChanged
    self.onFocus(event)
  File "/usr/local/lib/python2.7/dist-packages/orca/scripts/toolkits/Gecko/script.py", line 1591, in onFocus
    default.Script.onFocus(self, event)
  File "/usr/local/lib/python2.7/dist-packages/orca/scripts/default.py", line 3092, in onFocus
    orca.setLocusOfFocus(event, newFocus)
  File "/usr/local/lib/python2.7/dist-packages/orca/orca.py", line 674, in setLocusOfFocus
    event, oldLocusOfFocus, orca_state.locusOfFocus)
  File "/usr/local/lib/python2.7/dist-packages/orca/scripts/toolkits/Gecko/script.py", line 1985, in locusOfFocusChanged
    newLocusOfFocus)
  File "/usr/local/lib/python2.7/dist-packages/orca/scripts/default.py", line 1290, in locusOfFocusChanged
    self.updateBraille(newLocusOfFocus)
  File "/usr/local/lib/python2.7/dist-packages/orca/scripts/toolkits/Gecko/script.py", line 2225, in updateBraille
    and regions[0].string and line.regions[-1].string \
IndexError: list index out of range

Attila
Comment 13 Hammer Attila 2011-09-15 14:46:16 UTC
Oh my good, I owerwrited the second Gedit related debug.out file.
Just a moment, I will be regenerate again.

I need examining an another interesting situation, but this is possible not unicode related problem:
For example, in gnome-terminal, gedit applications if I press F10 key, Orca doesn't spokening and presenting braille the main menu bar first selected main menu related important informations (for example file menu).
You possible reproduce this?
Launch for example with gnome-terminal or gedit application, and simple press F10 key. Your system what happening?

Attila
Comment 14 Hammer Attila 2011-09-15 15:15:11 UTC
Created attachment 196642 [details]
Two interesting traceback error message for gedit

Ok, I regenerated the gedit application related debug.out file.
I see two interesting traceback error message:
1. error message, this is possible an another bug:
    app.name='gnome-panel' (exception getting relation set)(exception fetching data)
_toolkitForObject: [DEAD] no longer exists
getModuleName: [DEAD] no longer exists

Traceback (most recent call last):
  • File "/usr/local/lib/python2.7/dist-packages/orca/event_manager.py", line 238 in _dequeue
    self._processObjectEvent(event)
  • File "/usr/local/lib/python2.7/dist-packages/orca/event_manager.py", line 493 in _processObjectEvent
    script = self._getScriptForEvent(event)
  • File "/usr/local/lib/python2.7/dist-packages/orca/event_manager.py", line 387 in _getScriptForEvent
    script = _scriptManager.getScript(app, event.source)
  • File "/usr/local/lib/python2.7/dist-packages/orca/script_manager.py", line 235 in getScript
    appScript = self._createScript(app, None)
  • File "/usr/local/lib/python2.7/dist-packages/orca/script_manager.py", line 191 in _createScript
    script = self.getDefaultScript(app)
  • File "/usr/local/lib/python2.7/dist-packages/orca/script_manager.py", line 201 in getDefaultScript
    script = default.Script(app)
  • File "/usr/local/lib/python2.7/dist-packages/orca/scripts/default.py", line 92 in __init__
    script.Script.__init__(self, app)
  • File "/usr/local/lib/python2.7/dist-packages/orca/script.py", line 73 in __init__
    self.name = self.app.name
  • File "/usr/lib/python2.7/dist-packages/pyatspi/Accessibility.py", line 177 in <lambda>
    Atspi.Accessible.name = property(fget=lambda x: exwrap(Atspi.Accessible.get_name, x))
  • File "/usr/lib/python2.7/dist-packages/pyatspi/Accessibility.py", line 154 in exwrap
    raise LookupError LookupError
Interesting, if I known right Oneiric using at-spi2, not at-spi.

2. error message, this is the unicode encode traceback error:
generate braille results:
TypeError when trying to write text
GENERATION  TIME: 0.0117  ---->  ancestors=[<orca.braille.Component instance at 0x91cebac>, <orca.braille.Region instance at 0x8ff538c>, <orca.braille.Component instance at 0x91cef6c>]
GENERATION  TIME: 0.0005  ---->  rowHeader=[]
GENERATION  TIME: 0.0004  ---->  columnHeader=[]
GENERATION  TIME: 0.0004  ---->  radioButtonGroup=[]
GENERATION  TIME: 0.0014  ---->  label=['N\xc3\xa9v:']
GENERATION  TIME: 0.0008  ---->  placeholderText=[]
GENERATION  TIME: 0.0004  ---->  eol=[u' ']

Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/orca/braille.py", line 355, in __init__
    string = string.decode("UTF-8")
  File "/usr/lib/python2.7/encodings/utf_8.py", line 16, in decode
    return codecs.utf_8_decode(input, errors, True)
UnicodeEncodeError: 'ascii' codec can't encode character u'\xe9' in position 1: ordinal not in range(128)

Attila
Comment 15 Joanmarie Diggs (IRC: joanie) 2011-09-15 16:19:19 UTC
(In reply to comment #14)
> Created an attachment (id=196642) [details]
> Two interesting traceback error message for gedit

Hey Attila. The good news is that those are being printed out on purpose. In other words, they fall into the category of errors which are both known and being handled. And the reason I have those printed out is two-fold:

1. Shed additional light on what is occurring (especially the 'no longer exists' items)

2. Remind me that things are going wrong. <grins> And that's true of the braille one.

Regarding how to distinguish item 2 from an unexpected on which I need to fix.... if it's short and from braille.py line 355 then it's on purpose:

        try:
            string = string.decode("UTF-8")
        except UnicodeEncodeError:
            debug.printException(debug.LEVEL_FINEST)

By choosing debug.LEVEL_FINEST, I am preventing most people from seeing that error. But it's present for people capturing full debug.outs like you have been.

Compare that one to the one in Comment 12. The one in Comment 12 is not expected and is likely causing bad things to occur because we're not handling that error.

Make sense?

Anyhoo, I was in a team meeting until recently, but now I'll look at those unexpected errors.
Comment 16 Joanmarie Diggs (IRC: joanie) 2011-09-15 16:26:23 UTC
(In reply to comment #13)
> For example, in gnome-terminal, gedit applications if I press F10 key, Orca
> doesn't spokening and presenting braille the main menu bar first selected main
> menu related important informations (for example file menu).
> You possible reproduce this?

Yeah. I filed that Gtk+ bug here:
https://bugzilla.gnome.org/show_bug.cgi?id=654410
Comment 17 Joanmarie Diggs (IRC: joanie) 2011-09-15 17:08:25 UTC
I was able to reproduce the firefox-related traceback and just committed a fix which solves the problem for me. Please pull master yet again and keep testing. And thanks!!

http://git.gnome.org/browse/orca/commit/?id=f871b84413d32ec5d083086006ec40f723f3c880
Comment 18 Hammer Attila 2011-09-16 11:42:40 UTC
Joanie, if I see right now maked debug.out file for example when tested Gedit related problem with latest master Orca version, I see only unicode encode error traceback error message with \x00e9 unicode character.
I don't no why not spokening Orca the deleted character with file save dialog edit box, perhaps this is a GTK bug too?
I reproduced this type issue for example with Alt+F2 presenting run application dialog.
Try you following short test with locale independent to verify this is not localization specific issue and Orca specific issue:
1. Press Alt+F2 keystroke to present run application dialog.
2. Write for example the apple text.
3. If you do where am I operation, Orca wonderful spokening the typed text again, independent you deleted any character or not.
4. If you press Backspace key, you will be not hear the deleted character. With braille display the text change is happening correct. If you press one backspace key, you will be see braille display with appl text, after this the app text, etc, but Orca speech module doesn't spokening you what character to deleted.
Comment 19 Hammer Attila 2011-09-16 11:53:42 UTC
Created attachment 196706 [details]
Unicode decode error traceback error messages if I using Firefox7 the Bugzilla File a bug form elements

Latest master Orca producing too unicode decode error tracebacks if I using Firefox7 the Bugzilla file a bug form elements.

Attila
Comment 20 Hammer Attila 2011-09-16 12:29:00 UTC
The run application related Backspace keypress producing problem I reported with bug 659235 separated report, because the debug.out file I not see unicode encode or decode error related traceback messages.

Hopefuly this problem is not Gtk3 specific.

Attila
Comment 21 Joanmarie Diggs (IRC: joanie) 2011-09-19 01:32:11 UTC
(In reply to comment #19)
> Created an attachment (id=196706) [details]
> Unicode decode error traceback error messages if I using Firefox7 the Bugzilla
> File a bug form elements
> 
> Latest master Orca producing too unicode decode error tracebacks if I using
> Firefox7 the Bugzilla file a bug form elements.

Confirmed and fixed:
http://git.gnome.org/browse/orca/commit/?id=94bcd8fce302b2325e24edcac03668a0547f6424

Bring on the next one! <smiles> By the way, in terms of making it easier for you to figure out "is this a known exception or an unhandled bug?" I've also just removed a couple of deliberate print exceptions. At this point, this unicode situation is permanently in my brain, so I do not believe I will need those debug.out reminders to myself after all. <grins>
Comment 22 Joanmarie Diggs (IRC: joanie) 2011-09-19 01:34:55 UTC
Attila as for the others, it appears that you have filed new bugs for them because they were not unicode encode or decode issues. Thanks for doing that! I shall look at them in the bugs you filed. What I would like to do with this bug here is: 

1. Are there any items in your reports above that I just totally missed?
2. Are there any new unicode-related bugs?

If the answer to both of the above is "No," let's close this sucker. Thanks again very, very much!
Comment 23 Hammer Attila 2011-09-19 10:03:33 UTC
Created attachment 196914 [details]
Debug file with an unicode decode error for \x00c3 character

Joanie, bugzilla forms works very well, thank you the fix.
Unfortunately, when I try do a Firefox search for CTRL+F key combination in bugzilla.gnome.org, I found following traceback error message the debug.out file:
Traceback (most recent call last):
  • File "/usr/lib/python2.7/dist-packages/orca/event_manager.py", line 238 in _dequeue
    self._processObjectEvent(event)
  • File "/usr/lib/python2.7/dist-packages/orca/event_manager.py", line 499 in _processObjectEvent
    script.processObjectEvent(event)
  • File "/usr/lib/python2.7/dist-packages/orca/script.py", line 397 in processObjectEvent
    self.listeners[key](event)
  • File "/usr/lib/python2.7/dist-packages/orca/scripts/toolkits/Gecko/script.py", line 1303 in onCaretMoved
    self.presentFindResults(event.source, event.detail1)
  • File "/usr/lib/python2.7/dist-packages/orca/scripts/toolkits/Gecko/script.py", line 1180 in presentFindResults
    self.speakContents(line)
  • File "/usr/lib/python2.7/dist-packages/orca/scripts/toolkits/Gecko/script.py", line 5343 in speakContents
    clumped = self.clumpUtterances(utterances)
  • File "/usr/lib/python2.7/dist-packages/orca/scripts/toolkits/Gecko/script.py", line 5324 in clumpUtterances
    clumped[-1][0] += " " + element
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 9: ordinal not in range(128)

The more interesting think for this problem related:
Default, not existing in .local/share/orca/app-settings directory the mozilla.py Orca application-specific file. This is right, because Orca have some preconfigured default settings for Firefox.
Now, with hungarian locale Orca doesn't spokening search results if I typing characters, or press ESCAPE key. if have search term matches
If I activated the Orca application-speciific preferences dialog, not change any settings and click Ok button, the Firefox search works very well. Orca again spokening the search results both typing and ESCAPE key press, and the regenerated debug.out file not presenting the pasted traceback error message.

Next comment I will be attaching what application-specific file creating Orca when I simple click Ok button the application-specific preferences dialog after Firefox launched.

Attila
Comment 24 Hammer Attila 2011-09-19 10:10:24 UTC
Created attachment 196915 [details]
This file created Orca application-specific preferences dialog when Firefox are launched and focused
Comment 25 Victor Ramirez (virako) 2011-09-19 11:07:42 UTC
I have the same problem as Attila, with the same trace. I only have the problem when I have written some text with acented character or special spanish character (á, é, ú, ñ) in the text entry. The problem not appear if I only write one character. 

UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 2: ordinal not in range(128)
Comment 26 Joanmarie Diggs (IRC: joanie) 2011-09-19 14:40:14 UTC
I am sure you do Victor. I am working on these along with some other issues. No worries, I can reproduce them.
Comment 27 Hammer Attila 2011-09-30 10:17:03 UTC
Created attachment 197864 [details]
Found an another Unicode encode error traceback error message with Orca time presenting function

Hy Joanie,

I found an another unicode encode error traceback error message. If I setted up hungarian time format (hour, minute and second format), the time is not spokened and presented my braille display.
The error message is following:
KEYEVENT: type=0
          id=65509
          hw_code=66
          modifiers=8192
          event_string=(Caps_Lock)
          is_text=True
          timestamp=383354
          time=1317373581.806310
KEYBOARDEVENT: type=0
                id=65509
                hw_code=66
                modifiers=8192
                event_string=(Caps_Lock)
                keyval_name=(Caps_Lock)
                is_text=True
                timestamp=383354
                time=1317373581.806748
orca.isPrintableKey: returning: False
orca.keyEcho: string to echo: Caps_Lock
orca.isModifierKey: returning: True
orca.isModifierKey: returning: True
orca.isModifierKey: returning: True
KEYEVENT: type=0
          id=84
          hw_code=28
          modifiers=8194
          event_string=(T)
          is_text=True
          timestamp=384011
          time=1317373582.455808
KEYBOARDEVENT: type=0
                id=84
                hw_code=28
                modifiers=8194
                event_string=(T)
                keyval_name=(T)
                is_text=True
                timestamp=384011
                time=1317373582.456305
orca.isPrintableKey: returning: True
orca.isModifierKey: returning: False
----------> QUEUEING <ENUM ATSPI_KEY_PRESSED_EVENT OF TYPE EVENTTYPE> 'T' (28)
DEQUEUED <ENUM ATSPI_KEY_PRESSED_EVENT OF TYPE EVENTTYPE> 'T' (28) <----------

vvvvv PROCESS <ENUM ATSPI_KEY_PRESSED_EVENT OF TYPE EVENTTYPE> 'T' (28) vvvvv

Traceback (most recent call last):
  • File "/usr/lib/python2.7/dist-packages/orca/input_event.py", line 206 in processInputEvent
    consumed = self.function(script, inputEvent)
  • File "/usr/lib/python2.7/dist-packages/orca/scripts/default.py", line 5790 in presentTime
    message = time.strftime(timeFormat, time.localtime())
UnicodeEncodeError: 'ascii' codec can't encode character u'\xf3' in position 4: ordinal not in range(128)

So, Orca doesn't possible encode ó (\x0xF3) unicode character when for example want spokening following format the time:
13 óra 44 perc, 35 másodperc.

Attila
Comment 28 Joanmarie Diggs (IRC: joanie) 2011-09-30 19:55:53 UTC
Fixed the date/time traceback in both master and the gnome-3-2 branch. Thanks Attila!
Comment 29 Joanmarie Diggs (IRC: joanie) 2011-09-30 19:57:11 UTC
Since we're just catching the ones we missed before, this is no longer critical. Lowering to NORMAL.
Comment 30 Hammer Attila 2011-10-01 03:38:26 UTC
Joanie, thank you the date and time related fix, works great this two function again with hungarian locale.

Attila
Comment 31 Joanmarie Diggs (IRC: joanie) 2011-10-12 23:14:29 UTC
And.... We have another.... At least we're getting most of these....


Traceback (most recent call last):
  • File "/usr/lib/python2.7/site-packages/orca/input_event.py", line 206 in processInputEvent
    consumed = self.function(script, inputEvent)
  • File "/usr/lib/python2.7/site-packages/orca/scripts/toolkits/Gecko/script.py", line 5915 in goNextLine
    self.presentLine(nextObj, nextCharOffset)
  • File "/usr/lib/python2.7/site-packages/orca/scripts/toolkits/Gecko/script.py", line 2080 in presentLine
    self.speakContents(self.currentLineContents)
  • File "/usr/lib/python2.7/site-packages/orca/scripts/toolkits/Gecko/script.py", line 5355 in speakContents
    speech.speak(element, acss, False)
  • File "/usr/lib/python2.7/site-packages/orca/speech.py", line 221 in speak
    _speak(content, acss, interrupt)
  • File "/usr/lib/python2.7/site-packages/orca/speech.py", line 196 in _speak
    _speechserver.speak(text, __resolveACSS(voice), interrupt)
  • File "/usr/lib/python2.7/site-packages/orca/speechdispatcherfactory.py", line 428 in speak
    self._speak(text, acss)
  • File "/usr/lib/python2.7/site-packages/orca/speechdispatcherfactory.py", line 329 in _speak
    text = self.__addVerbalizedPunctuation(text)
  • File "/usr/lib/python2.7/site-packages/orca/speechdispatcherfactory.py", line 314 in __addVerbalizedPunctuation
    newText = re.sub(symbol, charName, newText)
  • File "/usr/lib/python2.7/re.py", line 151 in sub
    return _compile(pattern, flags).sub(repl, string, count)
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 5: ordinal not in range(128)

Comment 32 Joanmarie Diggs (IRC: joanie) 2011-10-12 23:21:30 UTC
*** Bug 661382 has been marked as a duplicate of this bug. ***
Comment 34 Hammer Attila 2011-11-01 06:32:54 UTC
Created attachment 200381 [details]
This debug.out file shows an another Unicode decode related traceback error message

Joanie, my orca-customizations.py file shows an another unicode decode error traceback message in a hungarian weather report function:
SPEECH OUTPUT: 'Kis türelmet, időjárás információk letöltése folyamatban.'

Traceback (most recent call last):
  • File "/usr/local/lib/python2.7/dist-packages/orca/input_event.py", line 206 in processInputEvent
    consumed = self.function(script, inputEvent)
  • File "/home/hammera/.local/share/orca/orca-customizations.py", line 392 in otnaposelorejelzesrovid
    otnaposelorejelzeslekerese(kellosszefoglalo)
  • File "/home/hammera/.local/share/orca/orca-customizations.py", line 184 in otnaposelorejelzeslekerese
    datum[0]=datum[0].replace("Készült: ", "")
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 1: ordinal not in range(128)
This line a simple string replacement operation.

Need handling this type problem too in Orca, or I need handling this problem my orca-customizations.py file?
If I need handling this problem, how can I handle this problem my script?

Attila
Comment 35 Joanmarie Diggs (IRC: joanie) 2011-11-01 07:33:55 UTC
It will likely need to be handled in your orca-customizations.py file. But please attach it and I'll take a look.
Comment 36 Hammer Attila 2011-11-01 09:39:01 UTC
Created attachment 200389 [details]
This is my orca-customizations.py file

Joanie, I attached my orca-customizations.py file.
This script using hungarian visual impaired users my BeLin named Ubuntu based accessible derivative hungarian distribution.
This script functions works great under GNOME2, but in GNOME3 need some customizations I doing future, for example the clipboard related function.
With this unicode decode error related traceback message happens the 184th line.
Sorry the hungarian variable names and method names with you will be seeing when you reviewing my code.

Attila
Comment 37 Hammer Attila 2011-11-01 09:42:55 UTC
I attached prewious the GNOME3 modified script, for example in GNOME3 need I think different way importing the GTK related libraries.
In GNOME2 environvent enough the import gtk code line, but in GNOME3 environment this code producing segmentation fault.
I replace this line with from gi.repository import Gtk as gtk line, but the clipboard presenting function not working yet.
Have a good tutorial webpage in Python level what differences need handling when porting Orca level codes from gtk2 to gtk3?

Attila
Comment 38 Hammer Attila 2011-12-06 05:29:50 UTC
Created attachment 202897 [details]
Debug file with show a unicode decode error related traceback message with Thunderbird usage

Hy Joanie,

I installed yesterday an Ubuntu 12.04 development version system to I access latest testing environment.
When I try using Thundervird (9.0b3) with hungarian locale, some menues are silent, and not presenting braille.
When I looked the debug.out file, I see following traceback message lot of time the debug.out file:
generate braille results:
  Component: '$be1rke2ett {2enetek - $hei mapp"k - $mo2illa $thunderbird $keret', 1

PREPARATION TIME: 0.0009
generate braille for focused app.name='Thunderbird' name='Thunderbird' role='application' state='showing visible' relations='' (args={'formatType': 'focused', 'useDefaultFormatting': False, 'includeContext': False, 'role': <enum ATSPI_ROLE_APPLICATION of type Role>, 'mode': 'braille', 'recursing': True}) using '[Component(obj,                                     asString(label + displayedText + value + roleName + required))]'
GENERATION  TIME: 0.0009  ---->  label=[]
GENERATION  TIME: 0.0004  ---->  displayedText=['Thunderbird']
GENERATION  TIME: 0.0006  ---->  value=['']
GENERATION  TIME: 0.0003  ---->  roleName=['Alkalmaz\xc3\xa1s']
GENERATION  TIME: 0.0002  ---->  required=[]
COMPLETION  TIME: 0.0040
generate braille results:
  Component: '$thunderbird $alkalma2"s', 1
GENERATION  TIME: 0.0293  ---->  ancestors=[<orca.braille.Component instance at 0x951ebac>, <orca.braille.Region instance at 0x951e58c>, <orca.braille.Component instance at 0x951e62c>, <orca.braille.Region instance at 0x951e94c>, <orca.braille.Component instance at 0x951e0cc>, <orca.braille.Region instance at 0x951ec2c>, <orca.braille.Component instance at 0x951ec4c>, <orca.braille.Region instance at 0x951e82c>, <orca.braille.Component instance at 0x951e78c>]
GENERATION  TIME: 0.0004  ---->  rowHeader=[]
GENERATION  TIME: 0.0004  ---->  columnHeader=[]
GENERATION  TIME: 0.0003  ---->  radioButtonGroup=[]
GENERATION  TIME: 0.0010  ---->  label=[]
GENERATION  TIME: 0.0006  ---->  displayedText=['\xc3\x9czenetablak']
GENERATION  TIME: 0.0005  ---->  roleName=['Jel\xc3\xb6l\xc5\x91elem']
GENERATION  TIME: 0.0010  ---->  availability=[]

Traceback (most recent call last):
  • File "/usr/lib/python2.7/dist-packages/orca/generator.py", line 254 in generate
    globalsDict[arg] = self._methodsDict[arg](obj, **args)
  • File "/usr/lib/python2.7/dist-packages/orca/braille_generator.py", line 146 in _generateAccelerator
    self._script.utilities.mnemonicShortcutAccelerator(obj)
  • File "/usr/lib/python2.7/dist-packages/orca/script_utilities.py", line 2843 in mnemonicShortcutAccelerator
    fullShortcut = keynames.localizeKeySequence(fullShortcut)
  • File "/usr/lib/python2.7/dist-packages/orca/keynames.py", line 331 in localizeKeySequence
    keys = keys.replace(key, getKeyName(key))
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 0: ordinal not in range(128)

Attila
Comment 39 Hammer Attila 2011-12-06 05:32:13 UTC
Forgot I wrote:
This traceback error message I experienced with default packaged Orca 3.3.2 version and yesterday master version.
Possible need fixing this error both master and stable branch.
Comment 40 Hammer Attila 2011-12-07 06:19:13 UTC
Created attachment 202963 [details]
An another debug.out file with show an another unicode decode error

Joanie, I found an another unicode decode error.
I simple try assign a laptop key binding with show notifications list command. After I reload Orca preferences and restart Orca, I tryed verify new associoted key binding.
Because the new key binding is not working, I try reopening Orca preferences dialog.
In debug.out file I see following traceback error message:
Traceback (most recent call last):
  • File "/usr/lib/python2.7/dist-packages/orca/orca.py", line 1626 in showPreferencesGUI
    module.showPreferencesUI()
  • File "/usr/lib/python2.7/dist-packages/orca/orca_gui_prefs.py", line 3537 in showPreferencesUI
    orca_state.orcaOS.init()
  • File "/usr/lib/python2.7/dist-packages/orca/orca_gui_prefs.py", line 436 in init
    self._populateKeyBindings()
  • File "/usr/lib/python2.7/dist-packages/orca/orca_gui_prefs.py", line 2209 in _populateKeyBindings
    self._insertRow(handl, kb, iterOrca)
  • File "/usr/lib/python2.7/dist-packages/orca/orca_gui_prefs.py", line 2092 in _insertRow
    + clickCount
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc5 in position 12: ordinal not in range(128)

Very interesting, I try simple associate with show notification list command the Capslock+Shift+semicolon key binding.

Attila
Comment 41 Hammer Attila 2011-12-07 06:21:26 UTC
Created attachment 202964 [details]
This is my Orca user-settings.conf file

This configuration file created Orca master version after I tryed associate with Capslock+Shift+semicolon keybinding the show notification message list command.

Attila
Comment 42 Hammer Attila 2011-12-08 05:25:25 UTC
I looked associate Notification message list keybinding assigning with Capslock+Shift+Semicolon my Lucid system.
Right settings is following:
            "keybindings": {
                "enableNotificationMessageListModeHandler": [
                    [
                        "semicolon", 
                        "365", 
                        "257", 
                        "1"
                    ], 

My Precise system Orca stores following wrong settings when I using laptop layout:
            "keybindings": {
                "enableNotificationMessageListModeHandler": [
                    [
                        "grave", 
                        "365", 
                        "8450", 
                        "1"
                    ], 

Joanie, possible happening this wrong setting storing because committed Bill's capslock related fix?
Comment 43 Hammer Attila 2011-12-08 06:07:44 UTC
Joaine, I tryed reverting Bill's capslock related fix to I verify this issue happening or not.
Not Bill's committed capslock related fix producing this issue.

Attila
Comment 44 Joanmarie Diggs (IRC: joanie) 2011-12-08 16:20:48 UTC
(In reply to comment #43)
> Joaine, I tryed reverting Bill's capslock related fix to I verify this issue
> happening or not.
> Not Bill's committed capslock related fix producing this issue.

Well, yes and no....

Bill's fix did not cause the traceback you saw. But when I fixed that, I discovered that Bill's fix did cause problems which still would have caused your keybinding not to work. Therefore, I fixed that issue in bug 665804. The unicode error itself was also fixed in the gnome-3-2 branch.
Comment 45 Joanmarie Diggs (IRC: joanie) 2011-12-08 17:23:39 UTC
The Hungarian Thunderbird issue confirmed and fixed.

Master: http://git.gnome.org/browse/orca/commit/?id=bfbcf2faac9ecee2621f70cca39f8efc1c38e5bd

gnome-3-2 branch: http://git.gnome.org/browse/orca/commit/?h=gnome-3-2&id=26d11063a5eea3a1b6b4589d25e11e595ce1885f
Comment 46 Joanmarie Diggs (IRC: joanie) 2012-02-20 19:54:53 UTC
I think I've gotten all of these. If there are no instances, new bugs can be opened.