GNOME Bugzilla – Bug 521651
oocalc regression tests need work
Last modified: 2008-06-03 19:39:04 UTC
As part of working on another bug, I ran the oocalc regression tests and found quite a few unexpected failures. Attachments coming soon. :-)
Created attachment 107006 [details] output with current Orca Note that there are two things in my output that aren't "normal": Xlib: extension "RANDR" missing on display ":0.0". javaldx: Could not find a Java Runtime Environment! The former is what happens when you mess with proprietary nvidia drivers but doesn't seem to impact anything. I hadn't noticed the latter until just now. I forgot to reinstall the java7 jre (which the latest OOo seems to want). Doing that now and will re-run. But I suspect that doesn't have anything to do with the tests....
Created attachment 107007 [details] output with my patch to bug 518914 One reason for the failure is that Calc apparently changed on us again. Before the frame's name ended in "Calc". Now the frame name is None but the root pane's name ends in "Calc." This change was causing isSpreadSheetCell() to fail. When I addressed that in the patch to bug 518914, two things happened as a side effect: * Bogus '0's which were appearing before "cell" in the braille context went away. * Bogus ' not selected's went away from the speech context. Many of the remaining failures seem to be the expectation of a named frame and its inclusion in the braille context, e.g.: EXPECTED: "BRAILLE LINE: 'soffice Application fruit - OpenOffice.org Calc Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Good in Pies Cell A2 '" ACTUAL: "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Good in Pies Cell A2 '" But I haven't dug any further. Rich said he'd take this one, so assigning to him. Thanks Rich!!
Created attachment 107019 [details] latest run of the tests (In reply to comment #1) > I forgot to reinstall the java7 jre (which the latest OOo seems to want). > Doing that now and will re-run. But I suspect that doesn't have anything to do > with the tests.... And thus my dual career goals of being a psychic and a bookie were dashed. I wasn't all that systematic about things: I updated Hardy (which included some OOo updates) and installed the jre and then re-ran the tests. Thanks to one or both of those things, the aforementioned bogusity seems to be gone. Two types of errors still present throughout: 1. Braille context (see comment #2) 2. An empty string missing from the speech context, a la: EXPECTED: "SPEECH OUTPUT: ''", "SPEECH OUTPUT: 'Good in Pies A2'", ACTUAL: "SPEECH OUTPUT: 'Good in Pies A2'", There are other things here and there, but I'll leave that to Rich. :-) Question remains, though, what should the contexts contain? Solaris currently ships with StarOffice 8 which means that: 1. The frame name is present in Solaris' braille context but absent in Ubuntu (at least in Hardy). 2. The root pane name (present in both) doesn't match because Solaris has StarOffice Calc and Ubuntu has OpenOffice.org Calc. Should one of the testing "rules" for uniformity (along the lines of thou shan't use compiz) be that we use the latest OpenOffice (or StarOffice)?
(In reply to comment #3) > Should one of the testing "rules" for uniformity (along the lines of thou > shan't use compiz) be that we use the latest OpenOffice (or StarOffice)? Yes, and we probably should use just the latest OpenOffice. It's easier to obtain and using just OpenOffice will help eliminate a potential set of variables.
Created attachment 107648 [details] Results of running the oocalc regression tests. Here's the summaries of running the oocalc regression tests against OOo 2.4 dev (Release Candidate 6): SUMMARY: 0 SUCCEEDED and 4 FAILED (4 UNEXPECTED) of 4 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_356334.py SUMMARY: 2 SUCCEEDED and 8 FAILED (8 UNEXPECTED) of 10 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_361167.py SUMMARY: 4 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 4 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_363801.py SUMMARY: 0 SUCCEEDED and 6 FAILED (6 UNEXPECTED) of 6 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_363802.py SUMMARY: 0 SUCCEEDED and 6 FAILED (6 UNEXPECTED) of 6 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_363804.py SUMMARY: 0 SUCCEEDED and 2 FAILED (2 UNEXPECTED) of 2 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_364086.py SUMMARY: 1 SUCCEEDED and 2 FAILED (2 UNEXPECTED) of 3 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_364407.py SUMMARY: 0 SUCCEEDED and 4 FAILED (4 UNEXPECTED) of 4 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_433398.py SUMMARY: 0 SUCCEEDED and 2 FAILED (2 UNEXPECTED) of 2 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_435307.py SUMMARY: 0 SUCCEEDED and 4 FAILED (4 UNEXPECTED) of 4 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_435852.py To divide this into manageable chunks, I'll file separate bugs for each of these failures (one bug per .py file). I also note that OOo spews out a load of WARNING messages: $ grep WARNING oocalc-tests.txt | uniq -c 1 ** (soffice:27162): WARNING **: Invalidate all children called 1 ** (soffice:27289): WARNING **: Invalidate all children called 1 ** (soffice:27416): WARNING **: Invalidate all children called 1 ** (soffice:27551): WARNING **: Invalidate all children called 1 ** (soffice:27685): WARNING **: Invalidate all children called 2 ** (soffice:27685): WARNING **: Unmapped KeyCode: 774 1 ** (soffice:27986): WARNING **: Focused object has invalid index in parent 1 ** (soffice:28115): WARNING **: Invalidate all children called 1 ** (soffice:28242): WARNING **: Invalidate all children called I realize they are warnings, but they also worry me.
A lot of the oocalc regression test failures are occuring now because Orca is speaking "no selected" for the spread sheet table cells. Mike, should Orca be speaking "not selected" for oocalc spread sheet table cells?
Rich, as I alluded to in comment #3, the "not selected" in cells went away either from a hardy upgrade or (my bet) the installation of a jre.
Missed that. Thanks. Okay, so the gold standard for running the Orca oocalc regression tests includes the installing of a JRE, yes?
For some reason I'm not hearing not selected in cells. If you are getting this it is definitely not correct.
I do currently have a JRE installed but I don't know why it should have an impact.
> Missed that. Thanks. My bad. It was buried amongst the rest of my ramblings. :-) > Okay, so the gold standard for running the > Orca oocalc regression tests includes the installing of a JRE, yes? Yeah, I think it should. One is by default. I think that ours got taken out by either a hardy update or a side effect of installing OOo 2.4 dev.
I'll second Mike's comment: why should having a JRE make a difference? Secondly, if it's not installed by default, why should we have to force Orca user's to install a JRE in order to get the right response? Is OOo accessibility still dependent upon Java? If you don't know that answers, then I'll investigate further. I'd really not have to require our users to have to install a honking great JRE in order to successfully run oocalc.
I thought it was installed by default. And the repeated errors I was getting: > javaldx: Could not find a Java Runtime Environment! Made me think it was necessary. Maybe it ain't. Regardless.... If you look at my comment #2: > One reason for the failure is that Calc apparently changed on us again. Before > the frame's name ended in "Calc". Now the frame name is None but the root > pane's name ends in "Calc." This change was causing isSpreadSheetCell() to > fail. When I addressed that in the patch to bug 518914, two things happened as > a side effect: > > * Bogus '0's which were appearing before "cell" in the braille context > went away. > > * Bogus ' not selected's went away from the speech context. ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Having the JRE installed also made them go away. <shrugs> I haven't done anything with bug 518914 because it's still waiting for testing (thanks for looking it over in the meantime Rich!). Perhaps if that change to isSpreadSheetCell() makes the not selecteds go away for you, the JRE isn't necessary. And, if so, perhaps that change should be checked in and I can revise the patch to bug 518914.
> I haven't done anything with bug 518914 because it's still waiting for testing > (thanks for looking it over in the meantime Rich!). Perhaps if that change to > isSpreadSheetCell() makes the not selecteds go away for you, the JRE isn't > necessary. And, if so, perhaps that change should be checked in and I can > revise the patch to bug 518914. Yes, this sounds more plausible. I'll try some of those "not selected" failures with your patch tomorrow and see if the problems go away. Thanks.
Just glanced at your output. Looks like you have bogus 0's too. "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Yes 0 Cell'", " VISIBLE: 'Yes 0 Cell', cursor=1",
Sorry to be spammy.... Just remembered something.... > force Orca user's to install a JRE in order to get the right response? > Is OOo accessibility still dependent upon Java? I don't believe it is, however, I thought the JRE was necessary at least for wizards in OOo (independent of accessibility). In which case, our users will probably want to install it.
I went and did a runall.sh on .../orca/trunk/test/keystrokes/oocalc and got the following results: SUMMARY: 2 SUCCEEDED and 2 FAILED (2 UNEXPECTED) of 4 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_356334.py Correct. See bug #523459 (blocked). SUMMARY: 10 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 10 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_361167.py Correct. See bug #523460 (pending). SUMMARY: 4 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 4 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_363801.py Correct. SUMMARY: 6 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 6 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_363802.py Correct. See bug #523461 (pending). SUMMARY: 3 SUCCEEDED and 3 FAILED (3 UNEXPECTED) of 6 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_363804.py Unexpected (see below). When I ran a runone.sh on this test, I got 6 out 6 SUCCEEDED. To be investigated further. SUMMARY: 0 SUCCEEDED and 2 FAILED (2 UNEXPECTED) of 2 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_364086.py Unexpected (see below). To be investigated further. SUMMARY: 1 SUCCEEDED and 2 FAILED (2 UNEXPECTED) of 3 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_364407.py Unexpected (see below). When I ran a runone.sh on this test, I got 3 out 3 SUCCEEDED. To be investigated further. SUMMARY: 2 SUCCEEDED and 2 FAILED (2 UNEXPECTED) of 4 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_433398.py Unexpected (see below). When I ran a runone.sh on this test, I got 4 out 4 SUCCEEDED. To be investigated further. SUMMARY: 0 SUCCEEDED and 2 FAILED (2 UNEXPECTED) of 2 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_435307.py Unexpected (see below). When I ran a runone.sh on this test, I got 2 out 2 SUCCEEDED. To be investigated further. SUMMARY: 0 SUCCEEDED and 4 FAILED (4 UNEXPECTED) of 4 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_435852.py Unexpected (see below). To be investigated further. ================ Test 4 of 6 FAILED: /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_363804.py:Down to A2 - don't speak cell coordinates EXPECTED: "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Good in Pies Cell A2 '", " VISIBLE: 'Good in Pies Cell A2 ', cursor=1", "SPEECH OUTPUT: 'Good in Pies'", ACTUAL: "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Good in Pies Cell A2 '", " VISIBLE: 'Good in Pies Cell A2 ', cursor=1", "SPEECH OUTPUT: 'Good in Pies A2'", [FAILURE WAS UNEXPECTED] Test 5 of 6 FAILED: /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_363804.py:Right to B2 - don't speak cell coordinates EXPECTED: "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Yes Cell B2 '", " VISIBLE: 'Yes Cell B2 ', cursor=1", "SPEECH OUTPUT: 'Yes'", ACTUAL: "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Yes Cell B2 '", " VISIBLE: 'Yes Cell B2 ', cursor=1", "SPEECH OUTPUT: 'Yes B2'", [FAILURE WAS UNEXPECTED] Test 6 of 6 FAILED: /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_363804.py:Control+Home to A1 - don't speak cell coordinates EXPECTED: "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell A1 '", " VISIBLE: 'Cell A1 ', cursor=1", "SPEECH OUTPUT: 'blank'", ACTUAL: "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell A1 '", " VISIBLE: 'Cell A1 ', cursor=1", "SPEECH OUTPUT: ' A1'", [FAILURE WAS UNEXPECTED] ---- Test 1 of 2 FAILED: /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_364086.py:File->New->Spreadsheet EXPECTED: "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame'", " VISIBLE: 'Untitled2 - OpenOffice.org Calc ', cursor=1", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane Panel'", " VISIBLE: 'Panel', cursor=1", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table'", " VISIBLE: 'Sheet Sheet1 Table', cursor=1", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell A1 '", " VISIBLE: 'Cell A1 ', cursor=1", "SPEECH OUTPUT: ''", "SPEECH OUTPUT: 'Untitled2 - OpenOffice.org Calc frame'", "SPEECH OUTPUT: ''", "SPEECH OUTPUT: 'panel'", "SPEECH OUTPUT: 'Sheet Sheet1 table grayed'", "SPEECH OUTPUT: ' A1'", ACTUAL: "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame'", " VISIBLE: 'Untitled2 - OpenOffice.org Calc ', cursor=1", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane Panel'", " VISIBLE: 'Panel', cursor=1", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table'", " VISIBLE: 'Sheet Sheet1 Table', cursor=1", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell A1 '", " VISIBLE: 'Cell A1 ', cursor=1", "SPEECH OUTPUT: ''", "SPEECH OUTPUT: 'Untitled2 - OpenOffice.org Calc frame'", "SPEECH OUTPUT: ''", "SPEECH OUTPUT: 'panel'", "SPEECH OUTPUT: 'Sheet Sheet1 table grayed'", "SPEECH OUTPUT: 'blank'", [FAILURE WAS UNEXPECTED] Test 2 of 2 FAILED: /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_364086.py:Type 'hello' (without the quotes), followed by Return EXPECTED: "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell A1 '", " VISIBLE: 'Cell A1 ', cursor=1", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell A2 '", " VISIBLE: 'Cell A2 ', cursor=1", "SPEECH OUTPUT: ' A1'", "SPEECH OUTPUT: ' A2'", ACTUAL: "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell A1 '", " VISIBLE: 'Cell A1 ', cursor=1", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell A2 '", " VISIBLE: 'Cell A2 ', cursor=1", "SPEECH OUTPUT: 'blank'", "SPEECH OUTPUT: 'blank'", [FAILURE WAS UNEXPECTED] ---- Test 1 of 3 FAILED: /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_364407.py:File->New->Spreadsheet EXPECTED: "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame'", " VISIBLE: 'Untitled2 - OpenOffice.org Calc ', cursor=1", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane Panel'", " VISIBLE: 'Panel', cursor=1", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table'", " VISIBLE: 'Sheet Sheet1 Table', cursor=1", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell A1 '", " VISIBLE: 'Cell A1 ', cursor=1", "SPEECH OUTPUT: ''", "SPEECH OUTPUT: 'Untitled2 - OpenOffice.org Calc frame'", "SPEECH OUTPUT: ''", "SPEECH OUTPUT: 'panel'", "SPEECH OUTPUT: 'Sheet Sheet1 table grayed'", "SPEECH OUTPUT: ' A1'", ACTUAL: "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame'", " VISIBLE: 'Untitled2 - OpenOffice.org Calc ', cursor=1", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane Panel'", " VISIBLE: 'Panel', cursor=1", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table'", " VISIBLE: 'Sheet Sheet1 Table', cursor=1", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell A1 '", " VISIBLE: 'Cell A1 ', cursor=1", "SPEECH OUTPUT: ''", "SPEECH OUTPUT: 'Untitled2 - OpenOffice.org Calc frame'", "SPEECH OUTPUT: ''", "SPEECH OUTPUT: 'panel'", "SPEECH OUTPUT: 'Sheet Sheet1 table grayed'", "SPEECH OUTPUT: 'blank'", [FAILURE WAS UNEXPECTED] Test 3 of 3 FAILED: /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_364407.py:Type 'c3' followed by Return to jump to cell C3 in the spreadsheet EXPECTED: "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ToolBar c $l'", " VISIBLE: 'c $l', cursor=2", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ToolBar c $l'", " VISIBLE: 'c $l', cursor=2", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ToolBar c3 $l'", " VISIBLE: 'c3 $l', cursor=3", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ToolBar c3 $l'", " VISIBLE: 'c3 $l', cursor=3", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ToolBar c3 $l'", " VISIBLE: 'c3 $l', cursor=1", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell A1 '", " VISIBLE: 'Cell A1 ', cursor=1", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell C3 '", " VISIBLE: 'Cell C3 ', cursor=1", "SPEECH OUTPUT: ' A1'", "SPEECH OUTPUT: ' C3'", ACTUAL: "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ToolBar c $l'", " VISIBLE: 'c $l', cursor=2", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ToolBar c $l'", " VISIBLE: 'c $l', cursor=2", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ToolBar c3 $l'", " VISIBLE: 'c3 $l', cursor=3", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ToolBar c3 $l'", " VISIBLE: 'c3 $l', cursor=3", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ToolBar c3 $l'", " VISIBLE: 'c3 $l', cursor=1", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell A1 '", " VISIBLE: 'Cell A1 ', cursor=1", "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell C3 '", " VISIBLE: 'Cell C3 ', cursor=1", "SPEECH OUTPUT: 'blank'", "SPEECH OUTPUT: 'blank'", [FAILURE WAS UNEXPECTED] ---- Test 2 of 4 FAILED: /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_433398.py:Type Return to check it EXPECTED: "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view4 Sheet Sheet1 Table'", " VISIBLE: 'Sheet Sheet1 Table', cursor=1", "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view4 Sheet Sheet1 Table Apples Cell B1 '", " VISIBLE: 'Apples Cell B1 ', cursor=1", "SPEECH OUTPUT: 'Sheet Sheet1 table grayed'", "SPEECH OUTPUT: 'Apples B1'", ACTUAL: "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view4 Sheet Sheet1 Table'", " VISIBLE: 'Sheet Sheet1 Table', cursor=1", "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view4 Sheet Sheet1 Table Apples Cell B1 '", " VISIBLE: 'Apples Cell B1 ', cursor=1", "SPEECH OUTPUT: 'Sheet Sheet1 table grayed'", "SPEECH OUTPUT: 'Apples'", [FAILURE WAS UNEXPECTED] Test 4 of 4 FAILED: /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_433398.py:Type Return to uncheck it EXPECTED: "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table'", " VISIBLE: 'Sheet Sheet1 Table', cursor=1", "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Apples Cell B1 '", " VISIBLE: 'Apples Cell B1 ', cursor=1", "SPEECH OUTPUT: 'Sheet Sheet1 table grayed'", "SPEECH OUTPUT: 'Apples B1'", ACTUAL: "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table'", " VISIBLE: 'Sheet Sheet1 Table', cursor=1", "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Apples Cell B1 '", " VISIBLE: 'Apples Cell B1 ', cursor=1", "SPEECH OUTPUT: 'Sheet Sheet1 table grayed'", "SPEECH OUTPUT: 'Apples'", [FAILURE WAS UNEXPECTED] ---- Test 1 of 2 FAILED: /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_435307.py:Type Alt-f to select the Freeze menu item [1] EXPECTED: "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view4 Sheet Sheet1 Table'", " VISIBLE: 'Sheet Sheet1 Table', cursor=1", "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view4 Sheet Sheet1 Table Apples Cell B1 '", " VISIBLE: 'Apples Cell B1 ', cursor=1", "SPEECH OUTPUT: 'Sheet Sheet1 table grayed'", "SPEECH OUTPUT: 'Apples B1'", ACTUAL: "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view4 Sheet Sheet1 Table'", " VISIBLE: 'Sheet Sheet1 Table', cursor=1", "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view4 Sheet Sheet1 Table Apples Cell B1 '", " VISIBLE: 'Apples Cell B1 ', cursor=1", "SPEECH OUTPUT: 'Sheet Sheet1 table grayed'", "SPEECH OUTPUT: 'Apples'", [FAILURE WAS UNEXPECTED] Test 2 of 2 FAILED: /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_435307.py:Type Alt-f to select the Freeze menu item [2] EXPECTED: "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table'", " VISIBLE: 'Sheet Sheet1 Table', cursor=1", "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Apples Cell B1 '", " VISIBLE: 'Apples Cell B1 ', cursor=1", "SPEECH OUTPUT: 'Sheet Sheet1 table grayed'", "SPEECH OUTPUT: 'Apples B1'", ACTUAL: "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table'", " VISIBLE: 'Sheet Sheet1 Table', cursor=1", "BRAILLE LINE: 'soffice Application Frame fruit - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Apples Cell B1 '", " VISIBLE: 'Apples Cell B1 ', cursor=1", "SPEECH OUTPUT: 'Sheet Sheet1 table grayed'", "SPEECH OUTPUT: 'Apples'", [FAILURE WAS UNEXPECTED] ---- Test 1 of 4 FAILED: /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_435852.py:Enter right arrow to move to cell B1 EXPECTED: "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell B1 '", " VISIBLE: 'Cell B1 ', cursor=1", "SPEECH OUTPUT: ' B1'", ACTUAL: "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell B1 '", " VISIBLE: 'Cell B1 ', cursor=1", "SPEECH OUTPUT: 'blank'", [FAILURE WAS UNEXPECTED] Test 2 of 4 FAILED: /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_435852.py:Enter down arrow to move to cell B2 EXPECTED: "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell B2 '", " VISIBLE: 'Cell B2 ', cursor=1", "SPEECH OUTPUT: ' B2'", ACTUAL: "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell B2 '", " VISIBLE: 'Cell B2 ', cursor=1", "SPEECH OUTPUT: 'blank'", [FAILURE WAS UNEXPECTED] Test 3 of 4 FAILED: /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_435852.py:Enter left arrow to move to cell A2 EXPECTED: "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell A2 '", " VISIBLE: 'Cell A2 ', cursor=1", "SPEECH OUTPUT: ' A2'", ACTUAL: "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell A2 '", " VISIBLE: 'Cell A2 ', cursor=1", "SPEECH OUTPUT: 'blank'", [FAILURE WAS UNEXPECTED] Test 4 of 4 FAILED: /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_435852.py:Enter up arrow to move to cell A1 EXPECTED: "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell A1 '", " VISIBLE: 'Cell A1 ', cursor=1", "SPEECH OUTPUT: ' A1'", ACTUAL: "BRAILLE LINE: 'soffice Application Untitled2 - OpenOffice.org Calc Frame Untitled2 - OpenOffice.org Calc RootPane ScrollPane Document view3 Sheet Sheet1 Table Cell A1 '", " VISIBLE: 'Cell A1 ', cursor=1", "SPEECH OUTPUT: 'blank'", [FAILURE WAS UNEXPECTED] ======================================
The above problems are caused by an Orca application Preferences dialog focusing problem. See bug #523712 for more details.
Here's the results from running: $ cd /home/richb/gnome/orca/trunk/test/harness $ ./runall -a /home/richb/gnome/orca/trunk/keystrokes/oocalc on my Ubuntu Hardy system. SUMMARY: 2 SUCCEEDED and 2 FAILED (2 UNEXPECTED) of 4 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_356334.py SUMMARY: 10 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 10 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_361167.py SUMMARY: 4 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 4 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_363801.py SUMMARY: 6 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 6 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_363802.py SUMMARY: 6 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 6 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_363804.py SUMMARY: 2 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 2 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_364086.py SUMMARY: 3 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 3 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_364407.py SUMMARY: 4 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 4 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_433398.py SUMMARY: 2 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 2 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_435307.py SUMMARY: 4 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 4 for /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_435852.py For the two failures, I'm getting: Test 2 of 4 FAILED: /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_356334.py:Type Insert-f to get text attributes on the current cell (A2) EXPECTED: "BUG: not speaking anything", ACTUAL: "", [FAILURE WAS UNEXPECTED] Test 4 of 4 FAILED: /home/richb/gnome/orca/trunk/test/keystrokes/oocalc/bug_356334.py:Type Insert-f to get text attributes on the current cell (B2) EXPECTED: "BUG: not speaking anything", ACTUAL: "", [FAILURE WAS UNEXPECTED] This failure is known and there is a bug open against OOo for it. So these seem in pretty good shape.
> So these seem in pretty good shape. Agreed, and I'm getting the same results on Solaris, with the same failures and same successes. Woo hoo! SUMMARY: 2 SUCCEEDED and 2 FAILED (2 UNEXPECTED) of 4 for /export/home/wwalker/orca/trunk/test/keystrokes/oocalc/bug_356334.py SUMMARY: 10 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 10 for /export/home/wwalker/orca/trunk/test/keystrokes/oocalc/bug_361167.py SUMMARY: 4 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 4 for /export/home/wwalker/orca/trunk/test/keystrokes/oocalc/bug_363801.py SUMMARY: 6 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 6 for /export/home/wwalker/orca/trunk/test/keystrokes/oocalc/bug_363802.py SUMMARY: 6 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 6 for /export/home/wwalker/orca/trunk/test/keystrokes/oocalc/bug_363804.py SUMMARY: 2 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 2 for /export/home/wwalker/orca/trunk/test/keystrokes/oocalc/bug_364086.py SUMMARY: 3 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 3 for /export/home/wwalker/orca/trunk/test/keystrokes/oocalc/bug_364407.py SUMMARY: 4 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 4 for /export/home/wwalker/orca/trunk/test/keystrokes/oocalc/bug_433398.py SUMMARY: 2 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 2 for /export/home/wwalker/orca/trunk/test/keystrokes/oocalc/bug_435307.py SUMMARY: 4 SUCCEEDED and 0 FAILED (0 UNEXPECTED) of 4 for /export/home/wwalker/orca/trunk/test/keystrokes/oocalc/bug_435852.py
I'm moving this one to "[pending]" too. There is already a bug open for the problem that is causing the two test failures in .../test/keystrokes/oocalc/bug_356334.py. Everything else is working.