GNOME Bugzilla – Bug 702942
Install conformance tests
Last modified: 2013-07-10 23:14:22 UTC
Install the conformance tests, and metadata to run them with gnome-desktop-testing-runner.
Created attachment 247592 [details] [review] Install conformance tests
This looks like it assumes Cogl is using the gtester framework, since it passes -p to the conformance test. A long time ago Cogl used to use gtester but I'm afraid we found it didn't really meet our needs. Cogl has its own minimal test runner (please see tests/run-tests.sh and tests/test-launcher.sh) that lets us make sure every test runs in a separate process for catching signals, lets us run each test with several environment variations to check different drivers and features, lets us track different constraints for running each test in different situations and can also run on win32 in the same way. In master the test runner is now also re-used for running white-box unit tests to test Cogl internals. The runner tabulates all of these results on the console into a format that's most convenient for Neil and myself as maintainers to digest. Instead of installing a .test file for each individual conformance test, could we perhaps instead look at installing Cogl's own test rig and create a single .test file to run the whole suite? We could perhaps also look at supporting the TAP output format from our rig. I'm a bit concerned that we'll make maintaining the conformance suite more awkward if we need to support running the individual tests under alternative runners.
Oh, I just copied that (-p) from my clutter patch. Whichever works - running the entire testsuite at once is totally fine with me.
Created attachment 248276 [details] [review] Install conformance tests Install the conformance tests, and metadata to run them with gnome-desktop-testing-runner.
Another attempt, this time using run-tests.sh
Thanks I've landed your patch on master and the cogl-1.16 branch and it was included in the 1.15.2 snapshot today.