After an evaluation, GNOME has moved from Bugzilla to GitLab. Learn more about GitLab.
No new issues can be reported in GNOME Bugzilla anymore.
To report an issue in a GNOME project, go to GNOME GitLab.
Do not go to GNOME Gitlab for: Bluefish, Doxygen, GnuCash, GStreamer, java-gnome, LDTP, NetworkManager, Tomboy.
Bug 702942 - Install conformance tests
Install conformance tests
Status: RESOLVED FIXED
Product: cogl
Classification: Platform
Component: general
unspecified
Other All
: Normal normal
: ---
Assigned To: Cogl maintainer(s)
Cogl maintainer(s)
Depends on:
Blocks:
 
 
Reported: 2013-06-24 03:33 UTC by Matthias Clasen
Modified: 2013-07-10 23:14 UTC
See Also:
GNOME target: ---
GNOME version: ---


Attachments
Install conformance tests (2.39 KB, patch)
2013-06-24 03:33 UTC, Matthias Clasen
none Details | Review
Install conformance tests (2.54 KB, patch)
2013-07-03 03:31 UTC, Matthias Clasen
none Details | Review

Description Matthias Clasen 2013-06-24 03:33:32 UTC
Install the conformance tests, and metadata to run them
with gnome-desktop-testing-runner.
Comment 1 Matthias Clasen 2013-06-24 03:33:34 UTC
Created attachment 247592 [details] [review]
Install conformance tests
Comment 2 Robert Bragg 2013-06-24 15:41:14 UTC
This looks like it assumes Cogl is using the gtester framework, since it passes -p to the conformance test.

A long time ago Cogl used to use gtester but I'm afraid we found it didn't really meet our needs.

Cogl has its own minimal test runner (please see tests/run-tests.sh and tests/test-launcher.sh) that lets us make sure every test runs in a separate process for catching signals, lets us run each test with several environment variations to check different drivers and features, lets us track different constraints for running each test in different situations and can also run on win32 in the same way. In master the test runner is now also re-used for running white-box unit tests to test Cogl internals. The runner tabulates all of these results on the console into a format that's most convenient for Neil and myself as maintainers to digest.

Instead of installing a .test file for each individual conformance test, could we perhaps instead look at installing Cogl's own test rig and create a single .test file to run the whole suite? We could perhaps also look at supporting the TAP output format from our rig. I'm a bit concerned that we'll make maintaining the conformance suite more awkward if we need to support running the individual tests under alternative runners.
Comment 3 Matthias Clasen 2013-06-24 16:51:42 UTC
Oh, I just copied that (-p) from my clutter patch. 
Whichever works - running the entire testsuite at once is totally fine with me.
Comment 4 Matthias Clasen 2013-07-03 03:31:29 UTC
Created attachment 248276 [details] [review]
Install conformance tests

Install the conformance tests, and metadata to run them
with gnome-desktop-testing-runner.
Comment 5 Matthias Clasen 2013-07-03 03:32:42 UTC
Another attempt, this time using run-tests.sh
Comment 6 Robert Bragg 2013-07-10 23:14:22 UTC
Thanks I've landed your patch on master and the cogl-1.16 branch and it was included in the 1.15.2 snapshot today.