After an evaluation, GNOME has moved from Bugzilla to GitLab. Learn more about GitLab.
No new issues can be reported in GNOME Bugzilla anymore.
To report an issue in a GNOME project, go to GNOME GitLab.
Do not go to GNOME Gitlab for: Bluefish, Doxygen, GnuCash, GStreamer, java-gnome, LDTP, NetworkManager, Tomboy.
Bug 743629 - validate: add an extra test suite for checking elements
validate: add an extra test suite for checking elements
Status: RESOLVED FIXED
Product: GStreamer
Classification: Platform
Component: gst-devtools
unspecified
Other Linux
: Normal enhancement
: 1.5.1
Assigned To: GStreamer Maintainers
GStreamer Maintainers
Depends on: 743994
Blocks:
 
 
Reported: 2015-01-28 10:13 UTC by Vineeth
Modified: 2015-04-25 07:07 UTC
See Also:
GNOME target: ---
GNOME version: ---


Attachments
Adding test suite for checking elements (5.21 KB, patch)
2015-01-28 10:19 UTC, Vineeth
none Details | Review
Added test generator in gstvalidate (2.97 KB, patch)
2015-01-28 10:20 UTC, Vineeth
reviewed Details | Review
Adding test suite for checking elements (6.32 KB, patch)
2015-01-29 06:18 UTC, Vineeth
none Details | Review
Adding test suite for checking elements (5.90 KB, patch)
2015-01-29 15:29 UTC, Vineeth
needs-work Details | Review
Adding test suite for checking elements (6.19 KB, patch)
2015-02-03 06:26 UTC, Vineeth
none Details | Review
extra test cases (3.36 KB, patch)
2015-03-03 11:21 UTC, Vineeth
none Details | Review
update test suite. (2.40 KB, patch)
2015-04-24 02:14 UTC, Vineeth
none Details | Review
update test suite. (2.41 KB, patch)
2015-04-24 08:04 UTC, Vineeth
none Details | Review

Description Vineeth 2015-01-28 10:13:58 UTC
first version validateelement test suite is added,
which goes through all audio and video effect elements
and launches the elements with default audio/video testsrc and fakesink
and with various element properties and finds errors in the pipelines.

subsequent versions of the test suite involves expanding the test suite to all types of elements and making pipelines with all kinds of possible source and sinks.
Comment 1 Vineeth 2015-01-28 10:19:20 UTC
Created attachment 295627 [details] [review]
Adding test suite for checking elements
Comment 2 Vineeth 2015-01-28 10:20:08 UTC
Created attachment 295628 [details] [review]
Added test generator in gstvalidate
Comment 3 Thibault Saunier 2015-01-28 12:56:43 UTC
Review of attachment 295628 [details] [review]:

You should not use a fakesink by default but check if you are muted or not and use autovideosink if it is not case (also by default GstValidatePipelineTestGenerator uses %(videosink)s and %(audiosink)s to handle that for you).

::: validate/launcher/apps/gstvalidate.py
@@ +25,3 @@
 from launcher.loggable import Loggable
+from gi.repository import Gst
+from gi.repository import GObject

I think we do not want to depend on GObject Introspection here

@@ +209,1 @@
+class GstValidateCheckAllElementTestsGenerator(GstValidatePipelineTestsGenerator):

You should just move that to the testsuite implementation instead of here
Comment 4 Thibault Saunier 2015-01-28 13:00:18 UTC
Review of attachment 295628 [details] [review]:

::: validate/launcher/apps/gstvalidate.py
@@ +209,1 @@
+class GstValidateCheckAllElementTestsGenerator(GstValidatePipelineTestsGenerator):

Actually I do not understand what is the goal of that subclass? Can't you just use GstValidatePipelineTestsGenerator ?
Comment 5 Vineeth 2015-01-29 06:18:53 UTC
Created attachment 295720 [details] [review]
Adding test suite for checking elements

Moving the test generator to the test suite implementation and adding auto video/audio sinks in case it is not muted..

And the reason to have a separate subclass is because, for this test suite, i don't think scenario files are needed.  And GstValidatePipelineTestsGenerator is based on scenario files. If i don't declare scenario files, then the tests wont be added.
Comment 6 Thibault Saunier 2015-01-29 09:14:35 UTC
> And the reason to have a separate subclass is because, for this test suite, i
> don't think scenario files are needed.  And GstValidatePipelineTestsGenerator
> is based on scenario files. If i don't declare scenario files, then the tests
> wont be added.

You definitely want to use some scenarios.
Comment 7 Vineeth 2015-01-29 15:29:27 UTC
Created attachment 295766 [details] [review]
Adding test suite for checking elements

Please review the patch

Adding blacklist of testcases is pending as i am not able to run the test cases with scenarios.
I will add it as soon as the errors get resolved.
Comment 8 Thibault Saunier 2015-01-30 10:25:43 UTC
Review of attachment 295766 [details] [review]:

::: testsuites/validateelements.py
@@ +33,3 @@
+BLACKLIST = []
+
+pipelines_descriptions = []

Should not be global but returned by the following function

@@ +39,3 @@
+    loop = 0
+    prop_value = Gst.ElementFactory.make(fname, None).get_property(prop.name)
+    bool_value = "True"

Why do you work with strings here instead of actual booleans? (conversion to string will be done automatically in Python)

@@ +44,3 @@
+    if prop.value_type == GObject.TYPE_BOOLEAN:
+        loop = 2
+    elif prop.value_type == GObject.TYPE_INT or prop.value_type == GObject.TYPE_INT64 or \

You chould rather do:

    elif prop.value_type in [GObject.TYPE_INT, GObject.TYPE_INT64, GObject.TYPE_UINT...]

And actually add a pspec_is_numeric function or something

@@ +62,3 @@
+                prop.value_type == GObject.TYPE_UINT or prop.value_type == GObject.TYPE_UINT64 or \
+                prop.value_type == GObject.TYPE_LONG or prop.value_type == GObject.TYPE_ULONG or \
+                prop.value_type == GObject.TYPE_DOUBLE:

And use the func here too

@@ +79,3 @@
+        elif "Video" in klass:
+            cpipe = "videotestsrc num-buffers=20 ! %s " % (cname)
+            sink = "! videoconvert ! autovideosink"

You should simply use "! videoconvert ! %(videosink)s" -- The base PipelineGenerator class will handle the templating
Comment 9 Vineeth 2015-02-03 06:26:16 UTC
Created attachment 295995 [details] [review]
Adding test suite for checking elements

updated the patch with review comments
and created bugs for the elements which are failing and blacklisted the same.
Added patches for 2 of the bugs, and 3 are pending.
Comment 10 Thibault Saunier 2015-02-04 14:44:33 UTC
Adding dependencies to #743994 as that feature needs that branch to be merged first
Comment 11 Vineeth 2015-03-03 11:21:29 UTC
Created attachment 298413 [details] [review]
extra test cases

Improved the script to add more elements to be verified by the test suite.
Comment 12 Vineeth 2015-04-20 08:17:53 UTC
Hi Thibault. 

Can you please check if the dependencies for this is resolved.
Comment 13 Thibault Saunier 2015-04-20 08:29:44 UTC
Hello vineth, thanks for this work, it has now been merged as it was taking too much time and the patches are now good enough to get in. But I am still getting the following issues so could you please investigate then open bug reports/fix for them please?


=============
Final Report:
=============
validate.launch_pipeline.audiointerleavechannel-positions-from-input=False.play_15s: Failed 'Application returned -11 (issues: No criticals)'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  audiotestsrc num-buffers=20 ! audiointerleave channel-positions-from-input=False ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/audiointerleavechannel-positions-from-input=False/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/audiointerleavechannel-positions-from-input=False/play_15s.validate.logs


validate.launch_pipeline.gleffectshswap=False.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gleffects hswap=False ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gleffectshswap=False/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gleffectshswap=False/play_15s.validate.logs


validate.launch_pipeline.gleffectshswap=True.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gleffects hswap=True ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gleffectshswap=True/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gleffectshswap=True/play_15s.validate.logs


validate.launch_pipeline.glfilterbinasync-handling=False.play_15s: Failed 'Application returned 255 (issues: No criticals)'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfilterbin async-handling=False ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfilterbinasync-handling=False/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfilterbinasync-handling=False/play_15s.validate.logs


validate.launch_pipeline.glfilterbinasync-handling=True.play_15s: Failed 'Application returned 255 (issues: No criticals)'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfilterbin async-handling=True ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfilterbinasync-handling=True/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfilterbinasync-handling=True/play_15s.validate.logs


validate.launch_pipeline.glfiltercubeaspect=0.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube aspect=0.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeaspect=0/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeaspect=0/0/play_15s.validate.logsGST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  audiotestsrc num-buffers=20 ! audiointerleave channel-positions-from-input=False ! fakesink


validate.launch_pipeline.glfiltercubeaspect=100.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube aspect=100.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeaspect=100/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeaspect=100/0/play_15s.validate.logs


validate.launch_pipeline.glfiltercubefovy=0.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube fovy=0.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubefovy=0/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubefovy=0/0/play_15s.validate.logs


validate.launch_pipeline.glfiltercubefovy=180.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube fovy=180.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubefovy=180/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubefovy=180/0/play_15s.validate.logs


validate.launch_pipeline.glfiltercubefovy=45.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube fovy=45.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubefovy=45/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubefovy=45/0/play_15s.validate.logs


validate.launch_pipeline.glfiltercubezfar=0.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube zfar=0.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubezfar=0/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubezfar=0/0/play_15s.validate.logs

GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  audiotestsrc num-buffers=20 ! audiointerleave channel-positions-from-input=False ! fakesink
validate.launch_pipeline.glfiltercubezfar=100.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube zfar=100.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubezfar=100/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubezfar=100/0/play_15s.validate.logs


validate.launch_pipeline.glfiltercubezfar=1000.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube zfar=1000.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubezfar=1000/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubezfar=1000/0/play_15s.validate.logs


validate.launch_pipeline.glfiltercubeznear=0.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube znear=0.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeznear=0/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeznear=0/0/play_15s.validate.logs


validate.launch_pipeline.glfiltercubeznear=0.1.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube znear=0.1 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeznear=0/1/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeznear=0/1/play_15s.validate.logs


validate.launch_pipeline.glfiltercubeznear=100.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube znear=100.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeznear=100/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeznear=100/0/play_15s.validate.logs


validate.launch_pipeline.glfiltersobelinvert=False.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltersobel invert=False ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltersobelinvert=False/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltersobelinvert=False/play_15s.validate.logs


validate.launch_pipeline.glfiltersobelinvert=True.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltersobel invert=True ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltersobelinvert=True/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltersobelinvert=True/play_15s.validate.logs


validate.launch_pipeline.gloverlayalpha=0.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay alpha=0.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayalpha=0/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayalpha=0/0/play_15s.validate.logs


validate.launch_pipeline.gloverlayalpha=1.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the busGST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  audiotestsrc num-buffers=20 ! audiointerleave channel-positions-from-input=False ! fakesink])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay alpha=1.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayalpha=1/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayalpha=1/0/play_15s.validate.logs


validate.launch_pipeline.gloverlayoffset-x=-2147483648.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay offset-x=-2147483648 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-x=-2147483648/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-x=-2147483648/play_15s.validate.logs


validate.launch_pipeline.gloverlayoffset-x=0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay offset-x=0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-x=0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-x=0/play_15s.validate.logs

GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  audiotestsrc num-buffers=20 ! audiointerleave channel-positions-from-input=False ! fakesink
validate.launch_pipeline.gloverlayoffset-x=2147483647.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay offset-x=2147483647 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-x=2147483647/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-x=2147483647/play_15s.validate.logs


validate.launch_pipeline.gloverlayoffset-y=-2147483648.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay offset-y=-2147483648 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-y=-2147483648/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-y=-2147483648/play_15s.validate.logs


validate.launch_pipeline.gloverlayoffset-y=0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay offset-y=0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-y=0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-y=0/play_15s.validate.logs


validate.launch_pipeline.gloverlayoffset-y=2147483647.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  audiotestsrc num-buffers=20 ! audiointerleave channel-positions-from-input=False ! fakesinkbus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay offset-y=2147483647 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-y=2147483647/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-y=2147483647/play_15s.validate.logs


validate.launch_pipeline.gloverlayoverlay-height=0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay overlay-height=0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoverlay-height=0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoverlay-height=0/play_15s.validate.logs


validate.launch_pipeline.gloverlayoverlay-height=2147483647.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay overlay-height=2147483647 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoverlay-height=2147483647/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoverlay-height=2147483647/play_15s.validate.logs


validate.launch_pipeline.gloverlayoverlay-width=0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay overlay-width=0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoverlay-width=0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoverlay-width=0/play_15s.validate.logs


validate.launch_pipeline.gloverlayoverlay-width=2147483647.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay overlay-width=2147483647 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoverlay-width=2147483647/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoverlay-width=2147483647/play_15s.validate.logs


validate.launch_pipeline.gloverlayrelative-x=0.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay relative-x=0.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayrelative-=============
Final Report:
=============
validate.launch_pipeline.audiointerleavechannel-positions-from-input=False.play_15s: Failed 'Application returned -11 (issues: No criticals)'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  audiotestsrc num-buffers=20 ! audiointerleave channel-positions-from-input=False ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/audiointerleavechannel-positions-from-input=False/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/audiointerleavechannel-positions-from-input=False/play_15s.validate.logs


validate.launch_pipeline.gleffectshswap=False.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gleffects hswap=False ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gleffectshswap=False/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gleffectshswap=False/play_15s.validate.logs


validate.launch_pipeline.gleffectshswap=True.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gleffects hswap=True ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gleffectshswap=True/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gleffectshswap=True/play_15s.validate.logs


validate.launch_pipeline.glfilterbinasync-handling=False.play_15s: Failed 'Application returned 255 (issues: No criticals)'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfilterbin async-handling=False ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfilterbinasync-handling=False/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfilterbinasync-handling=False/play_15s.validate.logs


validate.launch_pipeline.glfilterbinasync-handling=True.play_15s: Failed 'Application returned 255 (issues: No criticals)'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfilterbin async-handling=True ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfilterbinasync-handling=True/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfilterbinasync-handling=True/play_15s.validate.logs


validate.launch_pipeline.glfiltercubeaspect=0.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube aspect=0.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeaspect=0/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeaspect=0/0/play_15s.validate.logs


validate.launch_pipeline.glfiltercubeaspect=100.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube aspect=100.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeaspect=100/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeaspect=100/0/play_15s.validate.logs


validate.launch_pipeline.glfiltercubefovy=0.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube fovy=0.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubefovy=0/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubefovy=0/0/play_15s.validate.logs


validate.launch_pipeline.glfiltercubefovy=180.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube fovy=180.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubefovy=180/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubefovy=180/0/play_15s.validate.logs


validate.launch_pipeline.glfiltercubefovy=45.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube fovy=45.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubefovy=45/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubefovy=45/0/play_15s.validate.logs


validate.launch_pipeline.glfiltercubezfar=0.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube zfar=0.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubezfar=0/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubezfar=0/0/play_15s.validate.logs


validate.launch_pipeline.glfiltercubezfar=100.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube zfar=100.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubezfar=100/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubezfar=100/0/play_15s.validate.logs


validate.launch_pipeline.glfiltercubezfar=1000.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube zfar=1000.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubezfar=1000/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubezfar=1000/0/play_15s.validate.logs


validate.launch_pipeline.glfiltercubeznear=0.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube znear=0.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeznear=0/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeznear=0/0/play_15s.validate.logs


validate.launch_pipeline.glfiltercubeznear=0.1.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube znear=0.1 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeznear=0/1/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeznear=0/1/play_15s.validate.logs


validate.launch_pipeline.glfiltercubeznear=100.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltercube znear=100.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeznear=100/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltercubeznear=100/0/play_15s.validate.logs


validate.launch_pipeline.glfiltersobelinvert=False.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltersobel invert=False ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltersobelinvert=False/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltersobelinvert=False/play_15s.validate.logs


validate.launch_pipeline.glfiltersobelinvert=True.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! glfiltersobel invert=True ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltersobelinvert=True/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/glfiltersobelinvert=True/play_15s.validate.logs


validate.launch_pipeline.gloverlayalpha=0.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay alpha=0.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayalpha=0/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayalpha=0/0/play_15s.validate.logs


validate.launch_pipeline.gloverlayalpha=1.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay alpha=1.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayalpha=1/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayalpha=1/0/play_15s.validate.logs


validate.launch_pipeline.gloverlayoffset-x=-2147483648.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay offset-x=-2147483648 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-x=-2147483648/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-x=-2147483648/play_15s.validate.logs


validate.launch_pipeline.gloverlayoffset-x=0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay offset-x=0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-x=0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-x=0/play_15s.validate.logs


validate.launch_pipeline.gloverlayoffset-x=2147483647.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay offset-x=2147483647 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-x=2147483647/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-x=2147483647/play_15s.validate.logs


validate.launch_pipeline.gloverlayoffset-y=-2147483648.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay offset-y=-2147483648 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-y=-2147483648/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-y=-2147483648/play_15s.validate.logs


validate.launch_pipeline.gloverlayoffset-y=0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay offset-y=0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-y=0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-y=0/play_15s.validate.logs


validate.launch_pipeline.gloverlayoffset-y=2147483647.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay offset-y=2147483647 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-y=2147483647/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoffset-y=2147483647/play_15s.validate.logs


validate.launch_pipeline.gloverlayoverlay-height=0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay overlay-height=0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoverlay-height=0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoverlay-height=0/play_15s.validate.logs


validate.launch_pipeline.gloverlayoverlay-height=2147483647.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay overlay-height=2147483647 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoverlay-height=2147483647/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoverlay-height=2147483647/play_15s.validate.logs


validate.launch_pipeline.gloverlayoverlay-width=0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay overlay-width=0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoverlay-width=0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoverlay-width=0/play_15s.validate.logs


validate.launch_pipeline.gloverlayoverlay-width=2147483647.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay overlay-width=2147483647 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoverlay-width=2147483647/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayoverlay-width=2147483647/play_15s.validate.logs


validate.launch_pipeline.gloverlayrelative-x=0.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay relative-x=0.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayrelative-x=0/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayrelative-x=0/0/play_15s.validate.logs


validate.launch_pipeline.gloverlayrelative-x=1.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay relative-x=1.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayrelative-x=1/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayrelative-x=1/0/play_15s.validate.logs


validate.launch_pipeline.gloverlayrelative-y=0.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay relative-y=0.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayrelative-y=0/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayrelative-y=0/0/play_15s.validate.logs


validate.launch_pipeline.gloverlayrelative-y=1.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay relative-y=1.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayrelative-y=1/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayrelative-y=1/0/play_15s.validate.logs

x=0/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayrelative-x=0/0/play_15s.validate.logs


validate.launch_pipeline.gloverlayrelative-x=1.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay relative-x=1.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayrelative-x=1/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayrelative-x=1/0/play_15s.validate.logs


validate.launch_pipeline.gloverlayrelative-y=0.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay relative-y=0.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayrelative-y=0/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayrelative-y=0/0/play_15s.validate.logs


validate.launch_pipeline.gloverlayrelative-y=1.0.play_15s: Failed 'Application returned 18 (issues: [We got an ERROR message on the bus])'
       You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s gst-validate-1.0  videotestsrc num-buffers=20 ! gloverlay relative-y=1.0 ! fakesink
       You can find logs in:
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayrelative-y=1/0/play_15s
             - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/gloverlayrelative-y=1/0/play_15s.validate.logs
Comment 14 Thibault Saunier 2015-04-20 08:30:25 UTC
commit 8afdb4bc3d4c01ecc5e01ae81b1ebd4c84fd956d
Author: Vineeth T M <vineeth.tm@samsung.com>
Date:   Tue Mar 3 16:49:53 2015 +0530

    validate: Add extra test cases
    
    Adding more elements to be verified using the test suite.
    
    https://bugzilla.gnome.org/show_bug.cgi?id=743629

commit 74a43b2ccfdd01e9342a6321723f83b0a85fb912
Author: Vineeth T M <vineeth.tm@samsung.com>
Date:   Tue Feb 3 11:54:01 2015 +0530

    validate: add an extra test suite for checking elements
    
    first version validateelement test suite is added,
    which goes through all audio and video effect elements
    and launches the elements with default audio/video testsrc and fakesink
    and with various element properties and finds errors in the pipelines.
    
    https://bugzilla.gnome.org/show_bug.cgi?id=743629


Keeping that bug open to follow the previously listed errors.
Comment 15 Vineeth 2015-04-20 08:35:21 UTC
Hi Thibault,


Thanks for the update.

I will check these and update about the same to you by next week.
Comment 16 Thibault Saunier 2015-04-20 08:43:06 UTC
Perfect thanks.

Btw the result look like:

Statistics:
-----------

           Total time spent: 0:01:54.389768 seconds

           Passed: 603
           Failed: 34
           ---------
           Total: 637

Which is pretty nice as it is very fast and *most* of the test works properly :)
Comment 17 Vineeth 2015-04-24 02:14:56 UTC
Created attachment 302272 [details] [review]
update test suite.

With the latest update the result looks like

           Passed: 690
           Failed: 0
           ---------
           Total: 690


I have attached patches for some blacklisted issues. Raised bugs for the rest.
Will check the blacklisted issues when i get some time.
Comment 18 Thibault Saunier 2015-04-24 07:42:24 UTC
Review of attachment 302272 [details] [review]:

Apart from the comment, looks good

::: testsuites/validateelements.py
@@ +65,3 @@
         sink = "! audioconvert ! %(audiosink)s"
     elif "Video" in klass:
+        if "gl" in fname:

You should use those elements inside glfilterbin:

For exemple:

    gltestsrc ! glfilterbin filter=gleffects_mirror ! glimagesink
Comment 19 Vineeth 2015-04-24 08:04:21 UTC
Created attachment 302279 [details] [review]
update test suite.

Updated the patch as per review comments. Please check
Comment 20 Thibault Saunier 2015-04-24 10:24:01 UTC
Still 1 timeout here:

validate.launch_pipeline.levelinterval=1.play_15s: Timeout 'Application timed out: 30 secs'
You can reproduce with: DISPLAY=:0 GST_VALIDATE_SCENARIOS_PATH=/home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/data/scenarios/ GST_GL_XINITTHREADS=1 GST_VALIDATE_SCENARIO=play_15s /home/thiblahute/devel/pitivi/1.0-uninstalled/gst-devtools/validate/tools/gst-validate-1.0-debug  audiotestsrc num-buffers=20 ! level interval=1 ! fakesink
  You can find logs in:
    - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/levelinterval=1/play_15s
    - /home/thiblahute/gst-validate/logs/validate/launch_pipeline/levelinterval=1/play_15s.validate.logs
Comment 21 Vineeth 2015-04-24 22:48:16 UTC
Hi thibault

The timeout error in level is fixed by Tim a day back.. if you update with to thw latest master it will be fixed
Comment 22 Thibault Saunier 2015-04-25 07:07:03 UTC
(In reply to Vineeth from comment #21)
> Hi thibault
> 
> The timeout error in level is fixed by Tim a day back.. if you update with
> to thw latest master it will be fixed

Indeed, perfect, closing now :)