It would be really cool to have something like this:
http://www.xinehq.de/~tmattern/report/

We already have a buildbot that has proved to be _really_ useful (Thomas
rocks!). I think we need also a program to test some functions, like:
 - identify a file
 - play Ns of a file
 - play a file till eos 
 - seek
 - stream
 - rip cd
 - ....
Some tests can be:
 - check cpu/mem usage
 - check a/v sync
 - check if it doesn't segfault or hangs :)

I think this can be a really cool (gnome|kde|gstreamer|..)-love project (if
someone wants to blog about it..). There is a good gst-0.9 usage example in
gst-plugins-base/examples/seeking.