After an evaluation, GNOME has moved from Bugzilla to GitLab. Learn more about GitLab.
No new issues can be reported in GNOME Bugzilla anymore.
To report an issue in a GNOME project, go to GNOME GitLab.
Do not go to GNOME Gitlab for: Bluefish, Doxygen, GnuCash, GStreamer, java-gnome, LDTP, NetworkManager, Tomboy.
Bug 763011 - avfvideosrc: h264 support, optimize latency
avfvideosrc: h264 support, optimize latency
Status: RESOLVED OBSOLETE
Product: GStreamer
Classification: Platform
Component: gst-plugins-bad
git master
Other Mac OS
: Normal enhancement
: git master
Assigned To: GStreamer Maintainers
GStreamer Maintainers
Depends on:
Blocks:
 
 
Reported: 2016-03-02 20:52 UTC by Joe Gorse
Modified: 2018-11-03 13:47 UTC
See Also:
GNOME target: ---
GNOME version: ---


Description Joe Gorse 2016-03-02 20:52:56 UTC 
I would like to add h264 output support to the avfvidesrc element (i.e. the AVFoundation Session within it) in order to improve the encode/decode latency. When using vtenc_h264 and vtdec_hw, the total pipeline latency is increased 200 ms (~6 frames). I am still new to how GStreamer manages buffers and all this, though in a direct application using native API's I'd expect 2-4 frames of additional latency for h.264 encoding and decoding for real-time streaming.

The following pipelines were used for these measurements:

# With vtenc/vtdec and realtime settings
gst-launch-1.0 avfvideosrc device-index=0 ! "video/x-raw(memory:GLMemory),width=1280,height=720" ! gldownload qos=true ! vtenc_h264 realtime=true allow-frame-reordering=false ! vtdec_hw ! glimagesink

latency = 366 ms

# Without vtenc/vtdec
gst-launch-1.0 avfvideosrc device-index=0 ! "video/x-raw(memory:GLMemory),width=1280,height=720" ! glimagesink

latency = 166 ms
Comment 1 GStreamer system administrator 2018-11-03 13:47:14 UTC 
-- GitLab Migration Automatic Message --

This bug has been migrated to freedesktop.org's GitLab instance and has been closed from further activity.

You can subscribe and participate further through the new bug through this link to our GitLab instance: https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/issues/355.