GNOME Bugzilla – Bug 737158
rtph264pay does not multiplex NAL7/8 into stream
Last modified: 2018-11-03 14:54:10 UTC
It is going to be a fuzzy bug description, since it is pretty difficult to get into the situation (or at least the mechanics are not yet completely understood). Setup: Bosh camera 7000HD -> multicast -> GStreamer -> multicast The observervation is that in some cases, the multicast produced by GStreamer does not contain NAL 7 or NAL 8 anymore (SPS/PPS). Inspecting the stream produced by gst: GST_DEBUG=*rtph264depay*:5 gst-launch-1.0 urirecv uri=rtp://239.1.10.150:5560?encoding-name=H264 ! fakesink &> debug.log cat debug.log |grep NAL\ type 0:00:07.528576767 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:07.529103204 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:07.561325168 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:07.561822120 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:07.595638566 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:07.595823129 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:07.654061855 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:07.664710192 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 5 0:00:07.664746755 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:07.664772356 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:07.696166012 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:07.696433236 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:07.726968750 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:07.727307893 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:07.759747537 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:07.760010576 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:07.795414358 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:07.795708060 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:07.826839379 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:07.827141668 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:07.860425025 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:07.860685137 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:07.897826353 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:07.898097606 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:07.928312577 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:07.928637917 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:07.959940404 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:07.960258549 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:07.994137746 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:07.994550716 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.026958550 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.027303859 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.060415338 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.060998735 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.101329021 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.101777605 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.128332276 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.128824585 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.161946122 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.162375439 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.195848923 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.196489829 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.228388281 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.228973891 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.261066901 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.261589890 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.295710226 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.296257095 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.328935565 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.329438413 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.361794269 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.362281580 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.396789626 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.397433648 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.427303597 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.427767760 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.460780794 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.461252011 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.498994997 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.499471681 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.528817003 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.529222642 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.561687590 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.562256349 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.595417445 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.596065328 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.656565072 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.667220752 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 5 0:00:08.667291162 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.667334135 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.696295908 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.696593032 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.727200842 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.727534839 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.759836036 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.760112852 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.794219887 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.794555158 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.825931621 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.826184106 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.860381240 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.860650321 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:08.900099536 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:08.900440603 20799 0x7f2110002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 Since it is difficult to reproduce; I do not have the detailed logging of the intermediate operation; but from what is logged; it looks as if the CAPS and config data from the originating encoder is captured: application/x-rtp, media=(string)video, payload=(int)35, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, profile-level-id=(string)4d401e, sprop-parameter-sets=(string)"Z01AHppmBgG9gLUFAQUC\,aO48gA\=\=", a-recvonly=(string)"", npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 The pipeline strips the stream to ES and builds it back up; the ES caps are complete too: video/x-h264, stream-format=(string)avc, alignment=(string)au, codec_data=(buffer)014d401effe1000f674d401e9a660601bd80b50501050201000468ee3c80, width=(int)768, height=(int)432, framerate=(fraction)0/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1 The camera uses RTSP with multicast; listening to the multicast of the camera directly does show that the configuration data is sent in the stream (decoding picks up). 0:00:03.091789527 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.124916098 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.124953179 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.158041534 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.158089508 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.191482151 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.191541176 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.224806808 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.224853810 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.257984554 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.258053902 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.291415619 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.291450487 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.324816195 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.324850618 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.357952058 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.357990337 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.391543865 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.391581956 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.424825865 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.424868016 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.457976825 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.458012796 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.491435531 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.491473483 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.524802888 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.524838464 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.558039728 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.558109608 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.591548811 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 7 0:00:03.591586852 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 8 0:00:03.591611433 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.592684445 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 5 0:00:03.625016461 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.625053077 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.658144974 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.658179079 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.691586984 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.691622920 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.724907218 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.724943197 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.758021093 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.758057036 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.791483836 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.791533384 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.824975143 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.825009227 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 0:00:03.858000793 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 6 0:00:03.858045804 21125 0x7f6b18002850 DEBUG rtph264depay gstrtph264depay.c:678:gst_rtp_h264_depay_handle_nal:<rtph264depay0> handle NAL type 1 As far as I know; I haven't seen it with any other camera than this one (might be a general problem; I don't know).
On top of that; we are using RTSP as session management around the multicast; and when using RTSP around the same multicast stream; decoding with GStreamer is fine: the configuration data is passed in the RTSP SDP. This SDP data is captured around on a GST_EVENT_CAPS on the ghost sink pad of the bin around rtph264pay... I'll try to isolate the problem more and investigate if it can be reproduced with a single stream. The odd thing is that if one of seemingly independent stream have it, they all have the same problem.... (multiple streams are started at the same moment).
OK, we're zooming into the problem the pipeline looks something like this udpsrc ! rtpbin ! rtph264depay ! h264parse ! rtph264pay ! rtpbin ! udpsink All correctly connected (RTP) and such. the parser element produces avc/au; not bytestream so the codec_data is not IN the stream between the h264parse element and the rtph264pay element. We change the pipeline dynamically to include a different src; so everything before rtph264pay is changed; the sources are very close to each other; but not quite the same. From that point onwards, rtph264pay does no longer mplex nal 7/8 into the stream. This was something that worked for sure in 0.10 (last time I checked this is indeed some time ago). FYI, these are the relative config_data arrays. 014d001fffe10010674d001f9a6602802dd80b505010502001000468ee3c80 014d001fffe1000c674d001f9a6602802dd80804 01000468ee3c80 ^^ ^^^^^^^^^^^
Whooohooooo, I enabled an option that is in our custom bins that forces the h264parse element in the input trap to produce bytestream (was used for a HW decoder); and this removes the problem. The difference is probably that the rtph264pay element now gets the nal 6/7 from in band; no I just need to figure out what the problem is with avc/au and why the rtph264pay stops mplexing.
Also did you enable config-interval on rtph264pay ?
yes.
-- GitLab Migration Automatic Message -- This bug has been migrated to freedesktop.org's GitLab instance and has been closed from further activity. You can subscribe and participate further through the new bug through this link to our GitLab instance: https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/issues/128.