GNOME Bugzilla – Bug 741746
Vp8enc produces a segmentation fault
Last modified: 2015-06-03 12:26:16 UTC
Created attachment 293029 [details] [review] vp8enc: Fix segmentation fault when gst_vide_frame_map fails I've detected that in some circumstances (don't know exactly when), vp8 encoder produces a segmentation fault. Tracing the coredump it seems that the problems occurs when gst_vide_frame_map fails, it is not controlled and processing continues trying to use data that has not been generated. I attach a patch that could not be perfect, but at least shows the part that I think that has problems.
The bigger question would be, why it fails to map the input buffer. Is this on a special hardware platform? Or what kind of buffer/memory is arriving there? Is the buffer maybe mapped writeable elsewhere, or do we get the only reference here? While it's of course correct to check if map() fails, it shouldn't fail in the first place here.
This is happening on a i7 processor, it is a laptop, so no special hardware. Unfortunately I cannot ask your questions, is something that has happen very rarely so it is difficult to trace. I'll try to get more data if I found the bug again.
I think that we can close this one I couldn't reproduce it since I filed the bug.