After an evaluation, GNOME has moved from Bugzilla to GitLab. Learn more about GitLab.
No new issues can be reported in GNOME Bugzilla anymore.
To report an issue in a GNOME project, go to GNOME GitLab.
Do not go to GNOME Gitlab for: Bluefish, Doxygen, GnuCash, GStreamer, java-gnome, LDTP, NetworkManager, Tomboy.
Bug 575356 - timeout on importing large clip
timeout on importing large clip
Status: RESOLVED FIXED
Product: pitivi
Classification: Other
Component: Media library
Git
Other Linux
: Normal normal
: 0.13.4
Assigned To: Pitivi maintainers
Pitivi maintainers
Depends on: 609274
Blocks:
 
 
Reported: 2009-03-14 14:37 UTC by sam tygier
Modified: 2010-03-10 16:20 UTC
See Also:
GNOME target: ---
GNOME version: ---


Attachments
log of problem (4.32 KB, application/x-gzip)
2009-03-14 14:38 UTC, sam tygier
Details
Pitivi debug log (5.87 KB, application/x-gzip)
2010-02-07 15:17 UTC, Guido
Details

Description sam tygier 2009-03-14 14:37:10 UTC
i am using pitivi 0.13.0.1~git20090312-1 from the ubuntu PPA on intrepid

when i try to import a large clip (25 mins, dv, 5.7GB), i get a timeout error.
URI:/data/newzealand/raw/Untitled1
Problem:Timeout while analyzing file.
Extra information:Analyzing the file took too long.

if i keep trying it eventually works. if i drop my caches
echo 1 > /proc/sys/vm/drop_caches
then i get the timeout again.

i will attach a log
Comment 1 sam tygier 2009-03-14 14:38:40 UTC
Created attachment 130655 [details]
log of problem
Comment 2 sam tygier 2009-03-14 18:04:37 UTC
it may be relevant that dvgrab gets upset about the timecodes in these files https://sourceforge.net/tracker2/?func=detail&aid=2687039&group_id=14103&atid=114103
Comment 3 Edward Hervey 2009-03-14 18:32:35 UTC
Are you *SURE* it's a RAW DV file ?

I see mentions of qtdemux in the debug log.. .making me think it might be a dv-in-mov file.

If that's the case... my guess is that it timeouts when reading the index of the files (which will be 25*60*25 (37500) entries big).

There's two things we could do in that case:
* optimize the hell out of qtdemux (memcpying the indexes from the file in a table in memory)
* increasing the timeout for discoverer in pitivi

... Or you could use a *raw* dv file (straight dump from camera) for which the support is excellent in gstreamer and pitivi.
Comment 4 sam tygier 2009-03-15 09:02:42 UTC
(as requested on IRC)
gst-typefind-0.10 /data/newzealand/raw/Untitled1.dv
/data/newzealand/raw/Untitled1.dv - video/quicktime
sorry for my misleadings

i had assumed that because the files come out at 13GB per tape, that final cut was just dumping them to disk. so is dv-in-qt just a qt header, and then a dv stream, or does it do more mangling?
Comment 5 Jean-François Fortin Tam 2009-05-01 18:16:54 UTC
This happens a lot more often on netbooks (for clips that do import correctly on a modern desktop computer); I'd like to be able to disable that timeout. Or maybe there should be an importing progress bar/dialog with "skip" buttons.
Comment 6 Guido 2010-02-07 14:58:12 UTC
I have the same issue with any large AVI file
Comment 7 Guido 2010-02-07 14:59:12 UTC
(In reply to comment #6)
> I have the same issue with any large AVI file

pitivi 0.13.3+20100202 on Ubuntu karmic (gstreamer was upgrades)
Comment 8 Guido 2010-02-07 15:17:00 UTC
Created attachment 153197 [details]
Pitivi debug log

trying importing a avi/xvid file
Comment 9 Javier Acuña Ditzel 2010-02-07 15:48:19 UTC
(In reply to comment #5)
> This happens a lot more often on netbooks (for clips that do import correctly
> on a modern desktop computer); I'd like to be able to disable that timeout. Or
> maybe there should be an importing progress bar/dialog with "skip" buttons.

I agree with Jean-François. I have a netbook and tried to import a 800 MB MPEG-4 file and I always get this timeout error. Disabling that automatic response could be a solution.
Comment 10 Guido 2010-02-08 03:17:30 UTC
I think it is related to gstreamer. On my laptop I had the gstreamer version from Ubuntu karmic repository and pitivi imported large files.
But now I upgraded it with ppa:gstreamer-developers/ppa .
Now pitivi gives the error.
Comment 11 Jean-François Fortin Tam 2010-02-08 03:57:30 UTC
Actually, this is kind of three bugs in one:
- this bug, filed here a year ago (it didn't happen *that often* back then)
- the "hardcoded timeouts suck" problem: bug #583203
- the recent gstreamer problems that many of us have started experiencing; I filed a new one on gstreamer regarding that: bug #609274
Comment 12 Edward Hervey 2010-02-09 15:34:06 UTC
commit d68a34e70febfb6dc6d761471c08c31b19d46418
Author: Edward Hervey <bilboed@bilboed.com>
Date:   Tue Feb 9 16:31:16 2010 +0100

    discoverer: Make fakesink EOS instantly.
    
    We need this to make the discoverer EOS as soon as possible.
    
    Fixes #575356
Comment 13 Edward Hervey 2010-02-09 16:03:57 UTC
Forgot to mention that this depends on to-be-released-today gstreamer core. Will update the configure.ac once it's released.
Comment 14 Guido 2010-02-11 18:31:57 UTC
It seems the bug was not resolved. Pitivi gives error on large file (i installed gstreamer from gst-developers PPA for ubuntu)
Comment 15 Tommaso Pasini 2010-03-10 15:15:54 UTC
Hi,
using pitivi+gnonlin taken from git I stumbled on this same error. I was trying to import a few of AVI files taken with my camera (I think they're divx or similar), 40 to 100 MB.
I did a git-bisect (twice, just to be sure), and the winner is...

d68a34e70febfb6dc6d761471c08c31b19d46418 is the first bad commit
commit d68a34e70febfb6dc6d761471c08c31b19d46418
Author: Edward Hervey <bilboed@bilboed.com>
Date:   Tue Feb 9 16:31:16 2010 +0100

    discoverer: Make fakesink EOS instantly.
    
    We need this to make the discoverer EOS as soon as possible.
    
    Fixes #575356

:040000 040000 406838662cf6132f94ba9446c653cbc00d85149d 3a36484e965cdfee9c9aa16f7282dcfb7176ed41 M	pitivi

Reverting that single commit made pitivi work fine as usual.
Comment 16 Edward Hervey 2010-03-10 15:57:47 UTC
Tommaso, are you using gstreamer/gst-plugins-base 0.10.26 or more recent ?
Comment 17 Tommaso Pasini 2010-03-10 16:10:18 UTC
I'm using 0.10.25, 0.10.26/27/28 hasn't made it to gentoo portage, yet.
Comment 18 Edward Hervey 2010-03-10 16:20:13 UTC
Right, see comment #13.

I updated configure.ac to make it depend on core/base 0.10.28. That should solve the problem (of using pitivi with a version of gstreamer for which it's known to break).