After an evaluation, GNOME has moved from Bugzilla to GitLab. Learn more about GitLab.
No new issues can be reported in GNOME Bugzilla anymore.
To report an issue in a GNOME project, go to GNOME GitLab.
Do not go to GNOME Gitlab for: Bluefish, Doxygen, GnuCash, GStreamer, java-gnome, LDTP, NetworkManager, Tomboy.
Bug 626430 - 2.3GB of memory used during import
2.3GB of memory used during import
Status: RESOLVED DUPLICATE of bug 617687
Product: banshee
Classification: Other
Component: Importing
git master
Other Linux
: Normal critical
: 1.x
Assigned To: Banshee Maintainers
Banshee Maintainers
Depends on:
Blocks:
 
 
Reported: 2010-08-09 12:38 UTC by David Nielsen
Modified: 2010-12-15 15:02 UTC
See Also:
GNOME target: ---
GNOME version: ---


Attachments
compressed log of the run (952.49 KB, application/x-bzip)
2010-08-09 12:38 UTC, David Nielsen
Details
Pure --debug run (143.89 KB, text/plain)
2010-08-09 18:30 UTC, David Nielsen
Details
overnight run ending in death (322.85 KB, text/plain)
2010-08-12 18:28 UTC, David Nielsen
Details

Description David Nielsen 2010-08-09 12:38:55 UTC
Created attachment 167424 [details]
compressed log of the run

As discussed on IRC. I am seeing Banshee using 2.3 gigs of memory during an import of roughly 60GBs of mp3s and mp4 video files using copy on import.

The files are going from my local harddrive to my music/video folders which are mounted using cifs to /media/nas/ . Transfer speed for this should not be expected to exceed 1.5mb/s (different suckage).

No playback is taking place in Banshee at the time, so this is not likely to be #555365.
Comment 1 David Nielsen 2010-08-09 18:30:07 UTC
Created attachment 167447 [details]
Pure --debug run

around 1.9 GB Virt, 1.3GB RSS and Writable in use at the time. RSS use rising at about 24-25 MB/min.
Comment 2 David Nielsen 2010-08-12 18:28:20 UTC
Created attachment 167760 [details]
overnight run ending in death

For fun I left Banshee overnight doing the same import and as expected the memory use rose, when I woke up Banshee had died (presumably the OOM killer did its job). 

However I noticed that the LibraryWatcher was seeing a lot of use, so I tried disabling it and doing the same 'copy on import' import of my test files. This did not cause the growth in memory use so I am pretty certain that it is once again playing a part of lovely bugs.
Comment 3 Gabriel Burt 2010-08-12 18:47:55 UTC
Is your Music or Video library location set to your home directory or / or anything strange?
Comment 4 David Nielsen 2010-08-12 19:01:44 UTC
/media/nas/Musik and /media/nas/Videoklip respectively, /media/nas is a CIFS mount as stated above.
Comment 5 Brendan 2010-10-18 05:02:09 UTC
I'm also having this problem, 2.3 out of my 3GB ram was used before it died whilst importing from an external ntfs drive to an empty directory on a ntfs partition at /media/Storage/~Brendan/Music/ . disabling Library Watcher stopped the problem but I'd like to use the extension
Comment 6 Brendan 2010-10-18 05:10:04 UTC
Just to add to that, banshee is using ~500MB importing 14,000 tracks even fixing the massive lag/mem usage i was experiencing with library watcher on - not sure if it supposed to use that much or not though and playing music doesn't make a noticeable difference after monitoring ram usage for a minute or so. Another thing is that the track skips (like a CD) every minute or so but that could be a separate bug all together for all I know.
Comment 7 David Nielsen 2010-10-18 16:36:39 UTC
I wonder if this might be an artifact of the FileAdaptor leak Ricotz discovered in gio-sharp.

http://github.com/mono/gio-sharp/commit/d264425e9a89ffcde80c9561eb6290ceafa44083

Worthwhile notes on the workaround for this issue:
https://bugs.launchpad.net/ubuntu/+source/gio-sharp/+bug/650536
Comment 8 David Nielsen 2010-12-15 15:02:41 UTC
Thanks for the bug report. This particular bug has already been reported into our bug tracking system, but please feel free to report any further bugs you find.

*** This bug has been marked as a duplicate of bug 617687 ***