After an evaluation, GNOME has moved from Bugzilla to GitLab. Learn more about GitLab.
No new issues can be reported in GNOME Bugzilla anymore.
To report an issue in a GNOME project, go to GNOME GitLab.
Do not go to GNOME Gitlab for: Bluefish, Doxygen, GnuCash, GStreamer, java-gnome, LDTP, NetworkManager, Tomboy.
Bug 749137 - GLib-ERROR **: [...] glib/gmem.c:103: failed to allocate 464661187 bytes
GLib-ERROR **: [...] glib/gmem.c:103: failed to allocate 464661187 bytes
Status: RESOLVED DUPLICATE of bug 758315
Product: tracker
Classification: Core
Component: Extractor
1.2.x
Other Linux
: Normal major
: ---
Assigned To: tracker-extractor
tracker-extractor
Depends on:
Blocks:
 
 
Reported: 2015-05-08 20:01 UTC by Ludovic Pouzenc
Modified: 2016-05-08 01:54 UTC
See Also:
GNOME target: ---
GNOME version: ---


Attachments
valgrind trace of tracher-extract (102.80 KB, text/x-log)
2015-05-08 20:01 UTC, Ludovic Pouzenc
Details
Image that causes this issue (64.11 KB, image/gif)
2015-06-16 20:58 UTC, Rowan Lewis
Details

Description Ludovic Pouzenc 2015-05-08 20:01:22 UTC
Created attachment 303101 [details]
valgrind trace of tracher-extract

Hi,

I'm running a fresh copy of Debian 8. I've imported all my old stuff in ~/Documents and I see high IO at each logon, tracker-extract play a big role in it.

It seems that it doesn't acheive his first full scan. In /var/log/user.log, I see : 

May  8 13:31:32 lud-GB1 org.freedesktop.Tracker1.Miner.Extract[1974]: (tracker-extract:3035): Tracker-WARNING **: Call to gst_discoverer_discover_uri() failed: Il manque un greffon dans votre installation de GStreamer.
May  8 13:31:32 lud-GB1 org.freedesktop.Tracker1.Miner.Extract[1974]: (tracker-extract:3035): Tracker-WARNING **: Task for 'file:///home/lpouzenc/Documents/XXXXXXXXX.xcf' finished wi
th error: Could not get any metadata for uri:'file:///home/lpouzenc/Documents/XXXXXXXXX.xcf' and mime:'image/x-xcf'
May  8 13:31:36 lud-GB1 org.freedesktop.Tracker1.Miner.Extract[1974]: (tracker-extract:3035): GLib-ERROR **: /tmp/buildd/glib2.0-2.42.1/./glib/gmem.c:103: failed to allocate 464661187 bytes

I think that the XCF message is unrelated to the "real" problem : malloc of 450 Mio of RAM. No clue about current file that is being scanned, I tried some dpkg-divert and a wrap script :

lpouzenc@lud-GB1:~$ cat /usr/lib/tracker/tracker-extract
#!/bin/sh
valgrind --log-file="/tmp/$(basename $0)-%p.log" --track-fds=yes --trace-children=yes $0.real

Then I just open my Gnome session and waited.

Valgrind log is filled with "Conditional jump or move depends on uninitialised value(s)" and some "Use of uninitialised value of size 8" or "Invalid read of size 4" but the error about malloc(450Mio) does NOT happens in these conditions. The overall was quite slow, but valgrind eat all the CPU :)
Heap summary says 100 millions of allocs, 36 Tio allocated, quite impressive :D
I have no swap on my Debian (I always prefer OOM :P). There was no OOM traces in log around the occurence of the bug).

I have installed tracker-dbg but line numbers does not show up in valgrind traces. Please give me some tips to give you back accurate traces and infos.
--track-fds was irrevelant too.

Cheers,
Ludovic
Comment 1 Ludovic Pouzenc 2015-05-08 22:09:03 UTC
I finally do the obvious : --verbosity=3.

Tracker-Message: Extracting metadata for 'file:///home/lpouzenc/Documents/Progs/MesProgs/pc/shell_script/autres/arborescence-mindmap/datas.svg'
Tracker-Message: MIME type passed to us as 'image/svg+xml'
(tracker-extract.real:12241): Tracker-DEBUG: Using /usr/lib/x86_64-linux-gnu/tracker-1.0/extract-modules/libextract-gstreamer.so...
(tracker-extract.real:12241): Tracker-DEBUG: GStreamer backend in use:
(tracker-extract.real:12241): Tracker-DEBUG:   Discoverer/GUPnP-DLNA

(tracker-extract.real:12241): GLib-ERROR **: /tmp/buildd/glib2.0-2.42.1/./glib/gmem.c:103: failed to allocate 464661187 bytes
Trace/breakpoint trap



lpouzenc@lud-GB1:/tmp$ ls -l /home/lpouzenc/Documents/Progs/MesProgs/pc/shell_script/autres/arborescence-mindmap/datas.svg
-rwxr----- 1 lpouzenc pouzenc 2210289 oct.  27  2008 /home/lpouzenc/Documents/Progs/MesProgs/pc/shell_script/autres/arborescence-mindmap/datas.svg
lpouzenc@lud-GB1:/tmp$ file /home/lpouzenc/Documents/Progs/MesProgs/pc/shell_script/autres/arborescence-mindmap/datas.svg
/home/lpouzenc/Documents/Progs/MesProgs/pc/shell_script/autres/arborescence-mindmap/datas.svg: SVG Scalable Vector Graphics image
l


This SVG file is huge, and was generated by GraphViz with a lot of nodes.

I could send it privately or try to generate a similar file without "personnal" data inside.

Cheers,
Ludovic
Comment 2 Ludovic Pouzenc 2015-05-08 22:23:15 UTC
I'm not sure that is related but dmesg show up some messages :

[13580.215575] radeon_gem_object_create:62 alloc size 451Mb bigger than 256Mb limit
[13580.215598] radeon_gem_object_create:62 alloc size 451Mb bigger than 256Mb limit
[13580.215638] radeon_gem_object_create:62 alloc size 451Mb bigger than 256Mb limit
[13580.215648] radeon_gem_object_create:62 alloc size 451Mb bigger than 256Mb limit
[13580.215788] radeon_gem_object_create:62 alloc size 451Mb bigger than 256Mb limit
[13580.215800] radeon_gem_object_create:62 alloc size 451Mb bigger than 256Mb limit
[13580.215822] radeon_gem_object_create:62 alloc size 451Mb bigger than 256Mb limit
[13580.215830] radeon_gem_object_create:62 alloc size 451Mb bigger than 256Mb limit
Comment 3 Martyn Russell 2015-05-31 12:55:19 UTC
Thanks for filing the report. Can you attach or make available the file you're extracting.

Most times the problem is in the library or backend we're linking with to extract the information. But I can take a look if I have the file.
Comment 4 Ludovic Pouzenc 2015-05-31 15:41:53 UTC
Hi,

Thanks for reply, I just sent to you the file by email.

Regards,
Ludovic
Comment 5 Rowan Lewis 2015-06-16 20:57:32 UTC
I can confirm this with a different file, here's the terminal output:

↪ /usr/lib/tracker/tracker-extract --verbosity=3 -f bad.gif
Locale 'TRACKER_LOCALE_LANGUAGE' was set to 'en_AU.UTF-8'
Locale 'TRACKER_LOCALE_TIME' was set to 'en_AU.UTF-8'
Locale 'TRACKER_LOCALE_COLLATE' was set to 'en_AU.UTF-8'
Locale 'TRACKER_LOCALE_NUMERIC' was set to 'en_AU.UTF-8'
Locale 'TRACKER_LOCALE_MONETARY' was set to 'en_AU.UTF-8'
Setting priority nice level to 19
Loading extractor rules... (/usr/share/tracker/extract-rules)
  Loaded rule '10-abw.rule'
  Loaded rule '10-bmp.rule'
  Loaded rule '10-comics.rule'
  Loaded rule '10-dvi.rule'
  Loaded rule '10-ebooks.rule'
  Loaded rule '10-epub.rule'
  Loaded rule '10-flac.rule'
  Loaded rule '10-gif.rule'
  Loaded rule '10-html.rule'
  Loaded rule '10-ico.rule'
  Loaded rule '10-jpeg.rule'
  Loaded rule '10-mp3.rule'
  Loaded rule '10-msoffice.rule'
  Loaded rule '10-oasis.rule'
  Loaded rule '10-pdf.rule'
  Loaded rule '10-png.rule'
  Loaded rule '10-ps.rule'
  Loaded rule '10-svg.rule'
  Loaded rule '10-tiff.rule'
  Loaded rule '10-vorbis.rule'
  Loaded rule '10-xmp.rule'
  Loaded rule '10-xps.rule'
  Loaded rule '11-iso.rule'
  Loaded rule '11-msoffice-xml.rule'
  Loaded rule '15-gstreamer-guess.rule'
  Loaded rule '15-playlist.rule'
  Loaded rule '15-source-code.rule'
  Loaded rule '90-gstreamer-audio-generic.rule'
  Loaded rule '90-gstreamer-image-generic.rule'
  Loaded rule '90-gstreamer-video-generic.rule'
  Loaded rule '90-text-generic.rule'
Extractor rules loaded
Initializing media art processing requirements...
No mounts found to iterate
MIME type guessed as 'image/gif' (from GIO)
Using /usr/lib/tracker-1.0/extract-modules/libextract-gif.so...
gmem.c:103: failed to allocate 18446744073709420545 bytes
fish: Job 1, “/usr/lib/tracker/tracker-extract --verbosity=3 -f bad.gif” terminated by signal SIGTRAP (Trace or breakpoint trap)
Comment 6 Rowan Lewis 2015-06-16 20:58:49 UTC
Created attachment 305432 [details]
Image that causes this issue
Comment 7 Carlos Garnacho 2016-05-08 01:54:56 UTC
Thanks for the testing file. This is the same than bug #758315, as that one has a patch, I'm closing this one as a duplicate.

*** This bug has been marked as a duplicate of bug 758315 ***