After an evaluation, GNOME has moved from Bugzilla to GitLab. Learn more about GitLab.
No new issues can be reported in GNOME Bugzilla anymore.
To report an issue in a GNOME project, go to GNOME GitLab.
Do not go to GNOME Gitlab for: Bluefish, Doxygen, GnuCash, GStreamer, java-gnome, LDTP, NetworkManager, Tomboy.
Bug 659479 - tracker busy loops
tracker busy loops
Status: RESOLVED INCOMPLETE
Product: tracker
Classification: Core
Component: Miners
unspecified
Other Linux
: Normal normal
: ---
Assigned To: tracker-general
Jamie McCracken
Depends on:
Blocks:
 
 
Reported: 2011-09-19 14:40 UTC by Lennart Poettering
Modified: 2012-03-01 08:47 UTC
See Also:
GNOME target: ---
GNOME version: ---



Description Lennart Poettering 2011-09-19 14:40:44 UTC
strace -e open -p $(pidof /usr/libexec/tracker-miner-fs)

If I run this I get the same output over and over again:

open("/home/lennart/.local/share/applications/jhbuild.desktop", O_RDONLY) = 21
open("/home/lennart/.local/share/applications", O_RDONLY) = 21
open("/home/lennart/.local/share/applications/preferred-web-browser.desktop", O_RDONLY) = 21
open("/home/lennart/.local/share/applications", O_RDONLY) = 21
open("/home/lennart/.local/share/applications/userapp-gedit-KQSDLV.desktop", O_RDONLY) = 21
open("/home/lennart/.local/share/applications", O_RDONLY) = 21
open("/home/lennart/.local/share/applications/preferred-web-browser.desktop", O_RDONLY) = 21
open("/home/lennart/.local/share/applications", O_RDONLY) = 21
open("/home/lennart/.local/share/applications/preferred-mail-reader.desktop", O_RDONLY) = 21
open("/home/lennart/.local/share/applications", O_RDONLY) = 21
open("/home/lennart/.local/share/applications/userapp-gedit-KQSDLV.desktop", O_RDONLY) = 21
open("/home/lennart/.local/share/applications", O_RDONLY) = 21
open("/home/lennart/.local/share/applications/preferred-web-browser.desktop", O_RDONLY) = 21
open("/home/lennart/.local/share/applications", O_RDONLY) = 21
open("/home/lennart/.local/share/applications/preferred-mail-reader.desktop", O_RDONLY) = 21
open("/home/lennart/.local/share/applications", O_RDONLY) = 21
open("/home/lennart/.local/share/applications/jhbuild.desktop", O_RDONLY) = 21
open("/home/lennart/.local/share/applications", O_RDONLY) = 21
open("/home/lennart/.local/share/applications/preferred-web-browser.desktop", O_RDONLY) = 21
open("/home/lennart/.local/share/applications", O_RDONLY) = 21

It never gets out of that directory:

40 [lennart@epsilon] ~/.local/share/applications$ ls -al
total 44K
drwxr-xr-x.  2 lennart lennart 4,0K 19. Sep 04:46 ./
drwxr-xr-x. 25 lennart lennart 4,0K 19. Sep 03:11 ../
-rw-r--r--.  1 lennart lennart 1,5K 15. Jul 00:40 jhbuild.desktop
-rw-rw-r--.  1 lennart lennart 1,8K 19. Sep 04:46 mimeapps.list
-rw-rw-r--.  1 lennart lennart  469 28. Okt 2010  mimeinfo.cache
-rw-rw-r--.  1 lennart lennart  15K  4. Okt 2010  preferred-mail-reader.desktop
-rw-rw-r--.  1 lennart lennart 1,7K 26. Aug 2010  preferred-web-browser.desktop
-rw-rw-r--.  1 lennart lennart  137 28. Okt 2010  userapp-gedit-KQSDLV.desktop

$ rpm -qf /usr/libexec/tracker-miner-fs
tracker-0.12.0-1.fc16.x86_64
Comment 1 Jürg Billeter 2011-09-20 09:24:46 UTC
I haven't seen anything like this before. Fedora's tracker 0.12.0 appears to be affected by a bug that triggers recursive crawling of the home partition due to it being detected as a removable volume. That issue should be fixed in 0.12.1. To check whether the busy loop bug was triggered by the home partition issue, it would be great if you could retest it with 0.12.1.
Comment 2 Lennart Poettering 2011-09-20 11:05:57 UTC
0.12.1 doesn't change a thing. Still borked.
Comment 3 Lennart Poettering 2011-09-20 11:09:00 UTC
6 [lennart@epsilon] ~$ /usr/libexec/tracker-miner-fs -v 1
Initializing tracker-miner-fs...
Tracker-Message: Setting up monitor for changes to config file:'/home/lennart/.config/tracker/tracker-miner-fs.cfg'
Starting log:
  File:'/home/lennart/.local/share/tracker/tracker-miner-fs.log'
Tracker-INFO: Initializing
Tracker-INFO: Crawling recursively directory '/usr/local/share/applications'
Tracker-INFO: Finished crawling files after 0,01 seconds
Tracker-INFO: Crawling recursively directory '/usr/local/share/desktop-directories'
Tracker-INFO: Crawling recursively directory '/usr/share/applications'
Tracker-INFO: Finished crawling files after 0,03 seconds
Tracker-INFO: Crawling recursively directory '/usr/share/desktop-directories'
Tracker-INFO: Finished crawling files after 0,03 seconds
Tracker-INFO: Crawling recursively directory '/home/lennart/.local/share/applications'
Tracker-INFO: Finished crawling files after 0,04 seconds
Tracker-INFO: Crawling recursively directory '/home/lennart/.local/share/desktop-directories'
Tracker-INFO: Processing…
Tracker-INFO: Processed 224/228, estimated unknown time left, 03s elapsed

And that's where it stays stuck and strace reveals it always loops around /home/lennart/.local/share/applications/.
Comment 4 Lennart Poettering 2011-09-20 11:29:29 UTC
With -v3:

(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Processing file 'file:///home/lennart/.local/share/applications'...
(tracker-miner-fs:13616): Tracker-DEBUG: Creating new item 'file:///home/lennart/.local/share/applications'
Tracker-Message: Flushing SPARQL buffer, reason: Queue handlers WAIT
Tracker-Message: (Sparql buffer) Finished array-update with 1 tasks
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share/applications'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share/applications" }'
Tracker-Message: Parent 'file:///home/lennart/.local/share/applications' not indexed yet
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share" }'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Processing file 'file:///home/lennart/.local/share/applications'...
(tracker-miner-fs:13616): Tracker-DEBUG: Creating new item 'file:///home/lennart/.local/share/applications'
Tracker-Message: Flushing SPARQL buffer, reason: Queue handlers WAIT
Tracker-Message: (Sparql buffer) Finished array-update with 1 tasks
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share/applications'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share/applications" }'
Tracker-Message: Parent 'file:///home/lennart/.local/share/applications' not indexed yet
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share" }'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Processing file 'file:///home/lennart/.local/share/applications'...
(tracker-miner-fs:13616): Tracker-DEBUG: Creating new item 'file:///home/lennart/.local/share/applications'
Tracker-Message: Flushing SPARQL buffer, reason: Queue handlers WAIT
Tracker-Message: (Sparql buffer) Finished array-update with 1 tasks
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share/applications'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share/applications" }'
Tracker-Message: Parent 'file:///home/lennart/.local/share/applications' not indexed yet
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share" }'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Processing file 'file:///home/lennart/.local/share/applications'...
(tracker-miner-fs:13616): Tracker-DEBUG: Creating new item 'file:///home/lennart/.local/share/applications'
Tracker-Message: Flushing SPARQL buffer, reason: Queue handlers WAIT
Tracker-Message: (Sparql buffer) Finished array-update with 1 tasks
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share/applications'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share/applications" }'
Tracker-Message: Parent 'file:///home/lennart/.local/share/applications' not indexed yet
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share" }'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Processing file 'file:///home/lennart/.local/share/applications'...
(tracker-miner-fs:13616): Tracker-DEBUG: Creating new item 'file:///home/lennart/.local/share/applications'
Tracker-Message: Flushing SPARQL buffer, reason: Queue handlers WAIT
Tracker-Message: (Sparql buffer) Finished array-update with 1 tasks
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share/applications'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share/applications" }'
Tracker-Message: Parent 'file:///home/lennart/.local/share/applications' not indexed yet
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share" }'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Processing file 'file:///home/lennart/.local/share/applications'...
(tracker-miner-fs:13616): Tracker-DEBUG: Creating new item 'file:///home/lennart/.local/share/applications'
Tracker-Message: Flushing SPARQL buffer, reason: Queue handlers WAIT
Tracker-Message: (Sparql buffer) Finished array-update with 1 tasks
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share/applications'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share/applications" }'
Tracker-Message: Parent 'file:///home/lennart/.local/share/applications' not indexed yet
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share" }'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Processing file 'file:///home/lennart/.local/share/applications'...
(tracker-miner-fs:13616): Tracker-DEBUG: Creating new item 'file:///home/lennart/.local/share/applications'
Tracker-Message: Flushing SPARQL buffer, reason: Queue handlers WAIT
Tracker-Message: (Sparql buffer) Finished array-update with 1 tasks
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share/applications'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share/applications" }'
Tracker-Message: Parent 'file:///home/lennart/.local/share/applications' not indexed yet
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share" }'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Processing file 'file:///home/lennart/.local/share/applications'...
(tracker-miner-fs:13616): Tracker-DEBUG: Creating new item 'file:///home/lennart/.local/share/applications'
Tracker-Message: Flushing SPARQL buffer, reason: Queue handlers WAIT
Tracker-Message: (Sparql buffer) Finished array-update with 1 tasks
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share/applications'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share/applications" }'
Tracker-Message: Parent 'file:///home/lennart/.local/share/applications' not indexed yet
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share" }'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Processing file 'file:///home/lennart/.local/share/applications'...
(tracker-miner-fs:13616): Tracker-DEBUG: Creating new item 'file:///home/lennart/.local/share/applications'
Tracker-Message: Flushing SPARQL buffer, reason: Queue handlers WAIT
Tracker-Message: (Sparql buffer) Finished array-update with 1 tasks
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share/applications'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share/applications" }'
Tracker-Message: Parent 'file:///home/lennart/.local/share/applications' not indexed yet
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share" }'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Processing file 'file:///home/lennart/.local/share/applications'...
(tracker-miner-fs:13616): Tracker-DEBUG: Creating new item 'file:///home/lennart/.local/share/applications'
Tracker-Message: Flushing SPARQL buffer, reason: Queue handlers WAIT
Tracker-Message: (Sparql buffer) Finished array-update with 1 tasks
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share/applications'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share/applications" }'
Tracker-Message: Parent 'file:///home/lennart/.local/share/applications' not indexed yet
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share" }'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Processing file 'file:///home/lennart/.local/share/applications'...
(tracker-miner-fs:13616): Tracker-DEBUG: Creating new item 'file:///home/lennart/.local/share/applications'
Tracker-Message: Flushing SPARQL buffer, reason: Queue handlers WAIT
Tracker-Message: (Sparql buffer) Finished array-update with 1 tasks
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share/applications'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share/applications" }'
Tracker-Message: Parent 'file:///home/lennart/.local/share/applications' not indexed yet
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share" }'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Processing file 'file:///home/lennart/.local/share/applications'...
(tracker-miner-fs:13616): Tracker-DEBUG: Creating new item 'file:///home/lennart/.local/share/applications'
Tracker-Message: Flushing SPARQL buffer, reason: Queue handlers WAIT
Tracker-Message: (Sparql buffer) Finished array-update with 1 tasks
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share/applications'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share/applications" }'
Tracker-Message: Parent 'file:///home/lennart/.local/share/applications' not indexed yet
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Generating children cache for URI 'file:///home/lennart/.local/share'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?url ?u {   ?u nfo:belongsToContainer ?p ;      nie:url ?url .   ?p nie:url "file:///home/lennart/.local/share" }'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: tracker-backend.vala:84: Tracker.Sparql.Backend.query_async(): 'SELECT ?s WHERE { ?s nie:url "file:///home/lennart/.local/share/applications"}'
(tracker-miner-fs:13616): Tracker-DEBUG: Processing file 'file:///home/lennart/.local/share/applications'...
(tracker-miner-fs:13616): Tracker-DEBUG: Creating new item 'file:///home/lennart/.local/share/applications'
Tracker-Message: Flushing SPARQL buffer, reason: Queue handlers WAIT
^C
Received signal:2->'Interrupt'
Tracker-Message: (Sparql buffer) Finished array-update with 1 tasks
Tracker-Message: Shutdown started
Tracker-Message: Stopping disk space check

OK

And so on and so on.
Comment 5 Lennart Poettering 2011-09-20 13:02:22 UTC
hmm, i wonder if this has something to do with the fact that /home is a crypto partition and confusingly considered ejectable by gio? Maybe tracker gets confused if $HOME appears to be on removable media?
Comment 6 Aleksander Morgado 2011-09-20 14:22:14 UTC
(In reply to comment #5)
> hmm, i wonder if this has something to do with the fact that /home is a crypto
> partition and confusingly considered ejectable by gio? Maybe tracker gets
> confused if $HOME appears to be on removable media?

Now that you have tracker 0.12.1, try to go to the new config defaults with:
 tracker-control -c

And restart tracker requesting a full reindex with:
 tracker-control -rs

We know that in tracker 0.12.0 we were indexing removable media by default, and in your case /home may get detected as removable.

Anyway, will try to reproduce your setup here.
Comment 7 Lennart Poettering 2011-09-20 15:46:02 UTC
It now loops on something else apparently:

Tracker-Message: Parent 'file:///home/lennart/Desktop' not indexed yet
Tracker-Message: Flushing SPARQL buffer, reason: Queue handlers WAIT
Tracker-Message: (Sparql buffer) Finished array-update with 1 tasks
Tracker-Message: Parent 'file:///home/lennart/Desktop' not indexed yet
Tracker-Message: Flushing SPARQL buffer, reason: Queue handlers WAIT
Tracker-Message: (Sparql buffer) Finished array-update with 1 tasks
Tracker-Message: Parent 'file:///home/lennart/Desktop' not indexed yet
Tracker-Message: Flushing SPARQL buffer, reason: Queue handlers WAIT
Tracker-Message: (Sparql buffer) Finished array-update with 1 tasks
Tracker-Message: Parent 'file:///home/lennart/Desktop' not indexed yet

and so on and so on.
Comment 8 Lennart Poettering 2011-09-20 15:46:34 UTC
(That's after the -c and the -rs).
Comment 9 Aleksander Morgado 2011-09-21 08:27:04 UTC
I tried to reproduce your exact setup (F16, encrypted home partition), and I do see that /home gets wrongly detected as removable media, we'll need to check that (new bug 659671).

But even with that issue on, I cannot reproduce the busy loop. If you can still reproduce it, it would be great if you could provide all full tracker debug logs, so that we can check the miner-fs crawling logs (not just the logs during the loop). Steps for that would be:
$> tracker-control --set-log-verbosity-level=debug
$> tracker-control -rs

And then attach to the bugreport a compressed tarball with the logs under $HOME/.local/share/tracker/

Thanks!
Comment 10 Aleksander Morgado 2011-09-21 08:28:03 UTC
> $> tracker-control --set-log-verbosity-level=debug

Wait, that line is wrong, should be:
$> tracker-control --set-log-verbosity=debug
Comment 11 Martyn Russell 2011-09-21 09:03:43 UTC
Just to add to what Aleksander said. Lennart, I know you already tried with -v 3, but with the above instructions, we can see why or if the query is failing but not being reported correctly in the tracker-store process. This should help us track down more accurately if it's the query (on the parent folder) that's failing or the update (to create the parent) instead. We do report errors normally, but we've noticed there is a condition where errors are not reported in the logs. We're working on improving this too.
Comment 12 Lennart Poettering 2011-09-21 16:35:18 UTC
So, now tracker-miner-fs doesn't do this anymore. Not sure what happened. Now it wakes up every second for nothing (which it better shouldn't do really, see https://bugzilla.gnome.org/show_bug.cgi?id=659741).

The tracker index appears to be entirely empty though, although I definitely have quite a number of files in the documents, music and pictures folder.
Comment 13 Lennart Poettering 2011-09-21 17:03:22 UTC
So, I removed ~/.cache/tracker, ~/.config/tracker and ~/.local/share and rebooted. Tracker started to reindex things and it's stuck again in a directory, but a different one now. "/home/lennart/documents/prehistoric/jufo98/dosamp" over and over and over again. MEH!
Comment 14 Lennart Poettering 2011-09-21 17:16:24 UTC
What's fun is to see how the runtime stats printed out by "tracker-control" react to this looping, the remaining time goes up and up and up... about 2s for each wallclock second
Comment 15 Lennart Poettering 2011-09-21 17:23:20 UTC
So, doing "tracker-control -rs" always appears to have the effect to get the crawling restarted and finish in a matter of 3s or so, with an empty index afterwards. Hmm, and it appears to index a number of files of $HOME.

I am a bit concerned to attach the generated log files, since they include company stuff.

For me the original problem is easily reproducible though: remove the aforementiond tracker config dirs, reboot, and miner-fs will be stuck somewhere after a while.
Comment 16 Aleksander Morgado 2011-09-22 11:18:17 UTC
> > hmm, i wonder if this has something to do with the fact that /home is a crypto
> > partition and confusingly considered ejectable by gio? Maybe tracker gets
> > confused if $HOME appears to be on removable media?
> 
> Now that you have tracker 0.12.1, try to go to the new config defaults with:
>  tracker-control -c
> 

Ok, so tracker-control -c didn't work since the switch to GSettings (bug 659806), my bad. Therefore, you're probably still having removable media indexed by default, and that, along with bug 658457 in gvfs, is still making you index /home recursively.

You can explicitly disable the removable media indexing with:
gsettings set org.freedesktop.Tracker.Miner.Files index-removable-devices false
Comment 17 Martyn Russell 2011-10-11 10:15:57 UTC
Lennart does this still happen for you with more recent versions of Tracker?
Comment 18 Tobias Mueller 2012-03-01 08:47:04 UTC
Closing this bug report as no further information has been provided. Please feel free to reopen this bug if you can provide the information asked for.
Thanks!