After an evaluation, GNOME has moved from Bugzilla to GitLab. Learn more about GitLab.
No new issues can be reported in GNOME Bugzilla anymore.
To report an issue in a GNOME project, go to GNOME GitLab.
Do not go to GNOME Gitlab for: Bluefish, Doxygen, GnuCash, GStreamer, java-gnome, LDTP, NetworkManager, Tomboy.
Bug 660137 - Tracker consumes all diskspace on my user partition
Tracker consumes all diskspace on my user partition
Status: RESOLVED FIXED
Product: tracker
Classification: Core
Component: General
0.10.x
Other Linux
: Normal normal
: ---
Assigned To: tracker-general
Jamie McCracken
Depends on:
Blocks:
 
 
Reported: 2011-09-26 14:18 UTC by Deji Akingunola
Modified: 2011-10-12 14:51 UTC
See Also:
GNOME target: ---
GNOME version: ---



Description Deji Akingunola 2011-09-26 14:18:15 UTC
Originally reported in Fedora (https://bugzilla.redhat.com/show_bug.cgi?id=741007)

After I login tracker get started and shortly consumes all diskspace on my 
home partition. Since this is a limited encrypted partition this equals to
about 20GB of storage. Usually the file .cache/tracker/meta.db-wal takes all
this space.

Version-Release number of selected component (if applicable):

gnome-desktop3-3.0.1-2.fc15.x86_64
tracker-0.10.24-1.fc15.x86_64
tracker-docs-0.10.24-1.fc15.noarch
tracker-nautilus-plugin-0.10.24-1.fc15.x86_64
tracker-search-tool-0.10.24-1.fc15.x86_64

How reproducible:


Steps to Reproduce:
1. Login
2. Wait
3. Errors because home partition is out of space

Actual results:

0 available space on home partition

Expected results:
Comment 1 Jürg Billeter 2011-09-27 15:59:06 UTC
I haven't seen the WAL file ever grow that big. However, it can theoretically happen if active readers block SQLite checkpointing. I've pushed a commit to master that advises SQLite to shrink the WAL file to 10 MB as soon as possible. It does not prevent a temporarily larger WAL file, though, as SQLite does not support that. You're welcome to try whether this commit (11443fd) fixes the issue for you.

During step 2 "Wait" are you using tracker in any way besides the indexing in the background (e.g., via tracker-search-tool or nautilus)?

What directories did you configure to index? Do you have a huge data set?

Testing this with a more recent Tracker version such as the one available in Fedora 16 might help.
Comment 2 Deji Akingunola 2011-09-27 16:43:58 UTC
(In reply to comment #1)
> I haven't seen the WAL file ever grow that big. However, it can theoretically
> happen if active readers block SQLite checkpointing. I've pushed a commit to
> master that advises SQLite to shrink the WAL file to 10 MB as soon as possible.
> It does not prevent a temporarily larger WAL file, though, as SQLite does not
> support that. You're welcome to try whether this commit (11443fd) fixes the
> issue for you.
> 
> During step 2 "Wait" are you using tracker in any way besides the indexing in
> the background (e.g., via tracker-search-tool or nautilus)?
> 
> What directories did you configure to index? Do you have a huge data set?
> 
> Testing this with a more recent Tracker version such as the one available in
> Fedora 16 might help.

Quoting the OP from https://bugzilla.redhat.com/show_bug.cgi?id=741007
 
"Not using tracker besides the default background indexing when this occurs.
Just using the default storage locations in home/<my username> also.

Dataset is 22463 MB, tracker consumes all of the remaining 25372 MB and
tracker-store eventually exits. PLease note that a lot of the data is in large
files like imap folders and svn folders, not sure about the first but svn
folders should be ignored by default config.

Will try the tracker from F16 to see if that helps."
Comment 3 Martyn Russell 2011-10-11 10:15:10 UTC
Hi there, we've patched Tracker to limit the WAL file recently. Can you retry with >= 0.12.4 and let us know if this issue still exists for you?

See:

commit 11443fd7a52783fb1728e190b14875d6a82c94fc
Author: Jürg Billeter <j@bitron.ch>
Date:   Tue Sep 27 15:57:33 2011 +0200

    libtracker-data: Set journal_size_limit to 10 MB
    
    The WAL file may grow larger than that temporarily, but SQLite will
    truncate it to 10 MB as soon as it can.
Comment 4 Deji Akingunola 2011-10-12 14:51:52 UTC
The original has confirmed the fix works. Thanks.