This has just happened again. I had documents in a collection, and now they're no longer there. Quite annoying if you've spent hours organising your docs.

For some collections, all the docs are gone, for some a couple are gone. No discernible number really. Random.

Erm. I rebooted and now the collections have disappeared altogether. Even when I select a document to add it to a collection, the collection pop up says  I don't have any collections.

Do they still appear in tracker?

tracker-search -t
should list all the local documents.

They appear in gnome-documents, but not as part of the collection any more. Should I update the summary to make this clearer?

Please, and attach the output of tracker-info on one of the files that disappeared before resetting the status of the bug.

This was one of the files:

[asinha@localhost  99_misc]$ tracker-info fncom-08-00086.pdf
Querying information for entity:'fncom-08-00086.pdf'
  'urn:uuid:f9bc7496-6eb3-6675-f851-88793415c582'
Results:
  'http://purl.org/dc/elements/1.1/contributor' = 'urn:uuid:de54fcdd-7f95-189f-9b26-7c8149682336'
  'http://purl.org/dc/elements/1.1/creator' = 'urn:uuid:de54fcdd-7f95-189f-9b26-7c8149682336'
  'http://purl.org/dc/elements/1.1/date' = '2014-08-18T07:15:17Z'
  'http://purl.org/dc/elements/1.1/date' = '2014-09-02T06:00:58Z'
  'http://purl.org/dc/elements/1.1/date' = '2014-09-02T06:01:18Z'
  'http://purl.org/dc/elements/1.1/description' = 'Without synaptic input, Purkinje neurons can spontaneously fire in a repeating trimodal pattern that consists of tonic spiking, bursting and quiescence.'
  'http://purl.org/dc/elements/1.1/format' = 'application/pdf'
  'http://purl.org/dc/elements/1.1/source' = 'http://www.tracker-project.org/ontologies/tracker#extractor-data-source'
  'http://purl.org/dc/elements/1.1/source' = 'urn:nepomuk:datasource:9291a450-1d49-11de-8c30-0800200c9a66'
  'http://purl.org/dc/elements/1.1/subject' = 'Without synaptic input, Purkinje neurons can spontaneously fire in a repeating trimodal pattern that consists of tonic spiking, bursting and quiescence.'
  'http://purl.org/dc/elements/1.1/title' = 'Intracellular calcium dynamics permit a Purkinje neuron model to perform toggle and gain computations upon its inputs'
  'nao:hasTag' = 'urn:uuid:2cc21d0c-3c49-705b-cacd-ee3b46f135f0'
  'nao:hasTag' = 'urn:uuid:46b49958-4666-a370-299b-c7c6a2ff9736'
  'nao:hasTag' = 'urn:uuid:a9d0a293-2d60-d7d1-06cc-272ebb7b655d'
  'nao:hasTag' = 'urn:uuid:df3622b0-5d25-5392-f13b-448c89328f77'
  'nao:hasTag' = 'urn:uuid:92718661-7bb5-4724-f63f-7c783dfafb6d'
  'nao:hasTag' = 'urn:uuid:3004f0cc-3825-a156-11b8-84eb1d869de5'
  'nao:hasTag' = 'urn:uuid:170098ed-2db4-570e-bd9b-646c684df19a'
  'nao:hasTag' = 'urn:uuid:5b5f0043-f3d4-5f02-6ca4-f88cac6b0adf'
  'tracker:added' = '2014-09-03T02:37:12Z'
  'tracker:modified' = '4945'
  'rdf:type' = 'http://www.w3.org/2000/01/rdf-schema#Resource'
  'rdf:type' = 'http://www.semanticdesktop.org/ontologies/2007/01/19/nie#DataObject'
  'rdf:type' = 'http://www.semanticdesktop.org/ontologies/2007/01/19/nie#InformationElement'
  'rdf:type' = 'http://www.semanticdesktop.org/ontologies/2007/03/22/nfo#Document'
  'rdf:type' = 'http://www.semanticdesktop.org/ontologies/2007/03/22/nfo#FileDataObject'
  'rdf:type' = 'http://www.semanticdesktop.org/ontologies/2007/03/22/nfo#TextDocument'
  'rdf:type' = 'http://www.semanticdesktop.org/ontologies/2007/03/22/nfo#PaginatedTextDocument'
  'nie:byteSize' = '2026507'
  'nie:dataSource' = 'http://www.tracker-project.org/ontologies/tracker#extractor-data-source'
  'nie:dataSource' = 'urn:nepomuk:datasource:9291a450-1d49-11de-8c30-0800200c9a66'
  'nie:isPartOf' = 'urn:uuid:5c76d053-8661-d911-36de-ffbda4876f51'
  'nie:url' = 'file:///home/asinha/Documents/01_Readables/99_Current_papers/99_misc/fncom-08-00086.pdf'
  'nfo:belongsToContainer' = 'urn:uuid:5c76d053-8661-d911-36de-ffbda4876f51'
  'tracker:available' = 'true'
  'nie:contentCreated' = '2014-08-18T07:15:17Z'
  'nie:description' = 'Without synaptic input, Purkinje neurons can spontaneously fire in a repeating trimodal pattern that consists of tonic spiking, bursting and quiescence.'
  'nie:informationElementDate' = '2014-08-18T07:15:17Z'
  'nie:isStoredAs' = 'urn:uuid:f9bc7496-6eb3-6675-f851-88793415c582'
  'nie:mimeType' = 'application/pdf'
  'nie:subject' = 'Without synaptic input, Purkinje neurons can spontaneously fire in a repeating trimodal pattern that consists of tonic spiking, bursting and quiescence.'
  'nie:title' = 'Intracellular calcium dynamics permit a Purkinje neuron model to perform toggle and gain computations upon its inputs'
  'nco:contributor' = 'urn:uuid:de54fcdd-7f95-189f-9b26-7c8149682336'
  'nco:creator' = 'urn:uuid:de54fcdd-7f95-189f-9b26-7c8149682336'
  'nfo:tableOfContents' = 'Intracellular calcium dynamics permit a Purkinje neuron model to perform toggle and gain computations upon its inputs Introduction section.1.1 Materials and Methods section.1.2 The Equations of the Purkinje Cell Model subsection.1.2.1 SOMA subsection.1.2.2 Dendrite—Soma Electrotonic Current (Carnevale and Hines, 2006) subsection.1.2.3 Highly TEA Sensitive K+ Current (Khaliq et al., 2003) subsection.1.2.4 Moderately TEA Sensitive K+ Current (Khaliq et al., 2003) subsection.1.2.5 TEA Insensitive K+ Current (Khaliq et al., 2003) subsection.1.2.6 P-Type Ca2+ Current (Khaliq et al., 2003) subsection.1.2.7 Hyperpolarisation Activated Cation Current (Khaliq et al., 2003) subsection.1.2.8 BK Type K+ Current (Khaliq et al., 2003) subsection.1.2.9 Leak current (Khaliq et al., 2003) subsection.1.2.10 Intracellular Ca2+ Concentration (Khaliq et al., 2003) subsection.1.2.11 Resurgent Na+ Current (Khaliq et al., 2003) subsection.1.2.12 Na+/K+ Pump (Forrest et al., 2012) subsection.1.2.13 Intracellular Na+ Concentration (Forrest et al., 2012) subsection.1.2.14 Dendrite subsection.1.2.15 T-Type Ca2+ Current (Miyasho et al., 2001) subsection.1.2.16 E-Type Ca2+ Current (Miyasho et al., 2001) subsection.1.2.17 P-Type Ca2+ Current (Miyasho et al., 2001) subsection.1.2.18 Hyperpolarisation Activated Cation Current (Saraga et al., 2003) subsection.1.2.19 A-Type K+ Current (Miyasho et al., 2001) subsection.1.2.20 M-Type K+ Current (Miyasho et al., 2001) subsection.1.2.21 D-Type K+ Current (Miyasho et al., 2001) subsection.1.2.22 Delayed Rectifier Type K+ Current (Miyasho et al., 2001) subsection.1.2.23 BK-Type K+ Current (Miyasho et al., 2001) subsection.1.2.24 K2-Type K+ Current (Miyasho et al., 2001) subsection.1.2.25 Leak Current (Miyasho et al., 2001) subsection.1.2.26 Intracellular Ca2+ Dynamics in a Spiny Dendrite Compartment (Miyasho et al., 2001) subsection.1.2.27 Intracellular Ca2+ Dynamics in a Smooth Dendrite Compartment subsection.1.2.28 SK-Type K+ Current (Incorporated in Smooth and Not Spiny Dendrite Compartments) (Moczydlowski and Latorre, 1983) subsection.1.2.29 Results section.1.3 Parallel Fiber (PF) Input Changes the Mean Frequency, but not the Pattern, of Purkinje Cell Firing in the Model subsection.1.3.1 The Purkinje Cell Model's Intracellular Ca2+ Dynamics Permit it to Replicate Toggling subsection.1.3.2 CF Input Can Produce a Tonic Firing Pattern Punctuated by Complex Spikes and Short Pauses in the Purkinje Cell Model subsection.1.3.3 CF Input Blocks the Bursting Mode, but not the Quiescent mode, of the Trimodal Firing Pattern subsection.1.3.4 In the Purkinje Cell Model, CF Input Decreases the Mean Frequency of Firing to a Range Where PF input Can Greatly Increase it, Setting the Gain of the PF Response subsection.1.3.5 Ih Activity Controls Purkinje Cell, and Purkinje Model, Activity subsection.1.3.6 Discussion section.1.4 The Purkinje Cell Model Reconciles In Vitro and In Vivo Behavior subsection.1.4.1 The Purkinje Cell Model can Perform toggle and Gain Computations Upon its Inputs subsection.1.4.2 Neural Coding subsection.1.4.3 CF input Blocks the Bursting Mode, but Not the Quiescent Mode, of the Trimodal Firing Pattern subsection.1.4.4 Ion to Network Computation subsection.1.4.5 Purkinje Cell Inputs Converge Upon the Deep Cerebellar Nuclei (DCN) subsection.1.4.6 Confusion in the Literature subsection.1.4.7 An Alternative Model of Purkinje Cell Toggling subsection.1.4.8 The Future subsection.1.4.9 Summary subsection.1.4.10 Funding section.1.5 References section.1.6 '
  'nfo:fileLastAccessed' = '2014-09-02T06:01:18Z'
  'nfo:fileLastModified' = '2014-09-02T06:00:58Z'
  'nfo:fileName' = 'fncom-08-00086.pdf'
  'nfo:fileSize' = '2026507'
  'nfo:pageCount' = '19'


[asinha@localhost  99_misc]$

It shows up in gnome-documents just fine, but not in the collection. None of the documents in the collection are in it any more and as a result, the collection isn't shown any more either - either in the main documents view, or in the list shown when you click "add to collection".

Most of my documents are just research papers from different journals.

(In reply to comment #7)
> This was one of the files:
> 
> [asinha@localhost  99_misc]$ tracker-info fncom-08-00086.pdf
> Querying information for entity:'fncom-08-00086.pdf'
>   'urn:uuid:f9bc7496-6eb3-6675-f851-88793415c582'
> Results:
>
> [...]
>
>   'nie:isPartOf' = 'urn:uuid:5c76d053-8661-d911-36de-ffbda4876f51'
>   'nie:url' =
> 'file:///home/asinha/Documents/01_Readables/99_Current_papers/99_misc/fncom-08-00086.pdf'
>   'nfo:belongsToContainer' = 'urn:uuid:5c76d053-8661-d911-36de-ffbda4876f51'

This shows that the relation (or RDF triple) between this PDF and the collection does not exist in the database. If it was then we would have seen another nie:isPartOf entry because 'urn:uuid:5c76d053-8661-d911-36de-ffbda4876f51' is the URN of the directory in which this file is located.

Are you saying that the collections that you created still exist? What is the output of the following command:
$ tracker-sparql -q "SELECT nie:title(?u) WHERE {?u a nfo:DataContainer FILTER(fn:starts-with(nao:identifier(?u), 'gd:collection'))}"

Another question. Do you have a non-system copy of tracker lying around? eg., via jhbuild. And by any chance were you running against this copy of tracker when this bug occurred?

> Are you saying that the collections that you created still exist? What is the
> output of the following command:
> $ tracker-sparql -q "SELECT nie:title(?u) WHERE {?u a nfo:DataContainer
> FILTER(fn:starts-with(nao:identifier(?u), 'gd:collection'))}"


[asinha@localhost  ~]$ tracker-sparql -q "SELECT nie:title(?u) WHERE {?u a nfo:DataContainer
> FILTER(fn:starts-with(nao:identifier(?u), 'gd:collection'))}"
Results:
  (null)
  (null)
  Current
  Herts
  UWS
  split_files
  My publications

[asinha@localhost  ~]$ 

The collections too had disappeared as I documented in comment #3. I've created new collections again now, and haven't noticed any documents going missing from them as yet.

 (In reply to comment #10)
> Another question. Do you have a non-system copy of tracker lying around? eg.,
> via jhbuild. And by any chance were you running against this copy of tracker
> when this bug occurred?

Nah. I haven't got anything built from source on my system. I've been only using packages from the repositories.

Thanks for looking into this - it's not the most reproducible bug - happens erratically. 

Warm regards,
Ankur

Comment 3 is indeed very puzzling.

I am assuming that you are using tracker-1.1.4 on F21. Is this something that has been affecting you on older versions? eg., what about tracker-1.0.2?

Finally, can you please attach your ~/.local/share/tracker/data/tracker-store.journal ?

(In reply to comment #12)
> Comment 3 is indeed very puzzling.
> 
> I am assuming that you are using tracker-1.1.4 on F21. Is this something that
> has been affecting you on older versions? eg., what about tracker-1.0.2?
> 

tracker-1.1.4-2.fc21.x86_64

Unfortunately, I wasn't using collections until recently when I started testing F21, so I can't give you a definite answer :(

> Finally, can you please attach your
> ~/.local/share/tracker/data/tracker-store.journal ?

Sure. Attached.

Too large to attach. Uploaded here:

http://ankursinha.fedorapeople.org/gnome-735864/tracker-store.journal


[asinha@localhost  ~]$ du -sh .local/share/tracker/data/tracker-store.journal
35M     .local/share/tracker/data/tracker-store.journal

Hi Debarshi,

My collections have gone again. This is all I have now:

[asinha@localhost  ~]$ tracker-sparql -q "SELECT nie:title(?u) WHERE {?u a nfo:DataContainer
FILTER(fn:starts-with(nao:identifier(?u), 'gd:collection'))}"
Results:
  (null)
  (null)
  split_files


split_files is a folder on google drive, which is why it's still here. The local collections are gone now. I've uploaded the new tracker-store.journal file here:

https://ankursinha.fedorapeople.org/gnome-735864/tracker-store-20140911.journal

I think tracker had hung up and I had used "tracker-control -e" to stop it."-e" is the soft reset and the journal and backup are supposed to be restored on restart.

Thanks,
Ankur

I believe this happened to me as well, bug 736448

(In reply to comment #15)
> I think tracker had hung up and I had used "tracker-control -e" to stop it."-e"
> is the soft reset and the journal and backup are supposed to be restored on
> restart.

This definitely looks like a tracker bug as Bastien points out. Let's continue on bug 736448

*** This bug has been marked as a duplicate of bug 736448 ***