After an evaluation, GNOME has moved from Bugzilla to GitLab. Learn more about GitLab.
No new issues can be reported in GNOME Bugzilla anymore.
To report an issue in a GNOME project, go to GNOME GitLab.
Do not go to GNOME Gitlab for: Bluefish, Doxygen, GnuCash, GStreamer, java-gnome, LDTP, NetworkManager, Tomboy.
Bug 653260 - If "Copy to media folders" option is enabled, importing skips files and/or duplicates tracks
If "Copy to media folders" option is enabled, importing skips files and/or du...
Status: RESOLVED WONTFIX
Product: banshee
Classification: Other
Component: Importing
2.6.0
Other Linux
: Normal major
: ---
Assigned To: Banshee Maintainers
Banshee Maintainers
gnome[unmaintained]
: 684486 687337 689137 (view as bug list)
Depends on:
Blocks:
 
 
Reported: 2011-06-23 17:38 UTC by tensai
Modified: 2020-03-17 09:31 UTC
See Also:
GNOME target: ---
GNOME version: ---


Attachments
banshee --debug (32.28 KB, text/plain)
2011-06-23 17:38 UTC, tensai
Details
imported music folder structure (2.76 KB, text/plain)
2011-06-23 17:39 UTC, tensai
Details

Description tensai 2011-06-23 17:38:40 UTC
Created attachment 190521 [details]
banshee --debug

Fedora 15
Banshee 2.0.1

Banshee tuned to copy all files to ~/Music on import

When importing music from folders, banshee sometimes dublicates records in db (seems actually it imports file twice) and skips another files. Here is log and dump of actual imported folder.

After importing music i performed library i rescanned music library to remove dupes from album view, and manually added missing tracks.

Dupes: 04.recognizer, 05.armory, 07.rinzler and missed tracks 03,04,05 from Cd2
Comment 1 tensai 2011-06-23 17:39:27 UTC
Created attachment 190522 [details]
imported music folder structure
Comment 2 Ismael Olea 2011-10-03 17:41:41 UTC
same here.
Comment 3 Ismael Olea 2011-10-09 11:50:29 UTC
it happens importing from CD too.
Comment 4 Ismael Olea 2011-12-31 11:21:16 UTC
Importing from dupes at the db with 2.2.1
Comment 5 Ismael Olea 2011-12-31 11:53:05 UTC
Importing from _CD_ dupes _songs_ at the db with 2.2.1

Sorry my bad comment.
Comment 6 Carlos Sánchez López 2012-11-27 04:01:04 UTC
I can confirm this bug in Banshee version 2.4.0

Whenever I want to import a directory, some tracks are skipped. I have to reimport them. Fortunately, if no tags were changed, the duplicates are going to be detected and will not be reimported, only the missing ones.

Also, sometimes if I import multiple directories at once, some tracks are imported twice. I've checked, and they are not physically duplicated, only on the database, and hence, shown twice in the playlists. I have to select "Rescan Music Library" to check and delete duplicate entries in the database.

I have the "Copy files to media folders when importing" File Policy activated in Preferences, if its important.
Comment 7 Ismael Olea 2013-04-17 09:41:16 UTC
*** Bug 689137 has been marked as a duplicate of this bug. ***
Comment 8 Andrés G. Aragoneses (IRC: knocte) 2013-04-17 09:51:31 UTC
*** Bug 687337 has been marked as a duplicate of this bug. ***
Comment 9 Andrés G. Aragoneses (IRC: knocte) 2013-04-17 09:52:02 UTC
*** Bug 684486 has been marked as a duplicate of this bug. ***
Comment 10 cidthecoatrack 2013-04-17 11:56:21 UTC
Still a bug in 2.6.0
Comment 11 Andrés G. Aragoneses (IRC: knocte) 2013-04-17 22:28:25 UTC
(In reply to comment #10)
> Still a bug in 2.6.0

We need more info so one of the developers can reproduce this, guys.

Could you try to reduce the problem to a minimal testcase? Let's say: wipe your database (do a backup first), then import a track (only one), and then try to import it again. If that doesn't make the bug appear, try with a bigger set of files, until you find one for which it happens always. Then you tell us more details about where the file is, what folder do you import, etc, ok?

Also, couple of questions:

(In reply to comment #6)
> I have the "Copy files to media folders when importing" File Policy activated
> in Preferences, if its important.

Carlos, thanks for telling us about this. However, it's more important to know if disabling that preference makes the bug disappear? Can you test?


(In reply to comment #0)
> Here is log and dump of actual imported folder.

tensai, this log shows that you're using the LibraryWatcher extension. Can you tell us please if the bug disappears when you disable the LibraryWatcher extension?

Thanks
Comment 12 checoimg 2013-04-17 23:22:52 UTC
It is not a bug for me in Ubuntu 13.04 version 2.6.0
Comment 13 Andrés G. Aragoneses (IRC: knocte) 2013-04-17 23:26:46 UTC
(In reply to comment #12)
> It is not a bug for me in Ubuntu 13.04 version 2.6.0

Alright thanks. Leaving the NEEDINFO status to wait for cidthecoatrack's feedback.
Comment 14 cidthecoatrack 2013-04-18 12:15:53 UTC
Have wiped and tried to import.  Even importing a single track is inconsistent - sometimes it imports, sometimes it doesn't.  Stepped up tracks, still high inconsistency.  In the end, I could import a whole album, but only 2 tracks would actually be imported.  Turning off the library watcher did not solve the issue.
Comment 15 Andrés G. Aragoneses (IRC: knocte) 2013-04-18 12:17:34 UTC
Can you tell us where (in which path) you have those tracks, and can you send me by email 3 of them so I can try to reproduce the issue in my computer?
Comment 16 cidthecoatrack 2013-04-18 12:36:19 UTC
My music library is here:

/media/derpy/Storage MPD/Music

And the files I tried to import were here:

/home/derpy/Downloads/Torrents/The Puppini Sisters - The Rise and Fall of Ruby Woo

I will email three of the tracks to you.
Comment 17 Carlos Sánchez López 2013-04-18 16:11:44 UTC
Hello again,

Sorry for answering late.

> Carlos, thanks for telling us about this. However, it's more important to know
if disabling that preference makes the bug disappear? Can you test?

I can confirm that disabling the feature "Copy files to media folders when importing" gets rid of the problem. The songs are all imported once into the database, no duplicates and no skips. As soon as I enable the feature again and import any multiple songs at once, the problem reappears.

It happens with any group of songs imported at once. It doesn't matter if they are from the same album or unrelated. What I've noticed is that usually the songs that will be skipped or duplicated are not the first or the last, only songs in the middle of the selected group. Maybe this is important.

You can all reproduce the bug very easily:

1. Enable the "Copy files to media folders when importing" preference.

2. Import music, either selecting many files at once, or selecting a directory. If possible, import more than 10 at once, the more you import, the more probable the bug will sow up. Also, if you can import songs from the same album it would be easier for you to detect the tracks that were not imported, by looking at the track number (if those files happen to be correctly tagged).

3. Check in your Music directory which tracks were copied and which weren't. Most of the time, the physical files will be imported without problem (only once and no duplicates/skips). The bug will normally arise in the banshee database, where you will see that there are duplicates or skips.

4. Rescan your music library. Normally the problem will be corrected this way, the duplicates/skips will be removed/added respectively and the problem will disappear. But sometimes, and I don't know why, the songs will not be physically copied or will be physically duplicated, which will complicate the problem.

I hope this is enough information for you. If you need more, please let me know.
Comment 18 Andrés G. Aragoneses (IRC: knocte) 2013-04-18 16:27:54 UTC
Thanks so much for all the info guys.

But I have more questions.

This one for Carlos: do you have the LibraryWatcher extension enabled?

And these two for cidthecoatrack (btw thanks for the files, I'll try to reproduce it tonight):
a) do you have the preference "Copy files to media folders when importing" enabled like Carlos?
b) do you have the LibraryWatcher extension enabled?
Comment 19 Carlos Sánchez López 2013-04-18 16:31:24 UTC
Oh I get it. I thought you were asking me if I had enabled the "Copy files to media folders when importing" feature.

Let me do some tests with and without the LibraryWatcher extension enabled. Now that I remember, at first I suspected that the problem may have been caused by that extension.

Sorry for not mentioning it before, it was long ago since I submitted my first comment here.
Comment 20 Andrés G. Aragoneses (IRC: knocte) 2013-04-18 16:45:56 UTC
(In reply to comment #19)
> Oh I get it. I thought you were asking me if I had enabled the "Copy files to
> media folders when importing" feature.

Yes, I asked you that. But now I asked a new question :)
Comment 21 Carlos Sánchez López 2013-04-18 17:01:17 UTC
I just answered. I am going to test with and without the LibraryWatched extension enabled. As soon as I get the results, I'll let you know.
Comment 22 cidthecoatrack 2013-04-18 21:30:45 UTC
I do have the "copy to media folders" option enabled.  With that option enabled, with and without the library watcher made no difference - the bug still appeared.
Comment 23 pokulo 2014-12-10 13:21:44 UTC
The bug still appears on nearly every import! My secound harddrive (for music) is very slow and the source location is an ssd (so fast). 

The preference "Copy files to media folders when importing" enabled is enabled.
The LibraryWatcher extension is enabled.

It appears to be a weakly synchronized threaded import loop. Any guesses?
Comment 24 André Klapper 2020-03-17 09:31:17 UTC
Banshee is not under active development anymore and had its last code changes more than three years ago. Its codebase has been archived.

Closing this report as WONTFIX as part of Bugzilla Housekeeping to reflect
reality. Please feel free to reopen this ticket (or rather transfer the project
to GNOME Gitlab, as GNOME Bugzilla is being shut down) if anyone takes the
responsibility for active development again.
See https://gitlab.gnome.org/Infrastructure/Infrastructure/issues/264 for more info.