GNOME Bugzilla – Bug 523181
Can't sync folders - escaping/unicode problem
Last modified: 2008-10-06 08:50:03 UTC
Hi, I try to backup my music collection on an extrernal usb disk using the latext svn conduit with support for external drives. It stops the sync right away with this error: [Syncronization ][INFO ] Synchronizing Wrapper: Music twoway (UID: FolderTwoWay-file:///home/nt271/Music:Music) |--> Wrapper: Backup Music twoway (UID: FolderTwoWay-file:///media/disk-2/Backups:Backup Music) (Synchronization.py:426) [DeltaProvider ][INFO ] Delta: Source (FolderTwoWay-file:///home/nt271/Music:Music) does not implement get_changes(). Proxying... (DeltaProvider.py:25) [Syncronization ][CRITICAL] UNKNOWN SYNCHRONIZATION ERROR Traceback (most recent call last):
+ Trace 192773
self.one_way_sync(self.source, sink)
added, modified, deleted = self._get_changes(source, sink)
added, modified, deleted = delta.get_changes()
allItems.append(unicode(i))
(Synchronization.py:702) [Syncronization ][DEBUG ] Syncworker state 3 (Synchronization.py:605) [dataproviders.File ][DEBUG ] Saving group (file:///media/disk-2/Backups = Backup Music) to /media/disk-2/.conduit (File.py:44) [Syncronization ][DEBUG ] Deleting worker: <SyncWorker(Wrapper: Music twoway (UID: FolderTwoWay-file:///home/nt271/Music:Music) |--> [<conduit.ModuleWrapper.ModuleWrapper instance at 0x8c1460c>], stopped)> (Synchronization.py:86)
Hi there The problem is related to unicode/escaping rather than the fact that they are mp3s ;-) Could you run something like this: find /home/nt271/Music > log.txt And attach it to this bug report. Feel free to prune any personal info that might be in the text file - but we need to see as much as possible to work out which character we aren't dealing with properly. Cheers!
Created attachment 107540 [details] Log file
Thanks for being so responsive, looking at the list I get the impression that these filenames could be problematic: /home/nt271/Music/Les Cowboys Fringants/Les insucces en spectacle /home/nt271/Music/Les Cowboys Fringants/Les insucces en spectacle/09 - Les InsuccÚs en spectacle - M'a vivre avec toi.mp3 /home/nt271/Music/Les Cowboys Fringants/Les insucces en spectacle/13 - Les InsuccÚs en spectacle - La Noce.mp3 /home/nt271/Music/Les Cowboys Fringants/Les insucces en spectacle/11 - Les InsuccÚs en spectacle - Les routes du bonheur.mp3 /home/nt271/Music/Les Cowboys Fringants/Les insucces en spectacle/03 - Les InsuccÚs en spectacle - Cass de pouëlle.mp3 /home/nt271/Music/Les Cowboys Fringants/Les insucces en spectacle/14 - Les InsuccÚs en spectacle - Plattsburg.mp3 /home/nt271/Music/Les Cowboys Fringants/Les insucces en spectacle/08 - Les InsuccÚs en spectacle - Rue Chapdelaine.mp3 /home/nt271/Music/Les Cowboys Fringants/Les insucces en spectacle/06 - Les InsuccÚs en spectacle - Ãvangeline.mp3 /home/nt271/Music/Les Cowboys Fringants/Les insucces en spectacle/01 - Les InsuccÚs en spectacle - Voir du pays.mp3 /home/nt271/Music/Les Cowboys Fringants/Les insucces en spectacle/12 - Les InsuccÚs en spectacle - Gaetane.mp3 /home/nt271/Music/Les Cowboys Fringants/Les insucces en spectacle/10 - Les InsuccÚs en spectacle - Le reel de la patate pilée.mp3 /home/nt271/Music/Les Cowboys Fringants/Les insucces en spectacle/05 - Les InsuccÚs en spectacle - Les bons légumes.mp3 /home/nt271/Music/Les Cowboys Fringants/Les insucces en spectacle/07 - Les InsuccÚs en spectacle - Graseille.mp3 /home/nt271/Music/Les Cowboys Fringants/Les insucces en spectacle/02 - Les InsuccÚs en spectacle - La Culbute.mp3 /home/nt271/Music/Les Cowboys Fringants/Les insucces en spectacle/04 - Les InsuccÚs en spectacle - Tendresse-Paul.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 2 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 2/11 - Attache Ta Tuque Disc 2 - Impala Blues.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 2/06 - Attache Ta Tuque Disc 2 - Su' Mon Big Wheel (C'tait l'Fun).mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 2/12 - Attache Ta Tuque Disc 2 - En Berne.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 2/05 - Attache Ta Tuque Disc 2 - Robert Bob Bourgouin.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 2/07 - Attache Ta Tuque Disc 2 - Awikatchikaën.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 2/15 - Attache Ta Tuque Disc 2 - Un P'tit Tour.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 2/10 - Attache Ta Tuque Disc 2 - Le Roi Katshé (Part 2).mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 2/08 - Attache Ta Tuque Disc 2 - Le Roi Katshé (Part 1).mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 2/01 - Attache Ta Tuque Disc 2 - La Manifestation.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 2/03 - Attache Ta Tuque Disc 2 - Banlieue.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 2/13 - Attache Ta Tuque Disc 2 - L' Hiver Approche.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 2/02 - Attache Ta Tuque Disc 2 - Maurice au Bistro.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 2/09 - Attache Ta Tuque Disc 2 - Joyeux Calvaire.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 2/14 - Attache Ta Tuque Disc 2 - La Toune Cachée.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 2/04 - Attache Ta Tuque Disc 2 - La Sainte Paix.mp3 /home/nt271/Music/Les Cowboys Fringants/Sur mon canapé /home/nt271/Music/Les Cowboys Fringants/Sur mon canapé/08 - Sur mon canapé... - Le quai de Berthier.mp3 /home/nt271/Music/Les Cowboys Fringants/Sur mon canapé/12 - Sur mon canapé... - Banlieue.mp3 /home/nt271/Music/Les Cowboys Fringants/Sur mon canapé/02 - Sur mon canapé... - Le Plombier.mp3 /home/nt271/Music/Les Cowboys Fringants/Sur mon canapé/10 - Sur mon canapé... - La Gosse à Comeau.mp3 /home/nt271/Music/Les Cowboys Fringants/Sur mon canapé/06 - Sur mon canapé... - Denise Martinez.mp3 /home/nt271/Music/Les Cowboys Fringants/Sur mon canapé/04 - Sur mon canapé... - Maurice Au Bistro.mp3 /home/nt271/Music/Les Cowboys Fringants/Sur mon canapé/05 - Sur mon canapé... - Goldie.mp3 /home/nt271/Music/Les Cowboys Fringants/Sur mon canapé/07 - Sur mon canapé... - Mon pays (reel des Aristocrates).mp3 /home/nt271/Music/Les Cowboys Fringants/Sur mon canapé/09 - Sur mon canapé... - Grosse femme.mp3 /home/nt271/Music/Les Cowboys Fringants/Sur mon canapé/01 - Sur mon canapé... - Marcel Galarneau.mp3 /home/nt271/Music/Les Cowboys Fringants/Sur mon canapé/11 - Sur mon canapé... - La Culbute.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 1 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 1/10 - Attache Ta Tuque Disc 1 - Le Plombier.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 1/05 - Attache Ta Tuque Disc 1 - Salut Mon Ron!.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 1/01 - Attache Ta Tuque Disc 1 - Heavy Metal.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 1/11 - Attache Ta Tuque Disc 1 - Toune d'Automne.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 1/02 - Attache Ta Tuque Disc 1 - Québécois de Souche.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 1/08 - Attache Ta Tuque Disc 1 - Léopold.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 1/09 - Attache Ta Tuque Disc 1 - Le Shack à Hector.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 1/03 - Attache Ta Tuque Disc 1 - Le Pouceux.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 1/13 - Attache Ta Tuque Disc 1 - Le Reel des Aristocrates.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 1/12 - Attache Ta Tuque Disc 1 - Mon Pays.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 1/06 - Attache Ta Tuque Disc 1 - Le Temps Perdu.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 1/07 - Attache Ta Tuque Disc 1 - Le Gars d'La Compagnie.mp3 /home/nt271/Music/Les Cowboys Fringants/Attache Ta Tuque Disc 1/04 - Attache Ta Tuque Disc 1 - Mom Chum Rémi.mp3 /home/nt271/Music/Les Cowboys Fringants/12 Grandes Chansons /home/nt271/Music/Les Cowboys Fringants/12 Grandes Chansons/09 - 12 Grandes Chansons - Gaétane.mp3 /home/nt271/Music/Les Cowboys Fringants/12 Grandes Chansons/04 - 12 Grandes Chansons - Cass de pouëlle.mp3 /home/nt271/Music/Les Cowboys Fringants/12 Grandes Chansons/10 - 12 Grandes Chansons - Repentigny-by-the-sea.mp3 /home/nt271/Music/Les Cowboys Fringants/12 Grandes Chansons/03 - 12 Grandes Chansons - Ãvangéline.mp3 /home/nt271/Music/Les Cowboys Fringants/12 Grandes Chansons/11 - 12 Grandes Chansons - Le hurlot.mp3 /home/nt271/Music/Les Cowboys Fringants/12 Grandes Chansons/07 - 12 Grandes Chansons - Plattsburg.mp3 /home/nt271/Music/Les Cowboys Fringants/12 Grandes Chansons/02 - 12 Grandes Chansons - Awikachikaën.mp3 /home/nt271/Music/Les Cowboys Fringants/12 Grandes Chansons/08 - 12 Grandes Chansons - Willie Jos Hachey.mp3 /home/nt271/Music/Les Cowboys Fringants/12 Grandes Chansons/05 - 12 Grandes Chansons - L'Agacepésie.mp3 /home/nt271/Music/Les Cowboys Fringants/12 Grandes Chansons/06 - 12 Grandes Chansons - Dieudonné Rastapopoulos.mp3
Yes, unicode() chokes on those symbols quite badly... For now, could you move that artist out of the way and see if it works otherwise?
Well I've been fixing up tags for an hour, and it still doesn't sync. I guess there will always be a few wrong tags and I can't find all of them unfortunately. I think it is still a bug though as there is no explanation given by conduit on the error, or ways to find the offending files.
Of course, I was just trying to get it working right now instead of you having to wait for another release...
Created attachment 107564 [details] [review] Possible fix Does this patch fix your problem?
This problem has been fixed in the development version. The fix will be available in the next major software release. Thank you for your bug report.
Thanks for fixing this bug. I'm still getting problems with filename which contain a # sign: [datatypes.File ][DEBUG ] Transfering File file:///home/nt271/Music/Zunior/Compilation April 2007/09. Various - Rooster Jam #1.mp3 -> file:///media/disk/Music/Zunior/Compilation April 2007/09. Various - Rooster Jam #1.mp3 (File.py:294) [Syncronization ][CRITICAL] UNKNOWN SYNCHRONIZATION ERROR Traceback (most recent call last):
+ Trace 193234
self._put_data(source, sink, data, dataRid)
put_data(source, sink, sourceData, sourceDataRid, False)
sinkDataLUID)
vfsFile.transfer(newURI, True)
data=cancel_function
(Synchronization.py:702) [Syncronization ][DEBUG ] Syncworker state 3 (Synchronization.py:605) [dataproviders.DataProvider][DEBUG ] Change detected in dataproviders data (file:///media/disk/Music:Music) (DataProvider.py:76)
Are you running SVN or the 0.3.9 release?
I'm running svn
Note to self: http://farmdev.com/talks/unicode/
Unfortunately, I still have that same issue with # signs in song names. It makes it very difficult to keep my home folder in sync with my backup drive. Thanks again fro your hard work. version: 0.3.13.1 from your PPA in Intrepid
This problem has been fixed in our software repository. The fix will go into the next software release. Thank you for your bug report. With the transition to GIO, I was able to fix this, I think. Testing with the 5000 file song list you sent me, I was able to copy all 5000 items from one location to another, with no loss of information in the filenames.
Great! Thanks for your hard work, very appreciated!