GNOME Bugzilla – Bug 447979
Not all files transfered when copying directories
Last modified: 2018-07-01 08:37:08 UTC
Hello, I noticed that gFTP is not always copying all the files to the remote machine when I ask it to transfer a local directory. The directory is created remotely, a couple of files are tranfered in it but not the whole bunch. It seems to happen with directories with more than 10 files or so (not sure about the exact count though). If I try to transfer the directory again, the same files get tranfered and the others not. If I enter the directory both locally and remotely then I can copy ALL the files by selecting them manually. Regards
Is there something particular about the files that are transferred and the files that are not? Can you provide a directory listing, including permissions (i.e. ls -la) of the directory containing the files?
Hi, I could not reproduce the problem with the test cases I made. All the files I transfer are generated and have the same permissions (644). I don't think there is anything particular about the files that are tranfered and these that are not (all plain jpg images and html pages). I'll send more information if I get the problem again. Cheers
Well, I managed to reproduce the bug when transfering stuff "for real" (demo effect?). Here is what I wanted to transfer: $ ll -d newwork/ drwx------ 2 aline aline 4096 2007-12-15 17:58 newwork/ $ ll newwork/ total 1492 lrwxrwxrwx 1 aline aline 16 2007-12-15 18:13 images -> ../../web-images -rw-r--r-- 1 aline aline 1428 2007-12-15 18:13 index.php -rw-r--r-- 1 aline aline 118927 2007-12-15 17:58 _mg_18544_medium.jpg -rw-r--r-- 1 aline aline 135 2007-12-15 18:13 _mg_18544.php -rw-r--r-- 1 aline aline 27659 2007-12-15 17:58 _mg_18544_thumbnail.jpg -rw-r--r-- 1 aline aline 88071 2007-12-15 17:57 _mg_19543-cs3-2-crop-blue_medium.jpg -rw-r--r-- 1 aline aline 159 2007-12-15 18:13 _mg_19543-cs3-2-crop-blue.php -rw-r--r-- 1 aline aline 21344 2007-12-15 17:57 _mg_19543-cs3-2-crop-blue_thumbnail.jpg -rw-r--r-- 1 aline aline 150861 2007-12-15 17:57 _mg_19555-cr3_medium.jpg -rw-r--r-- 1 aline aline 174 2007-12-15 18:13 _mg_19555-cr3.php -rw-r--r-- 1 aline aline 27779 2007-12-15 17:57 _mg_19555-cr3_thumbnail.jpg -rw-r--r-- 1 aline aline 58225 2007-12-15 17:57 _mg_19637-cs3-retouched3_medium.jpg -rw-r--r-- 1 aline aline 171 2007-12-15 18:13 _mg_19637-cs3-retouched3.php -rw-r--r-- 1 aline aline 18192 2007-12-15 17:57 _mg_19637-cs3-retouched3_thumbnail.jpg -rw-r--r-- 1 aline aline 57750 2007-12-15 17:58 _mg_19705-cs3-higher-3_medium.jpg -rw-r--r-- 1 aline aline 163 2007-12-15 18:13 _mg_19705-cs3-higher-3.php -rw-r--r-- 1 aline aline 19364 2007-12-15 17:57 _mg_19705-cs3-higher-3_thumbnail.jpg -rw-r--r-- 1 aline aline 124756 2007-12-15 17:57 _mg_19782_medium.jpg -rw-r--r-- 1 aline aline 139 2007-12-15 18:13 _mg_19782.php -rw-r--r-- 1 aline aline 35489 2007-12-15 17:57 _mg_19782_thumbnail.jpg -rw-r--r-- 1 aline aline 137934 2007-12-15 17:57 _mg_19799_medium.jpg -rw-r--r-- 1 aline aline 139 2007-12-15 18:13 _mg_19799.php -rw-r--r-- 1 aline aline 32876 2007-12-15 17:57 _mg_19799_thumbnail.jpg -rw-r--r-- 1 aline aline 153960 2007-12-15 17:57 _mg_19801_medium.jpg -rw-r--r-- 1 aline aline 139 2007-12-15 18:13 _mg_19801.php -rw-r--r-- 1 aline aline 30596 2007-12-15 17:57 _mg_19801_thumbnail.jpg -rw-r--r-- 1 aline aline 155607 2007-12-15 17:57 _mg_19826_medium.jpg -rw-r--r-- 1 aline aline 155 2007-12-15 18:13 _mg_19826.php -rw-r--r-- 1 aline aline 38419 2007-12-15 17:57 _mg_19826_thumbnail.jpg And here is what actually got transfered: newwork/ newwork/_mg_18544_thumbnail.jpg newwork/_mg_19543-cs3-2-crop-blue_thumbnail.jpg newwork/_mg_19782_thumbnail.jpg newwork/_mg_19799_medium.jpg newwork/_mg_19826.php I tried to change the input directory on the local to mode 755 (and to restart gftp) but exactly the same files got transfered. If I enter the input directory and transfer all the files, it works fine.
Hi, classical 'me too' comment. Noticed when transfer big, structured directory tree with many levels. All structure on target machine is created, many files transfered but not all. Some final directories remain empty, without any error msg. When copied manually, it's all OK, even if they are copied as subdirectories of level 2-3. But as level 6 remains empty. Copied complete /home/user/*, with reported 3000+ files, some final dirs at level 6, almost all with *.png files remained empty. Hope it helps regards Pietro
I attempted a transfer of a local directory containing 50 JPG files to a linux hosted account on Godaddy. The folder was created with NO ACCESS - chmod of zero. Obviously the files could not be created after that and the native web based file manager was required to clean up the mess. Whatever Absolute FTP [ an ancient windows gui ftp program] does works reliably with godaddy. gFTP is reliable when transferring bucket loads of JPG files if the folders are already created. I'll see if I can create a log and post it here as well.
When attempting to recreate the problem, the directories were consistently created with 555 rather than the normal 755 so the transfers obviously failed. THere is no way to cleanly stop a transfer once it is started. The STOP button at the right is gray. The log is lost if you stop and restart the connection. Not sure if Transfers >> Stop the Transfer will stop a long series or not. But the STOP button at the right could stop a long series and leave the log and connection alone. I'll report this as an enh request. I have determined the problem. I had copied the folders from a CDROM and they were 555 so this was preserved when doing the FTP transfer. This will obviously cause failures. So, when copying stuff from CDROM enmass, the file system must be smart and make the folder 755 until the copy is complete and then make it 555 to preserve the way it looks on the CDROM. However gFTP is not that smart, so the copy fails.
gftp is not under active development anymore and has not seen code changes for many years. Its codebase has been archived: https://gitlab.gnome.org/Archive/gftp/commits/master The maintainer states that "I would like to hand this project off to someone compotent" on https://www.gftp.org/ Closing this report as WONTFIX as part of Bugzilla Housekeeping to reflect reality. Please feel free to reopen this ticket (or rather transfer the project to GNOME Gitlab, as GNOME Bugzilla is deprecated) if anyone takes the responsibility for active development again.