Multi-threaded file copy, RichCopy
Keith Combs convinced me to start blog (https://blogs.technet.com/keithcombs/). What for? I often receive e-mails asking about RichCopy, but it changed when Joshua Hoffman wrote an article about RichCopy in TechNet Magazine, April, 2009 issue. (https://technet.microsoft.com/en-us/magazine/2009.04.utilityspotlight.aspx) Keith covered this in his article, and consequently got tons of question on his blog (https://blogs.technet.com/keithcombs/archive/2009/03/22/richcopy-bulk-file-copy-tool-released-get-it-here.aspx). If I understand correctly, he screamed for help “I am not a support contact of RichCopy”, and asked me to start bloging on the TechNet.
What is RichCopy? Please visit Keith’s blog and 2009.4 issue of TechNet magazine. RichCopy was originally developed more than 10 years ago when I was working on Exchange Server 4.0 (a.k.a Touchdown project) and some other projects as a development lead. One of painful job was to copying latest build to my test machines over slow and large latency network. 10M bps was still majority of edge switches and NetBEUI as protocol at that time. RichCopy was developed to address those issues, especially to put another layer of packet transaction window. In my blogs, I will cover best practice of RichCopy configuration, QA, and I will also write about implementation for example how RichCopy supports over 64 threads while WaitForMultipleObjectEx() does not support more than 64 threads (MAXIMUM_WAIT_OBJECTS).
Comments
Anonymous
January 01, 2003
Ken, I am using your RichCopy tool and have a few questions 1)Can I use MS Premier support if I have a problem with the tool? 2)We have data on the NAS and the NAS rounds down timestamp values to seconds a.Robocopy uses the millisecond level timestamp and this causes files to always be copied, regardless of timestamp b.In Robocopy, if I use the /FFT switch (assume FAT File Times, 2-second granularity), we work around this problem ii. Does something like this exist in RichCopy?Anonymous
January 01, 2003
I see many folks are looking for the newest version that fixes the ACL issue. I would like to add my voice to that choirs. This an OK tool to me but will be awesome if I brings the security over as it is supposed to. Anyone know if there is a fixed version and if so, where to get it?Anonymous
January 01, 2003
The comment has been removedAnonymous
January 01, 2003
Ken, First off - Excellent job! Second - I can't seem to get the ACL's to copy, like others I've read about - I am using the latest version, all NTFS - any ideas? Is there workaround for it? Thanks, MarkAnonymous
January 01, 2003
any idea when the internal version where the ACL bug is fixed will be released? It would be rather cool to use RichCopy as opposed to RobocopyAnonymous
January 01, 2003
The comment has been removedAnonymous
January 01, 2003
The comment has been removedAnonymous
January 01, 2003
I discover something new. If I copy the files for the first time, the ACL is not copied. However, if I repeat the copy, ACL will be copied.Anonymous
January 01, 2003
has anybody successfully executed this via a batch file? could you post an example? i need to run this over a WAN link so any advise parameter wise would be appreciated. i need to run this as a scheduled task so i could run it on a regular basis. unfortunately the timer only facilitates 1 event. will this work on a 64bit 2008 server? i saw that the program directory included richCopy64.exe. i wanted to try it out on a 32bit 2k3 server first, but would prefer to run it on their 2k8 server if possible. TIA ~Jim RockAnonymous
January 01, 2003
I'm currently looking at v4.0.217.0. In help - copy option - method - consolidate multiple sources, I think the top graphic belongs with the bottom text and vice versa. I am trying to copy folders from a 2003R2 share via mapped drive M: on a 2008SP1 server. RichCopy is running on the 2008SP1 server. If I select a single folder as source e.g M:data and specify a drive as destination e.g E: the copy shows "copy start" and never completes or copies anything. If I select multiple folders from M: and destination E: I get error 87, The parameter is incorrect. If I create the destination folder first I can successfully copy single folders. I cannot see at all how to correctly specify the destination for multiple folder copy (not consolidated). Love the speed though.Anonymous
January 01, 2003
You say above that 216 fixed the permissions copy issue and I have even found 217 on a site and neither have fixed the issue. What is the trick to getting this to work?Anonymous
January 01, 2003
KEN, CAN WE AT LEAST GET AN ACKNOWLEDGMENT THAT YOUR READING THIS BLOG????Anonymous
January 01, 2003
The comment has been removedAnonymous
January 01, 2003
The comment has been removedAnonymous
January 01, 2003
Can anyone tell me how to copy the source folder. users$ -name1 --folder1 --files1 -name2 --folder2 --files2 -name3 --folder3 --files3 I would like to copy name1 and all the files and folder under it. When I try to copy name1 and files1 and folder1 under it to the destination location I only manage to copy the files1 and folders1 but not the source folder which shold be name1. Thx alotAnonymous
January 01, 2003
Hello, I need help... I think this App will do what I want, but I can't get it to work. I have one Source folder and many Destination folders. Each Destination folder needs to contain the entire contents of the Source or just a few files. I only want to copy files from the Source to the Destination, if the file already exists in the Destination. Also, there are files in the Destination folders that Don’t exist in the Source, and they need to stay intact. Thanks in advance for your help. SteveAnonymous
January 01, 2003
Ken, First off - Excellent job! Second - I can't seem to get the ACL's to copy, like others I've read about - I am using the latest version, all NTFS - any ideas? Is there workaround for it? Thanks, MarkAnonymous
January 01, 2003
I can't find RichCopy on Microsoft's download site. The only version I find is linked to the technet article. I'd like an updated one that fixes the ACL/DACL issue. Any idea when it'll be released? Can someone post a link to the updated RichCopy? The buggy version I currently have installed is 4.0.211Anonymous
January 01, 2003
The comment has been removedAnonymous
January 01, 2003
Same problem with ACL on Windows 2003 R2. Tried all suggestion above, no avail. Two other problems: 1.The log says that it copies more files than the source, however, checking on the "Properties" of the root folder, the number is the same on both destination and source. 2.Setting file copy thread to 2 sometimes would cause problem (Error code 32) on the destination file.Anonymous
January 01, 2003
How can I use RichCOpy to monitor Files & Directory change? I need this to poprompt a file copy process once there is a certain change in a folder or file.Anonymous
January 01, 2003
The comment has been removedAnonymous
January 01, 2003
I am try to backup roaming profiles and I can't do it using RichCopy. I currently use Xcopy which allows you to ignore permisions when copying. Can anyone help with this.Anonymous
January 01, 2003
Hello Ken, great tool. But there is one problem by copy a bunch of files from a NTFS filesystem to a NAS filesystem like EXT3. Does richcopy considers the "2-seconds-granularity" btw the files on different filesystem like NTFS and EXT3? Richcopy means during an update copy !all! files from the source are newer than the files within the destination.Anonymous
January 01, 2003
PingBack from http://www.netdeluxo.com/blog/blogs/ken-tamarus-blog-multi-threaded-file-copy-richcopy/Anonymous
January 01, 2003
The comment has been removedAnonymous
January 01, 2003
The comment has been removedAnonymous
January 01, 2003
The comment has been removedAnonymous
January 01, 2003
Hi, I just stumbled upon your application and I love it! However, I might have discovered a (somewhat) major bug in the program. I was trying to mirror the contents from C:ABC (source) to H:XYZ (destination), therefore I selected the "purge" option. I deleted some files off of C:ABC before running the app, and when I ran it, in the status window I got messages saying "purging: C:ABC"!! I was horrified as I thought the program was deleting files off my source folder, however when I checked the folders after the process had finished, I realised the app functioned as intended, deleting files off of H:XYZ. Even though the function worked, I still think the message in the status window needs to be fixed, as it has to relay accurate messages or else it'd give its users a big scare!Anonymous
January 01, 2003
Hi, is it possible to do incremental backups with RichCopy? If yes, please let me know how. Many thanks. Beto.Anonymous
January 01, 2003
The comment has been removedAnonymous
January 01, 2003
This is a great utility but for one small problem... the timer doesn't work which is a pain 'cause I need to move 55gb from one server to another and it can only start after 7.00pm :( Any fix for this? thanks Tracy.Anonymous
January 01, 2003
The comment has been removedAnonymous
January 01, 2003
Hi Ken, Any luck with fixing the wildcards when executed from a batch file? Thanks for the great tool.Anonymous
January 01, 2003
The comment has been removedAnonymous
January 01, 2003
For info, I had to disable User Account Control (UAC) for the ACL 's to copy. I hope this can help. Thanks to Ken for a very nice tool. FongenAnonymous
January 01, 2003
Hey there, if you are still reading here ... Great tool, you know that by now. A thing that gives me a headache is the help file included in the package. Could you convince somebody at M$ to proofread it and make it a bit more understandable? This tool really deserves a good documentation. ThanksAnonymous
September 28, 2010
Is there a way to minimize the Splash screen? The machine this I'm running this on has multiple users that are using it and I'm trying to get this to run in the background executing a shell command from a vb.net application. Any help would be greatly appreciated!Anonymous
November 24, 2010
I am a new user. Is there an examples document, manual? Like I want to copy the folders on my V: drive to D:c-11242010... all folders and files on "V:" to the target, keep dates and whatever the same. what are my desired options? Thanks in advance /s/ FrankAnonymous
December 02, 2010
The comment has been removedAnonymous
December 02, 2010
The comment has been removedAnonymous
February 02, 2011
The bug that Europa2010AD mentions also shows in the log files: The log entries for purged files incorrectly show them as if RichCopy purged them from the source directory. I agree that looks scary, please fix for next release.Anonymous
April 21, 2011
I agree with that. At home I use Roadkil's Unstoppable Copier which is an other copy manager that copies, moves and recovers files from damaged disks. bstdownload.com/.../roadkils-unstoppable-copier-5Anonymous
June 24, 2011
I tried richcopy using the GUI interface, selected the source folder of d:mainsubfoldersubfolder and the destination of e:targetsubfoldersubfolder and noticed that upon completion that inside the second subfolder was the name of the first sub folder of the d: rather than all the folder in the second folder. What switch should I have added to avoid this? Sorry is I am so unfamiliar with rich copy. I almost prefer robocopy as it works more like xcopy and does exactly what I expect it to do.Anonymous
December 06, 2011
I have been trying to find a list of error codes and definitions as they relate to the entries in the RichCopy log. I have not been able to find anything that explains the error codes.Anonymous
October 01, 2013
The comment has been removedAnonymous
November 28, 2014
Hi,
anyone can help me how to create batch file for copy the files from richcopy