Message boards : BOINC client : Simultaneous result uploading?
Message board moderation
Author | Message |
---|---|
Send message Joined: 25 Aug 09 Posts: 23 ![]() |
Is there some way to make the boinc client upload more than one result at a time? I have rather short (30 second) jobs running on a cluster with 8-processor nodes. While it takes longer to finish each job than it does to upload them, I finish 8 of them at a time, which is faster than my upload time for 8 serial uploads. The result is that my cpus are sitting idle waiting for the uploads to finish. If there were some way to upload more than one result at a time, though, I'd be good to go. Any ideas? Thanks |
Send message Joined: 23 Apr 07 Posts: 1112 ![]() |
There are options in cc_config.xml for changing the number of file transfers at once: How do I configure my client using the cc_config.xml file? Claggy |
Send message Joined: 5 Mar 08 Posts: 272 ![]() |
Is there some way to make the boinc client upload more than one result at a time? I have rather short (30 second) jobs running on a cluster with 8-processor nodes. While it takes longer to finish each job than it does to upload them, I finish 8 of them at a time, which is faster than my upload time for 8 serial uploads. The result is that my cpus are sitting idle waiting for the uploads to finish. If there were some way to upload more than one result at a time, though, I'd be good to go. Any ideas? By default it does 2 file xfers per project with a maximum of 8 transfers at a time. Telling your client to upload more than that tends to overload the project servers, not to mention you'd be competing with yourself for bandwidth on your internet connection. MarkJ |
Send message Joined: 19 Jan 07 Posts: 1179 ![]() |
Is there some way to make the boinc client upload more than one result at a time? I have rather short (30 second) jobs running on a cluster with 8-processor nodes. While it takes longer to finish each job than it does to upload them, I finish 8 of them at a time, which is faster than my upload time for 8 serial uploads. The result is that my cpus are sitting idle waiting for the uploads to finish. If there were some way to upload more than one result at a time, though, I'd be good to go. Any ideas? You don't upload results. You upload output files and then report results. With that said, please clarify what you're talking about. The client already uploads two files at a time, and tries to report as many results in a single request as possible (by delaying the reports). What you really need is a cache, though. You should download more than 8 results at a time, so that you can continue crunching while previous files are uploading. |
Copyright © 2025 University of California.
Permission is granted to copy, distribute and/or modify this document
under the terms of the GNU Free Documentation License,
Version 1.2 or any later version published by the Free Software Foundation.