Thread 'I'm looking for a project that respects checkpoints.'

Message boards : Projects : I'm looking for a project that respects checkpoints.
Message board moderation

To post messages, you must log in.

AuthorMessage
nyanta

Send message
Joined: 19 Jun 23
Posts: 7
Message 112082 - Posted: 20 Jun 2023, 23:17:50 UTC

HI

Added the following to the global_prefs.xml settings:
<disk_interval>60</disk_interval>

However, many projects seem to ignore checkpoints.

I'm looking for a project that respects checkpoints.

I'm using linux.

best regards.
ID: 112082 · Report as offensive
ProfileKeith Myers
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 17 Nov 16
Posts: 890
United States
Message 112083 - Posted: 21 Jun 2023, 0:43:21 UTC - in response to Message 112082.  

HI

Added the following to the global_prefs.xml settings:
<disk_interval>60</disk_interval>

However, many projects seem to ignore checkpoints.

I'm looking for a project that respects checkpoints.

I'm using linux.

best regards.

Depends on the science application mostly. Not the project per se.

What kind of tasks are you interested in? CPU or GPU? Or both?
ID: 112083 · Report as offensive
nyanta

Send message
Joined: 19 Jun 23
Posts: 7
Message 112084 - Posted: 21 Jun 2023, 14:15:39 UTC - in response to Message 112083.  

I am cpu only.
ID: 112084 · Report as offensive
nyanta

Send message
Joined: 19 Jun 23
Posts: 7
Message 112089 - Posted: 21 Jun 2023, 19:45:27 UTC - in response to Message 112084.  

I found.
NumberFields@home works as configured of checkout.

Except for the NumberFields@home?
ID: 112089 · Report as offensive
robsmith
Volunteer tester
Help desk expert

Send message
Joined: 25 May 09
Posts: 1301
United Kingdom
Message 112090 - Posted: 21 Jun 2023, 20:46:46 UTC - in response to Message 112082.  

You might find setting your checkpoint interval in global_prefs_override.xml will work better that using that set in global_prefs.xml , the latter can be written/over written by projects, while the former is under your control.
ID: 112090 · Report as offensive
ProfileKeith Myers
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 17 Nov 16
Posts: 890
United States
Message 112093 - Posted: 21 Jun 2023, 23:26:41 UTC - in response to Message 112090.  

You might find setting your checkpoint interval in global_prefs_override.xml will work better that using that set in global_prefs.xml , the latter can be written/over written by projects, while the former is under your control.

If you read his OP, you can see that he has already set his checkpoint interval to 60 seconds.

Unfortunately, a majority of projects ignore this value and let their science applications determine when to checkpoint. Many cpu apps don't checkpoint at all. Even a lot of gpu apps don't checkpoint. With gpu tasks though, the penalty is less because of their short runtimes. Starting from scratch isn't as hurtful as losing all progress on a multi-hour or multi-day cpu task.
ID: 112093 · Report as offensive
robsmith
Volunteer tester
Help desk expert

Send message
Joined: 25 May 09
Posts: 1301
United Kingdom
Message 112106 - Posted: 23 Jun 2023, 6:59:04 UTC - in response to Message 112093.  

Yes, but he's he's doing it in the "main" global_prefs file, which can be over-written by applications unlike the over-ride file which takes precedence. Bit of belt and braces.

We are all forgetting that the value set by global_prefs is a minimum time period between an application doing a checkpoint, not an absolute value. If the application is in a critical point in its calculation a checkpoint may be skipped or extended.
ID: 112106 · Report as offensive

Message boards : Projects : I'm looking for a project that respects checkpoints.

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.