my project restarted at 33%

Moderators: Site Moderators, PandeGroup

my project restarted at 33%

Postby crazzy88ss » Fri Jul 13, 2012 4:06 pm

Both are Project: 6040 (Run 0, Clone 48, Gen 309)

Any ideas why it quit and restarted?

Code: Select all

# Mac OS X SMP Console Edition ################################################
###############################################################################

                       Folding@Home Client Version 6.29r3

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: /Users/Stephen/Library/Folding@home
Executable: /usr/local/fah/fah6
Arguments: -advmethods -smp 4

[03:50:56] - Ask before connecting: No
[03:50:56] - User name: crazzy88ss (Team 55186)
[03:50:56] - User ID: EDIT
[03:50:56] - Machine ID: 1
[03:50:56]
[03:50:56] Loaded queue successfully.
[03:50:56]
[03:50:56] + Processing work unit
[03:50:56] Core required: FahCore_a3.exe
[03:50:56] Core found.
[03:50:56] Working on queue slot 06 [July 11 03:50:56 UTC]
[03:50:56] + Working ...
[03:50:56]
[03:50:56] *------------------------------*
[03:50:56] Folding@Home Gromacs SMP Core
[03:50:56] Version 2.22 (May 7 2010)
[03:50:56]
[03:50:56] Preparing to commence simulation
[03:50:56] - Ensuring status. Please wait.
[03:51:06] - Looking at optimizations...
[03:51:06] - Working with standard loops on this execution.
[03:51:06] - Previous termination of core was improper.
[03:51:06] - Files status OK
[03:51:07] - Expanded 7884310 -> 10126021 (decompressed 128.4 percent)
[03:51:07] Called DecompressByteArray: compressed_data_size=7884310 data_size=10126021, decompressed_data_size=10126021 diff=0
[03:51:07] - Digital signature verified
[03:51:07]
[03:51:07] Project: 6040 (Run 0, Clone 48, Gen 309)
[03:51:07]
[03:51:07] Entering M.D.
[03:51:13] Using Gromacs checkpoints
[03:51:16] Resuming from checkpoint
[03:51:16] fcSaveRestoreState: I/O failed dir=0, var=0080DF08, varsize=21120
[03:51:16] Can't restore state.fcSaveRestoreState: I/O failed dir=0, var=0080DF08, varsize=21120
[03:51:16] Can't restore state.fcSaveRestoreState: I/O failed dir=0, var=0080DF08, varsize=21120
[03:51:16] Can't restore state.fcSaveRestoreState: I/O failed dir=0, var=0080DF08, varsize=21120
[03:51:16] Can't restore state.mdrun returned 3
[03:51:16] Gromacs detected an invalid checkpoint.  Restarting...
[03:51:17] Folding@home Core Shutdown: UNKNOWN_ERROR
[03:51:17] CoreStatus = 62 (98)
[03:51:17] + Restarting core (settings changed)
[03:51:17]
[03:51:17] + Processing work unit
[03:51:17] Core required: FahCore_a3.exe
[03:51:17] Core found.
[03:51:17] Working on queue slot 06 [July 11 03:51:17 UTC]
[03:51:17] + Working ...
[03:51:17]
[03:51:17] *------------------------------*
[03:51:17] Folding@Home Gromacs SMP Core
[03:51:17] Version 2.22 (May 7 2010)
[03:51:17]
[03:51:17] Preparing to commence simulation
[03:51:17] - Looking at optimizations...
[03:51:17] - Not checking prior termination.
[03:51:18] - Expanded 7884310 -> 10126021 (decompressed 128.4 percent)
[03:51:18] Called DecompressByteArray: compressed_data_size=7884310 data_size=10126021, decompressed_data_size=10126021 diff=0
[03:51:18] - Digital signature verified
[03:51:18]
[03:51:18] Project: 6040 (Run 0, Clone 48, Gen 309)
[03:51:18]
[03:51:18] Assembly optimizations on if available.
[03:51:18] Entering M.D.
[03:51:27] Completed 0 out of 250000 steps  (0%)
[04:11:38] Completed 2500 out of 250000 steps  (1%)
[04:32:13] Completed 5000 out of 250000 steps  (2%)
[14:53:43] Completed 7500 out of 250000 steps  (3%)
[22:59:40] Completed 10000 out of 250000 steps  (4%)
[23:20:12] Completed 12500 out of 250000 steps  (5%)
[23:40:25] Completed 15000 out of 250000 steps  (6%)
[00:02:02] Completed 17500 out of 250000 steps  (7%)
[00:23:57] Completed 20000 out of 250000 steps  (8%)
[01:20:11] Completed 22500 out of 250000 steps  (9%)
[01:39:15] Completed 25000 out of 250000 steps  (10%)
[01:58:22] Completed 27500 out of 250000 steps  (11%)
[02:18:26] Completed 30000 out of 250000 steps  (12%)
[02:38:08] Completed 32500 out of 250000 steps  (13%)
[02:57:29] Completed 35000 out of 250000 steps  (14%)
[03:17:27] Completed 37500 out of 250000 steps  (15%)
[03:37:15] Completed 40000 out of 250000 steps  (16%)
[03:56:54] Completed 42500 out of 250000 steps  (17%)
[04:16:44] Completed 45000 out of 250000 steps  (18%)
[14:36:49] Completed 47500 out of 250000 steps  (19%)
[14:57:20] Completed 50000 out of 250000 steps  (20%)
[22:42:28] Completed 52500 out of 250000 steps  (21%)
[23:03:03] Completed 55000 out of 250000 steps  (22%)
[23:23:33] Completed 57500 out of 250000 steps  (23%)
[23:46:02] Completed 60000 out of 250000 steps  (24%)
[00:07:33] Completed 62500 out of 250000 steps  (25%)
[00:31:02] Completed 65000 out of 250000 steps  (26%)
[00:55:10] Completed 67500 out of 250000 steps  (27%)
[01:31:02] Completed 70000 out of 250000 steps  (28%)
[01:52:23] Completed 72500 out of 250000 steps  (29%)
[02:13:54] Completed 75000 out of 250000 steps  (30%)
[02:34:04] Completed 77500 out of 250000 steps  (31%)
[02:53:45] Completed 80000 out of 250000 steps  (32%)
[03:13:21] Completed 82500 out of 250000 steps  (33%)

Folding@Home Client Shutdown.


--- Opening Log file [July 13 03:49:34 UTC]


# Mac OS X SMP Console Edition ################################################
###############################################################################

                       Folding@Home Client Version 6.29r3

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: /Users/Stephen/Library/Folding@home
Executable: /usr/local/fah/fah6
Arguments: -advmethods -smp 4

[03:49:34] - Ask before connecting: No
[03:49:34] - User name: crazzy88ss (Team 55186)
[03:49:34] - User ID: EDIT
[03:49:34] - Machine ID: 1
[03:49:34]
[03:49:34] Loaded queue successfully.
[03:49:34]
[03:49:34] + Processing work unit
[03:49:34] Core required: FahCore_a3.exe
[03:49:34] Core found.
[03:49:34] Working on queue slot 06 [July 13 03:49:34 UTC]
[03:49:34] + Working ...
[03:49:34]
[03:49:34] *------------------------------*
[03:49:34] Folding@Home Gromacs SMP Core
[03:49:34] Version 2.22 (May 7 2010)
[03:49:34]
[03:49:34] Preparing to commence simulation
[03:49:34] - Ensuring status. Please wait.
[03:49:44] - Looking at optimizations...
[03:49:44] - Working with standard loops on this execution.
[03:49:46] - Created dyn
[03:49:46] - Files status OK
[03:49:47] - Expanded 7884310 -> 10126021 (decompressed 128.4 percent)
[03:49:47] Called DecompressByteArray: compressed_data_size=7884310 data_size=10126021, decompressed_data_size=10126021 diff=0
[03:49:47] - Digital signature verified
[03:49:47]
[03:49:47] Project: 6040 (Run 0, Clone 48, Gen 309)
[03:49:47]
[03:49:47] Entering M.D.
[03:49:56] Completed 0 out of 250000 steps  (0%)
[04:09:58] Completed 2500 out of 250000 steps  (1%)
[04:29:25] Completed 5000 out of 250000 steps  (2%)
[15:16:48] Completed 7500 out of 250000 steps  (3%)
[15:37:36] Completed 10000 out of 250000 steps  (4%)
[15:58:48] Completed 12500 out of 250000 steps  (5%)
[Team Neowin: 55186]
[3 Mac Pros]
- Dual Xeon, Dual Xeon, Dual Xeon
[4 iMacs]
- C2D, C2D, Core i3, Core i7
[1 MacBook]
- C2D
crazzy88ss
 
Posts: 50
Joined: Sat Jun 30, 2012 5:43 am

Re: my project restarted at 33%

Postby Meh_Lay_Lay » Fri Jul 13, 2012 4:19 pm

Wow, it didn't even save the progress..
And no, I have no idea. sry ;(
Meh_Lay_Lay
 
Posts: 64
Joined: Thu Sep 29, 2011 4:38 pm

Re: my project restarted at 33%

Postby 7im » Fri Jul 13, 2012 4:21 pm

If this was a Windows system shutting down at 3 AM, I'd say it was a System Update and reboot. Macs have anything like that?
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
User avatar
7im
 
Posts: 14648
Joined: Thu Nov 29, 2007 4:30 pm
Location: Arizona

Re: my project restarted at 33%

Postby Joe_H » Fri Jul 13, 2012 4:25 pm

crazzy88ss wrote:Folding@Home Client Shutdown.


Usually that message in the log indicates that it was shutdown by pausing the client using the control panel. If you didn't do that, did your system download and run an updater automatically for the OS? That would need a restart for many system components. If that coincided with the writing of a checkpoint, that will corrupt the checkpoint most of the time and the WU will start over from the beginning. Because this I don't leave the System Updater set to download and automatically apply updates.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Joe_H
Site Admin
 
Posts: 4124
Joined: Tue Apr 21, 2009 4:41 pm
Location: W. MA

Re: my project restarted at 33%

Postby codysluder » Sat Jul 14, 2012 12:02 am

crazzy88ss wrote:[02:53:45] Completed 80000 out of 250000 steps (32%)
[03:13:21] Completed 82500 out of 250000 steps (33%)

Folding@Home Client Shutdown.


--- Opening Log file [July 13 03:49:34 UTC]


Let's remember that this happened at 3AM UTC which, if you're in the USA, is 11PM EDT or 8PM PDT. That's not an unreasonable time for you to have rebooted the machine. Could you have rebooted manually? Does OSX have a log that records when it was last rebooted?
codysluder
 
Posts: 2128
Joined: Sun Dec 02, 2007 12:43 pm

Re: my project restarted at 33%

Postby PinHead » Sat Jul 14, 2012 2:38 am

You seem to have had issues at the very beginning of the log you posted. Do you have heat related issues?

Folding@home Core Shutdown: UNKNOWN_ERROR
CoreStatus = 62 (98)

Looks like the WU dumped before the 33 percent completion that you mentioned. It's at the very beginning of your log.

edit:
DId you edit the log file? I see some huge time differences.

Code: Select all
[04:16:44] Completed 45000 out of 250000 steps  (18%)
[14:36:49] Completed 47500 out of 250000 steps  (19%)
[14:57:20] Completed 50000 out of 250000 steps  (20%)
[22:42:28] Completed 52500 out of 250000 steps  (21%)
[23:03:03] Completed 55000 out of 250000 steps  (22%)
[23:23:33] Completed 57500 out of 250000 steps  (23%)
[23:46:02] Completed 60000 out of 250000 steps  (24%)
[00:07:33] Completed 62500 out of 250000 steps  (25%)

PinHead
 
Posts: 351
Joined: Tue Jan 24, 2012 3:43 am

Re: my project restarted at 33%

Postby Joe_H » Sat Jul 14, 2012 12:22 pm

PinHead wrote:edit:
DId you edit the log file? I see some huge time differences.


Or did you have your system sleeping for a bit? The large time difference is consistent with that.
Joe_H
Site Admin
 
Posts: 4124
Joined: Tue Apr 21, 2009 4:41 pm
Location: W. MA

Re: my project restarted at 33%

Postby crazzy88ss » Mon Jul 16, 2012 10:19 pm

7im wrote:If this was a Windows system shutting down at 3 AM, I'd say it was a System Update and reboot. Macs have anything like that?


Not sure, but I simply put the iMac to sleep at around 11pm, like I've been doing for a while with no issues on F@H.


Joe_H wrote:
crazzy88ss wrote:Folding@Home Client Shutdown.


Usually that message in the log indicates that it was shutdown by pausing the client using the control panel. If you didn't do that, did your system download and run an updater automatically for the OS?


I did a normal sleep; no shut down or updates or anything.

Joe_H wrote:
PinHead wrote:edit:
DId you edit the log file? I see some huge time differences.


Or did you have your system sleeping for a bit? The large time difference is consistent with that.


Yes, sleeping. No edits.
crazzy88ss
 
Posts: 50
Joined: Sat Jun 30, 2012 5:43 am

Re: my project restarted at 33%

Postby Joe_H » Tue Jul 17, 2012 3:01 am

I can't think of anything else that would cause that restart. One way to check on whether your system rebooted is to check the uptime. You can enter the command uptime in a Terminal app window, that will tell you how many days and hours since the last reboot. If that matches up with the restart of the WU in folding, that would be the explanation. The Console logs also keep track of reboots.
Joe_H
Site Admin
 
Posts: 4124
Joined: Tue Apr 21, 2009 4:41 pm
Location: W. MA

Re: my project restarted at 33%

Postby crazzy88ss » Tue Jul 17, 2012 3:56 am

I've a widget for it. Up time is 8 days; it's not related to the restart.

Sounds like it's a glitch somewhere :( Oh well.
crazzy88ss
 
Posts: 50
Joined: Sat Jun 30, 2012 5:43 am


Return to Intel Mac V6 client

Who is online

Users browsing this forum: No registered users and 2 guests

cron