project:8008 run:4 clone:59 gen:140 (GTX 680 Issue)

[sswilson]

Sorry, no other logs available. WU hangs my 680 in the same manner as previous incompatible WUs did (power @ 50% GPU Usage @ 30%, no progress).

[sortofageek]

Thanks for your report. Perhaps, if you could supply the log and more info, someone could help troubleshoot.

This WU, Project: 8008 (run 4, clone 59, gen 140), is not a bad WU, however. Another folder returned it successfully this morning.

[sswilson]

Thanks for your report. Perhaps, if you could supply the log and more info, someone could help troubleshoot.

This WU, Project: 8008 (run4, clone 59, gen 140), is not a bad WU, however. Another folder returned it successfully this morning.

Unfortunately, the work folder and slot were deleted (I'll rename the thread in the future) in a futile attempt to draw a new/different WU. IIRC though there is typically no indication on problem WUs (for the 680) other than the fact that it hangs.

edit: Recreated the slot and the GPU is back to chugging along on 7904 (220, 27, 13).

One of the main issues I have with these hanging WUs is that there doesn't appear to be any way to clear them from the slot without deleting the slot and leaving it idle for a day or so. They don't report back as bad because the client still thinks it's working as intended even though there is not output.

[bruce]

The FahCores designed and tested on Fermi do not fully support Kepler yet. It's certainly part of FAH's plans but apparently it's turning out to be a bigger challenge that anyone expected.

[sswilson]

The FahCores designed and tested on Fermi do not fully support Kepler yet. It's certainly part of FAH's plans but apparently it's turning out to be a bigger challenge that anyone expected.

Thanks for the update.

I'm on the fence when it comes to running WUs on my 680. On one hand, it seems to run the great majority of current WUs if I use the Beta tag, OTOH, I'm a bit concerned about some WUs needing to be re-assigned when they don't run properly.

I won't lie and say I don't want the points that the card gives me (competition is good), but if somebody were to come right out and say that the project is being damaged by using the beta switch outside of the official beta testing team I'd shelve the card until Stanford releases a fully compatible core.

[7im]

You personally may not be damaging the project, as you understand that any problems you have cannot be reported anywhere as you cannot post in the beta section of the forum. Help cannot be provided to you either. And while you may be diligent in monitoring your software for any instabilities that beta software might cause, many people do not.

And many people see the beta setting, and take it back to a home forum, and tell everyone to run it. How many of those people understand there is no support for using that switch? Would they become disenfranchised if they came here seeking help but were turned down, got mad, and stopped folding? All because they weren't warned upfront like we do here? Because the beta setting was spread around irresponsibly?

And how many of them would closely monitor those beta work units in case something went wrong, and the client suddenly started dumping a lot of work units. And because they don't read the beta section here, they miss the fix that is quickly posted in the beta section. So they continue to unknowingly dump 100s of work units while the responsible testers can't get work units because the dumpers drained all the work servers?

So yes, it can hurt the project. And yes, this is an extreme example, but this has happened to a lesser degree in the past...

You are probably not hurting the project, but not everyone is careful like you, so as they say, an ounce of prevention...

[codysluder]

I don't understand why those people who choose to use the beta setting don't just sign up to be part of the beta team. Then they'd be able to report the problems they encounter and they'd get support from others.

[sswilson]

I don't understand why those people who choose to use the beta setting don't just sign up to be part of the beta team. Then they'd be able to report the problems they encounter and they'd get support from others.

Because my current use of the beta tag is temporary until such time as they come out with a mainstream solution for the new 6XX series cards. I've run -adv for quite some time (not even sure if that's around any more with the V7 client) but haven't run the beta switch in the past.

I'm a hardware enthusiast first who uses FAH to get real life results from my hobby in that it proves the stability of my overclocked hardware. If I were to run the -beta tag as a beta tester, the first question on a problem WU would be if I was running stock or OC'd, as it stands, my 680 is running stock for that specific reason otherwise I'd be overclocking it as well.

[codysluder]

I've run -adv for quite some time (not even sure if that's around any more with the V7 client)

I'm not sure if it will be useful for your GPU, but set client-type to advanced.

[sswilson]

I've run -adv for quite some time (not even sure if that's around any more with the V7 client)

I'm not sure if it will be useful for your GPU, but set client-type to advanced.

Thanks, I've updated both of my clients. Always meant to look into that when I started running V7 vice the console version but never quite got around to it....

[sswilson]

On the off chance that anybody attached to the beta team is interested, here's the log for yet another 8008 WU (Project: 8008 (Run 9, Clone 64, Gen 124))
that's hung

Code: Select all

*********************** Log Started 2012-08-01T04:31:52Z ***********************
04:31:53:WU00:FS01:Starting
04:31:53:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/beta/Core_15.fah/FahCore_15.exe -dir 00 -suffix 01 -version 701 -lifeline 4976 -checkpoint 15 -cpu 98 -gpu 0
04:31:53:WU00:FS01:Started FahCore on PID 2508
04:31:53:WU00:FS01:Core PID:6056
04:31:53:WU00:FS01:FahCore 0x15 started
04:31:53:WU00:FS01:0x15:
04:31:53:WU00:FS01:0x15:*------------------------------*
04:31:53:WU00:FS01:0x15:Folding@Home GPU Core
04:31:53:WU00:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
04:31:53:WU00:FS01:0x15:Build host             AmoebaRemote
04:31:53:WU00:FS01:0x15:Board Type             NVIDIA/CUDA
04:31:53:WU00:FS01:0x15:Core                   15
04:31:53:WU00:FS01:0x15:
04:31:53:WU00:FS01:0x15:Window's signal control handler registered.
04:31:53:WU00:FS01:0x15:Preparing to commence simulation
04:31:53:WU00:FS01:0x15:- Looking at optimizations...
04:31:53:WU00:FS01:0x15:- Files status OK
04:31:53:WU00:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
04:31:53:WU00:FS01:0x15:- Expanded 145963 -> 660986 (decompressed 452.8 percent)
04:31:53:WU00:FS01:0x15:Called DecompressByteArray: compressed_data_size=145963 data_size=660986, decompressed_data_size=660986 diff=0
04:31:53:WU00:FS01:0x15:- Digital signature verified
04:31:53:WU00:FS01:0x15:
04:31:53:WU00:FS01:0x15:Project: 8018 (Run 249, Clone 0, Gen 8)
04:31:53:WU00:FS01:0x15:
04:31:53:WU00:FS01:0x15:Assembly optimizations on if available.
04:31:53:WU00:FS01:0x15:Entering M.D.
04:31:55:WU00:FS01:0x15:Will resume from checkpoint file 00/wudata_01.ckp
04:31:55:WU00:FS01:0x15:Tpr hash 00/wudata_01.tpr:  1410605951 2068024195 2384119146 2102169074 420418561
04:31:55:WU00:FS01:0x15:GPU device id=0
04:31:55:WU00:FS01:0x15:Working on GRowing Old MAkes el Chrono Sweat
04:31:55:WU00:FS01:0x15:Client config unavailable.
04:31:55:WU00:FS01:0x15:Starting GUI Server
04:32:04:FS01:Paused
04:32:04:FS01:Shutting core down
04:32:09:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
05:03:01:FS01:Unpaused
05:03:01:WU00:FS01:Starting
05:03:01:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/beta/Core_15.fah/FahCore_15.exe -dir 00 -suffix 01 -version 701 -lifeline 4976 -checkpoint 15 -cpu 98 -gpu 0
05:03:01:WU00:FS01:Started FahCore on PID 984
05:03:01:WU00:FS01:Core PID:4380
05:03:01:WU00:FS01:FahCore 0x15 started
05:03:02:WU00:FS01:0x15:
05:03:02:WU00:FS01:0x15:*------------------------------*
05:03:02:WU00:FS01:0x15:Folding@Home GPU Core
05:03:02:WU00:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
05:03:02:WU00:FS01:0x15:Build host             AmoebaRemote
05:03:02:WU00:FS01:0x15:Board Type             NVIDIA/CUDA
05:03:02:WU00:FS01:0x15:Core                   15
05:03:02:WU00:FS01:0x15:
05:03:02:WU00:FS01:0x15:Window's signal control handler registered.
05:03:02:WU00:FS01:0x15:Preparing to commence simulation
05:03:02:WU00:FS01:0x15:- Looking at optimizations...
05:03:02:WU00:FS01:0x15:- Files status OK
05:03:02:WU00:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
05:03:02:WU00:FS01:0x15:- Expanded 145963 -> 660986 (decompressed 452.8 percent)
05:03:02:WU00:FS01:0x15:Called DecompressByteArray: compressed_data_size=145963 data_size=660986, decompressed_data_size=660986 diff=0
05:03:02:WU00:FS01:0x15:- Digital signature verified
05:03:02:WU00:FS01:0x15:
05:03:02:WU00:FS01:0x15:Project: 8018 (Run 249, Clone 0, Gen 8)
05:03:02:WU00:FS01:0x15:
05:03:02:WU00:FS01:0x15:Assembly optimizations on if available.
05:03:02:WU00:FS01:0x15:Entering M.D.
05:03:03:WU00:FS01:0x15:Will resume from checkpoint file 00/wudata_01.ckp
05:03:03:WU00:FS01:0x15:Tpr hash 00/wudata_01.tpr:  1410605951 2068024195 2384119146 2102169074 420418561
05:03:03:WU00:FS01:0x15:GPU device id=0
05:03:03:WU00:FS01:0x15:Working on GRowing Old MAkes el Chrono Sweat
05:03:03:WU00:FS01:0x15:Client config unavailable.
05:03:04:WU00:FS01:0x15:Starting GUI Server
05:04:05:WU00:FS01:0x15:Resuming from checkpoint
05:04:05:WU00:FS01:0x15:fcCheckPointResume: retreived and current tpr file hash:
05:04:05:WU00:FS01:0x15:   0   1410605951   1410605951
05:04:05:WU00:FS01:0x15:   1   2068024195   2068024195
05:04:05:WU00:FS01:0x15:   2   2384119146   2384119146
05:04:05:WU00:FS01:0x15:   3   2102169074   2102169074
05:04:05:WU00:FS01:0x15:   4    420418561    420418561
05:04:05:WU00:FS01:0x15:fcCheckPointResume: file hashes same.
05:04:05:WU00:FS01:0x15:fcCheckPointResume: state restored.
05:04:05:WU00:FS01:0x15:fcCheckPointResume: name 00/wudata_01.log Verified 00/wudata_01.log
05:04:05:WU00:FS01:0x15:fcCheckPointResume: name 00/wudata_01.trr Verified 00/wudata_01.trr
05:04:05:WU00:FS01:0x15:fcCheckPointResume: name 00/wudata_01.xtc Verified 00/wudata_01.xtc
05:04:05:WU00:FS01:0x15:fcCheckPointResume: name 00/wudata_01.edr Verified 00/wudata_01.edr
05:04:05:WU00:FS01:0x15:fcCheckPointResume: state restored 2
05:04:05:WU00:FS01:0x15:Resumed from checkpoint
05:04:05:WU00:FS01:0x15:Setting checkpoint frequency: 250000
05:04:05:WU00:FS01:0x15:Completed  17000001 out of 25000000 steps (68%).
05:07:41:WU00:FS01:0x15:Completed  17250000 out of 25000000 steps (69%).
05:11:17:WU00:FS01:0x15:Completed  17500000 out of 25000000 steps (70%).
05:14:53:WU00:FS01:0x15:Completed  17750000 out of 25000000 steps (71%).
05:18:30:WU00:FS01:0x15:Completed  18000000 out of 25000000 steps (72%).
05:22:05:WU00:FS01:0x15:Completed  18250000 out of 25000000 steps (73%).
05:25:41:WU00:FS01:0x15:Completed  18500000 out of 25000000 steps (74%).
05:29:17:WU00:FS01:0x15:Completed  18750000 out of 25000000 steps (75%).
05:32:52:WU00:FS01:0x15:Completed  19000000 out of 25000000 steps (76%).
05:36:28:WU00:FS01:0x15:Completed  19250000 out of 25000000 steps (77%).
05:40:04:WU00:FS01:0x15:Completed  19500000 out of 25000000 steps (78%).
05:43:39:WU00:FS01:0x15:Completed  19750000 out of 25000000 steps (79%).
05:47:15:WU00:FS01:0x15:Completed  20000000 out of 25000000 steps (80%).
05:50:51:WU00:FS01:0x15:Completed  20250000 out of 25000000 steps (81%).
05:54:27:WU00:FS01:0x15:Completed  20500000 out of 25000000 steps (82%).
05:58:02:WU00:FS01:0x15:Completed  20750000 out of 25000000 steps (83%).
06:01:38:WU00:FS01:0x15:Completed  21000000 out of 25000000 steps (84%).
06:05:14:WU00:FS01:0x15:Completed  21250000 out of 25000000 steps (85%).
06:08:50:WU00:FS01:0x15:Completed  21500000 out of 25000000 steps (86%).
06:12:25:WU00:FS01:0x15:Completed  21750000 out of 25000000 steps (87%).
06:16:01:WU00:FS01:0x15:Completed  22000000 out of 25000000 steps (88%).
06:19:37:WU00:FS01:0x15:Completed  22250000 out of 25000000 steps (89%).
06:23:13:WU00:FS01:0x15:Completed  22500000 out of 25000000 steps (90%).
06:26:48:WU00:FS01:0x15:Completed  22750000 out of 25000000 steps (91%).
06:30:24:WU00:FS01:0x15:Completed  23000000 out of 25000000 steps (92%).
06:34:00:WU00:FS01:0x15:Completed  23250000 out of 25000000 steps (93%).
06:37:36:WU00:FS01:0x15:Completed  23500000 out of 25000000 steps (94%).
06:41:12:WU00:FS01:0x15:Completed  23750000 out of 25000000 steps (95%).
06:44:47:WU00:FS01:0x15:Completed  24000000 out of 25000000 steps (96%).
06:48:23:WU00:FS01:0x15:Completed  24250000 out of 25000000 steps (97%).
06:51:59:WU00:FS01:0x15:Completed  24500000 out of 25000000 steps (98%).
06:55:34:WU00:FS01:0x15:Completed  24750000 out of 25000000 steps (99%).
06:55:35:WU01:FS01:Connecting to assign-GPU.stanford.edu:80
06:55:35:WU01:FS01:News: Welcome to Folding@Home
06:55:35:WU01:FS01:Assigned to work server 171.67.108.141
06:55:35:WU01:FS01:Requesting new work unit for slot 01: RUNNING gpu:1:"GF114 [GeForce GTX 680]" from 171.67.108.141
06:55:35:WU01:FS01:Connecting to 171.67.108.141:8080
06:55:36:WU01:FS01:Downloading 65.06KiB
06:55:36:WU01:FS01:Download complete
06:55:36:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:OK project:8008 run:9 clone:64 gen:124 core:0x15 unit:0x0000008c6953ee2d4f9748ae5a51eb59
06:59:10:WU00:FS01:0x15:Completed  25000000 out of 25000000 steps (100%).
06:59:11:WU00:FS01:0x15:Finished fah_main status=0
06:59:11:WU00:FS01:0x15:Successful run
06:59:11:WU00:FS01:0x15:DynamicWrapper: Finished Work Unit: sleep=10000
06:59:21:WU00:FS01:0x15:Reserved 436028 bytes for xtc file; Cosm status=0
06:59:21:WU00:FS01:0x15:Allocated 436028 bytes for xtc file
06:59:21:WU00:FS01:0x15:- Reading up to 436028 from "00/wudata_01.xtc": Read 436028
06:59:21:WU00:FS01:0x15:Read 436028 bytes from xtc file; available packet space=785994436
06:59:21:WU00:FS01:0x15:xtc file hash check passed.
06:59:21:WU00:FS01:0x15:Reserved 54408 54408 785994436 bytes for arc file=<00/wudata_01.trr> Cosm status=0
06:59:21:WU00:FS01:0x15:Allocated 54408 bytes for arc file
06:59:21:WU00:FS01:0x15:- Reading up to 54408 from "00/wudata_01.trr": Read 54408
06:59:21:WU00:FS01:0x15:Read 54408 bytes from arc file; available packet space=785940028
06:59:21:WU00:FS01:0x15:trr file hash check passed.
06:59:21:WU00:FS01:0x15:Allocated 544 bytes for edr file
06:59:21:WU00:FS01:0x15:Read bedfile
06:59:21:WU00:FS01:0x15:edr file hash check passed.
06:59:21:WU00:FS01:0x15:Allocated 32328 bytes for logfile
06:59:21:WU00:FS01:0x15:Read logfile
06:59:21:WU00:FS01:0x15:GuardedRun: success in DynamicWrapper
06:59:21:WU00:FS01:0x15:GuardedRun: done
06:59:21:WU00:FS01:0x15:Run: GuardedRun completed.
06:59:22:WU00:FS01:0x15:+ Opened results file
06:59:22:WU00:FS01:0x15:- Writing 523820 bytes of core data to disk...
06:59:22:WU00:FS01:0x15:Done: 523308 -> 501118 (compressed to 95.7 percent)
06:59:22:WU00:FS01:0x15:  ... Done.
06:59:22:WU00:FS01:0x15:DeleteFrameFiles: successfully deleted file=00/wudata_01.ckp
06:59:22:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
06:59:22:WU00:FS01:Sending unit results: id:00 state:SEND error:OK project:8018 run:249 clone:0 gen:8 core:0x15 unit:0x0000000a6953ee2e500f1c25fff1fbb7
06:59:22:WU00:FS01:Uploading 489.87KiB to 171.67.108.142
06:59:22:WU00:FS01:Connecting to 171.67.108.142:8080
06:59:22:WU01:FS01:Starting
06:59:22:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 701 -lifeline 4976 -checkpoint 15 -cpu 98 -gpu 0
06:59:22:WU01:FS01:Started FahCore on PID 2156
06:59:22:WU01:FS01:Core PID:2908
06:59:22:WU01:FS01:FahCore 0x15 started
06:59:23:WU01:FS01:0x15:
06:59:23:WU01:FS01:0x15:*------------------------------*
06:59:23:WU01:FS01:0x15:Folding@Home GPU Core
06:59:23:WU01:FS01:0x15:Version                2.22 (Thu Dec 8 17:08:05 PST 2011)
06:59:23:WU01:FS01:0x15:Build host             SimbiosNvdWin7
06:59:23:WU01:FS01:0x15:Board Type             NVIDIA/CUDA
06:59:23:WU01:FS01:0x15:Core                   15
06:59:23:WU01:FS01:0x15:
06:59:23:WU01:FS01:0x15:Window's signal control handler registered.
06:59:23:WU01:FS01:0x15:Preparing to commence simulation
06:59:23:WU01:FS01:0x15:- Looking at optimizations...
06:59:23:WU01:FS01:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
06:59:23:WU01:FS01:0x15:- Created dyn
06:59:23:WU01:FS01:0x15:- Files status OK
06:59:23:WU01:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
06:59:23:WU01:FS01:0x15:- Expanded 66112 -> 287126 (decompressed 434.3 percent)
06:59:23:WU01:FS01:0x15:Called DecompressByteArray: compressed_data_size=66112 data_size=287126, decompressed_data_size=287126 diff=0
06:59:23:WU01:FS01:0x15:- Digital signature verified
06:59:23:WU01:FS01:0x15:
06:59:23:WU01:FS01:0x15:Project: 8008 (Run 9, Clone 64, Gen 124)
06:59:23:WU01:FS01:0x15:
06:59:23:WU01:FS01:0x15:Assembly optimizations on if available.
06:59:23:WU01:FS01:0x15:Entering M.D.
06:59:24:WU01:FS01:0x15:Tpr hash 01/wudata_01.tpr:  246663197 1870251084 629074908 2418385872 726513747
06:59:24:WU01:FS01:0x15:GPU device info: vendor=0 device=0 name=<NA> match=0
06:59:24:WU01:FS01:0x15:Working on Gromacs Runs On Most of All Computer Systems
06:59:24:WU01:FS01:0x15:Client config unavailable.
06:59:25:WU01:FS01:0x15:Starting GUI Server
06:59:28:WU00:FS01:Upload 78.39%
06:59:30:WU00:FS01:Upload complete
06:59:30:WU00:FS01:Server responded WORK_ACK (400)
06:59:30:WU00:FS01:Final credit estimate, 5757.00 points
06:59:30:WU00:FS01:Cleaning up
******************************** Date: 01/08/12 ********************************

<Snip to recent log from SMP client to show time frame>

*********************** Log Started 2012-08-01T04:31:52Z ***********************
04:31:53:WU01:FS00:Starting
04:31:53:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 701 -lifeline 4976 -checkpoint 15 -cpu 98 -np 8
04:31:53:WU01:FS00:Started FahCore on PID 3812
04:31:53:WU01:FS00:Core PID:2128
04:31:53:WU01:FS00:FahCore 0xa4 started
04:31:53:WU01:FS00:0xa4:
04:31:53:WU01:FS00:0xa4:*------------------------------*
04:31:53:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
04:31:53:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
04:31:53:WU01:FS00:0xa4:
04:31:53:WU01:FS00:0xa4:Preparing to commence simulation
04:31:53:WU01:FS00:0xa4:- Looking at optimizations...
04:31:53:WU01:FS00:0xa4:- Files status OK
04:31:53:WU01:FS00:0xa4:- Expanded 544709 -> 1305024 (decompressed 239.5 percent)
04:31:53:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=544709 data_size=1305024, decompressed_data_size=1305024 diff=0
04:31:53:WU01:FS00:0xa4:- Digital signature verified
04:31:53:WU01:FS00:0xa4:
04:31:53:WU01:FS00:0xa4:Project: 8004 (Run 63, Clone 52, Gen 6)
04:31:53:WU01:FS00:0xa4:
04:31:53:WU01:FS00:0xa4:Assembly optimizations on if available.
04:31:53:WU01:FS00:0xa4:Entering M.D.
04:31:59:WU01:FS00:0xa4:Using Gromacs checkpoints
04:31:59:WU01:FS00:0xa4:Mapping NT from 8 to 8 
04:31:59:WU01:FS00:0xa4:Resuming from checkpoint
04:31:59:WU01:FS00:0xa4:Verified 01/wudata_01.log
04:31:59:WU01:FS00:0xa4:Verified 01/wudata_01.trr
04:31:59:WU01:FS00:0xa4:Verified 01/wudata_01.xtc
04:31:59:WU01:FS00:0xa4:Verified 01/wudata_01.edr
04:31:59:WU01:FS00:0xa4:Completed 116560 out of 250000 steps  (46%)
04:32:15:WU01:FS00:0xa4:Completed 117500 out of 250000 steps  (47%)
04:32:54:WU01:FS00:0xa4:Completed 120000 out of 250000 steps  (48%)
04:33:31:WU01:FS00:0xa4:Completed 122500 out of 250000 steps  (49%)
04:34:09:WU01:FS00:0xa4:Completed 125000 out of 250000 steps  (50%)
04:34:47:WU01:FS00:0xa4:Completed 127500 out of 250000 steps  (51%)
04:35:25:WU01:FS00:0xa4:Completed 130000 out of 250000 steps  (52%)
04:36:02:WU01:FS00:0xa4:Completed 132500 out of 250000 steps  (53%)
04:36:40:WU01:FS00:0xa4:Completed 135000 out of 250000 steps  (54%)
04:37:17:WU01:FS00:0xa4:Completed 137500 out of 250000 steps  (55%)
04:37:54:WU01:FS00:0xa4:Completed 140000 out of 250000 steps  (56%)
04:38:32:WU01:FS00:0xa4:Completed 142500 out of 250000 steps  (57%)
04:39:10:WU01:FS00:0xa4:Completed 145000 out of 250000 steps  (58%)
04:39:48:WU01:FS00:0xa4:Completed 147500 out of 250000 steps  (59%)
04:40:26:WU01:FS00:0xa4:Completed 150000 out of 250000 steps  (60%)
04:41:08:WU01:FS00:0xa4:Completed 152500 out of 250000 steps  (61%)
04:41:50:WU01:FS00:0xa4:Completed 155000 out of 250000 steps  (62%)
04:42:31:WU01:FS00:0xa4:Completed 157500 out of 250000 steps  (63%)
04:43:11:WU01:FS00:0xa4:Completed 160000 out of 250000 steps  (64%)
04:43:49:WU01:FS00:0xa4:Completed 162500 out of 250000 steps  (65%)
04:44:28:WU01:FS00:0xa4:Completed 165000 out of 250000 steps  (66%)
04:45:07:WU01:FS00:0xa4:Completed 167500 out of 250000 steps  (67%)
04:45:45:WU01:FS00:0xa4:Completed 170000 out of 250000 steps  (68%)
04:46:24:WU01:FS00:0xa4:Completed 172500 out of 250000 steps  (69%)
04:47:04:WU01:FS00:0xa4:Completed 175000 out of 250000 steps  (70%)
04:47:45:WU01:FS00:0xa4:Completed 177500 out of 250000 steps  (71%)
04:48:23:WU01:FS00:0xa4:Completed 180000 out of 250000 steps  (72%)
04:49:01:WU01:FS00:0xa4:Completed 182500 out of 250000 steps  (73%)
04:49:38:WU01:FS00:0xa4:Completed 185000 out of 250000 steps  (74%)
04:50:16:WU01:FS00:0xa4:Completed 187500 out of 250000 steps  (75%)
04:50:53:WU01:FS00:0xa4:Completed 190000 out of 250000 steps  (76%)
04:51:32:WU01:FS00:0xa4:Completed 192500 out of 250000 steps  (77%)
04:52:17:WU01:FS00:0xa4:Completed 195000 out of 250000 steps  (78%)
04:53:01:WU01:FS00:0xa4:Completed 197500 out of 250000 steps  (79%)
04:53:45:WU01:FS00:0xa4:Completed 200000 out of 250000 steps  (80%)
04:54:29:WU01:FS00:0xa4:Completed 202500 out of 250000 steps  (81%)
04:55:11:WU01:FS00:0xa4:Completed 205000 out of 250000 steps  (82%)
04:55:52:WU01:FS00:0xa4:Completed 207500 out of 250000 steps  (83%)
04:56:33:WU01:FS00:0xa4:Completed 210000 out of 250000 steps  (84%)
04:57:16:WU01:FS00:0xa4:Completed 212500 out of 250000 steps  (85%)
04:57:53:WU01:FS00:0xa4:Completed 215000 out of 250000 steps  (86%)
04:58:33:WU01:FS00:0xa4:Completed 217500 out of 250000 steps  (87%)
04:59:10:WU01:FS00:0xa4:Completed 220000 out of 250000 steps  (88%)
04:59:48:WU01:FS00:0xa4:Completed 222500 out of 250000 steps  (89%)
05:00:26:WU01:FS00:0xa4:Completed 225000 out of 250000 steps  (90%)
05:01:02:WU01:FS00:0xa4:Completed 227500 out of 250000 steps  (91%)
05:01:39:WU01:FS00:0xa4:Completed 230000 out of 250000 steps  (92%)
05:02:16:WU01:FS00:0xa4:Completed 232500 out of 250000 steps  (93%)
05:02:52:WU01:FS00:0xa4:Completed 235000 out of 250000 steps  (94%)
05:03:31:WU01:FS00:0xa4:Completed 237500 out of 250000 steps  (95%)
05:04:09:WU01:FS00:0xa4:Completed 240000 out of 250000 steps  (96%)
05:04:48:WU01:FS00:0xa4:Completed 242500 out of 250000 steps  (97%)
05:05:26:WU01:FS00:0xa4:Completed 245000 out of 250000 steps  (98%)
05:06:05:WU01:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
05:06:44:WU01:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
05:06:44:WU01:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
05:06:44:WU02:FS00:Connecting to assign3.stanford.edu:8080
05:06:45:WU02:FS00:News: Welcome to Folding@Home
05:06:45:WU02:FS00:Assigned to work server 129.74.85.15
05:06:45:WU02:FS00:Requesting new work unit for slot 00: RUNNING smp:8 from 129.74.85.15
05:06:45:WU02:FS00:Connecting to 129.74.85.15:8080
05:06:45:WU02:FS00:Downloading 48.88KiB
05:06:45:WU02:FS00:Download complete
05:06:45:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:OK project:10090 run:151 clone:0 gen:171 core:0xa4 unit:0x000001b80001329c4dfb5721b3f98ff1
05:06:45:WU02:FS00:Downloading project 10090 description
05:06:45:WU02:FS00:Connecting to fah-web.stanford.edu:80
05:06:46:WU02:FS00:Project 10090 description downloaded successfully
05:06:54:WU01:FS00:0xa4:
05:06:54:WU01:FS00:0xa4:Finished Work Unit:
05:06:54:WU01:FS00:0xa4:- Reading up to 769668 from "01/wudata_01.trr": Read 769668
05:06:54:WU01:FS00:0xa4:trr file hash check passed.
05:06:54:WU01:FS00:0xa4:- Reading up to 456008 from "01/wudata_01.xtc": Read 456008
05:06:54:WU01:FS00:0xa4:xtc file hash check passed.
05:06:54:WU01:FS00:0xa4:edr file hash check passed.
05:06:54:WU01:FS00:0xa4:logfile size: 23459
05:06:54:WU01:FS00:0xa4:Leaving Run
05:06:54:WU01:FS00:0xa4:- Writing 1254539 bytes of core data to disk...
05:06:54:WU01:FS00:0xa4:Done: 1254027 -> 1193084 (compressed to 95.1 percent)
05:06:54:WU01:FS00:0xa4:  ... Done.
05:06:54:WU01:FS00:0xa4:- Shutting down core
05:06:54:WU01:FS00:0xa4:
05:06:54:WU01:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
05:06:55:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
05:06:55:WU01:FS00:Sending unit results: id:01 state:SEND error:OK project:8004 run:63 clone:52 gen:6 core:0xa4 unit:0x0000000a6652edcb4eee562cb928fb4e
05:06:55:WU01:FS00:Uploading 1.14MiB to 171.67.108.59
05:06:55:WU01:FS00:Connecting to 171.67.108.59:8080
05:06:55:WU02:FS00:Starting
05:06:55:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 02 -suffix 01 -version 701 -lifeline 4976 -checkpoint 15 -cpu 98 -np 8
05:06:55:WU02:FS00:Started FahCore on PID 1952
05:06:55:WU02:FS00:Core PID:2204
05:06:55:WU02:FS00:FahCore 0xa4 started
05:06:55:WU02:FS00:0xa4:
05:06:55:WU02:FS00:0xa4:*------------------------------*
05:06:55:WU02:FS00:0xa4:Folding@Home Gromacs GB Core
05:06:55:WU02:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
05:06:55:WU02:FS00:0xa4:
05:06:55:WU02:FS00:0xa4:Preparing to commence simulation
05:06:55:WU02:FS00:0xa4:- Looking at optimizations...
05:06:55:WU02:FS00:0xa4:- Created dyn
05:06:55:WU02:FS00:0xa4:- Files status OK
05:06:55:WU02:FS00:0xa4:- Expanded 49540 -> 197152 (decompressed 397.9 percent)
05:06:55:WU02:FS00:0xa4:Called DecompressByteArray: compressed_data_size=49540 data_size=197152, decompressed_data_size=197152 diff=0
05:06:55:WU02:FS00:0xa4:- Digital signature verified
05:06:55:WU02:FS00:0xa4:
05:06:55:WU02:FS00:0xa4:Project: 10090 (Run 151, Clone 0, Gen 171)
05:06:55:WU02:FS00:0xa4:
05:06:55:WU02:FS00:0xa4:Assembly optimizations on if available.
05:06:55:WU02:FS00:0xa4:Entering M.D.
05:07:01:WU01:FS00:Upload 32.94%
05:07:01:WU02:FS00:0xa4:Mapping NT from 8 to 8 
05:07:01:WU02:FS00:0xa4:Completed 0 out of 10000000 steps  (0%)
05:07:07:WU01:FS00:Upload 60.40%
05:07:13:WU01:FS00:Upload 87.85%
05:07:15:WU01:FS00:Upload complete
05:07:15:WU01:FS00:Server responded WORK_ACK (400)
05:07:15:WU01:FS00:Final credit estimate, 263.00 points
05:07:15:WU01:FS00:Cleaning up
05:09:11:WU02:FS00:0xa4:Completed 100000 out of 10000000 steps  (1%)
05:11:21:WU02:FS00:0xa4:Completed 200000 out of 10000000 steps  (2%)
05:13:30:WU02:FS00:0xa4:Completed 300000 out of 10000000 steps  (3%)
05:15:40:WU02:FS00:0xa4:Completed 400000 out of 10000000 steps  (4%)
05:17:49:WU02:FS00:0xa4:Completed 500000 out of 10000000 steps  (5%)
05:19:58:WU02:FS00:0xa4:Completed 600000 out of 10000000 steps  (6%)
05:22:08:WU02:FS00:0xa4:Completed 700000 out of 10000000 steps  (7%)
05:24:17:WU02:FS00:0xa4:Completed 800000 out of 10000000 steps  (8%)
05:26:26:WU02:FS00:0xa4:Completed 900000 out of 10000000 steps  (9%)
05:29:43:WU02:FS00:0xa4:Completed 1000000 out of 10000000 steps  (10%)
05:31:52:WU02:FS00:0xa4:Completed 1100000 out of 10000000 steps  (11%)
05:34:02:WU02:FS00:0xa4:Completed 1200000 out of 10000000 steps  (12%)
05:36:11:WU02:FS00:0xa4:Completed 1300000 out of 10000000 steps  (13%)
05:38:20:WU02:FS00:0xa4:Completed 1400000 out of 10000000 steps  (14%)
05:40:29:WU02:FS00:0xa4:Completed 1500000 out of 10000000 steps  (15%)
05:42:38:WU02:FS00:0xa4:Completed 1600000 out of 10000000 steps  (16%)
05:44:47:WU02:FS00:0xa4:Completed 1700000 out of 10000000 steps  (17%)
05:46:55:WU02:FS00:0xa4:Completed 1800000 out of 10000000 steps  (18%)
05:49:05:WU02:FS00:0xa4:Completed 1900000 out of 10000000 steps  (19%)
05:51:14:WU02:FS00:0xa4:Completed 2000000 out of 10000000 steps  (20%)
05:53:23:WU02:FS00:0xa4:Completed 2100000 out of 10000000 steps  (21%)
05:55:32:WU02:FS00:0xa4:Completed 2200000 out of 10000000 steps  (22%)
05:57:41:WU02:FS00:0xa4:Completed 2300000 out of 10000000 steps  (23%)
06:00:25:WU02:FS00:0xa4:Completed 2400000 out of 10000000 steps  (24%)
06:02:34:WU02:FS00:0xa4:Completed 2500000 out of 10000000 steps  (25%)
06:04:43:WU02:FS00:0xa4:Completed 2600000 out of 10000000 steps  (26%)
06:06:53:WU02:FS00:0xa4:Completed 2700000 out of 10000000 steps  (27%)
06:09:02:WU02:FS00:0xa4:Completed 2800000 out of 10000000 steps  (28%)
06:11:11:WU02:FS00:0xa4:Completed 2900000 out of 10000000 steps  (29%)
06:13:20:WU02:FS00:0xa4:Completed 3000000 out of 10000000 steps  (30%)
06:15:29:WU02:FS00:0xa4:Completed 3100000 out of 10000000 steps  (31%)
06:17:39:WU02:FS00:0xa4:Completed 3200000 out of 10000000 steps  (32%)
06:19:48:WU02:FS00:0xa4:Completed 3300000 out of 10000000 steps  (33%)
06:21:57:WU02:FS00:0xa4:Completed 3400000 out of 10000000 steps  (34%)
06:24:06:WU02:FS00:0xa4:Completed 3500000 out of 10000000 steps  (35%)
06:26:15:WU02:FS00:0xa4:Completed 3600000 out of 10000000 steps  (36%)
06:28:25:WU02:FS00:0xa4:Completed 3700000 out of 10000000 steps  (37%)
06:30:34:WU02:FS00:0xa4:Completed 3800000 out of 10000000 steps  (38%)
06:32:43:WU02:FS00:0xa4:Completed 3900000 out of 10000000 steps  (39%)
06:34:52:WU02:FS00:0xa4:Completed 4000000 out of 10000000 steps  (40%)
06:37:01:WU02:FS00:0xa4:Completed 4100000 out of 10000000 steps  (41%)
06:39:10:WU02:FS00:0xa4:Completed 4200000 out of 10000000 steps  (42%)
06:41:19:WU02:FS00:0xa4:Completed 4300000 out of 10000000 steps  (43%)
06:43:28:WU02:FS00:0xa4:Completed 4400000 out of 10000000 steps  (44%)
06:45:38:WU02:FS00:0xa4:Completed 4500000 out of 10000000 steps  (45%)
06:47:47:WU02:FS00:0xa4:Completed 4600000 out of 10000000 steps  (46%)
06:49:56:WU02:FS00:0xa4:Completed 4700000 out of 10000000 steps  (47%)
06:52:05:WU02:FS00:0xa4:Completed 4800000 out of 10000000 steps  (48%)
06:54:14:WU02:FS00:0xa4:Completed 4900000 out of 10000000 steps  (49%)
06:56:23:WU02:FS00:0xa4:Completed 5000000 out of 10000000 steps  (50%)
06:58:32:WU02:FS00:0xa4:Completed 5100000 out of 10000000 steps  (51%)
07:54:46:WU02:FS00:0xa4:Completed 5200000 out of 10000000 steps  (52%)
09:28:06:WU02:FS00:0xa4:Completed 5300000 out of 10000000 steps  (53%)
******************************** Date: 01/08/12 ********************************
11:04:32:WU02:FS00:0xa4:Completed 5400000 out of 10000000 steps  (54%)
12:37:42:WU02:FS00:0xa4:Completed 5500000 out of 10000000 steps  (55%)
14:13:35:WU02:FS00:0xa4:Completed 5600000 out of 10000000 steps  (56%)
15:47:21:WU02:FS00:0xa4:Completed 5700000 out of 10000000 steps  (57%)

Here's the full log including both SMP and GPU clients without separating them:

Code: Select all

*********************** Log Started 2012-08-01T04:31:52Z ***********************
04:31:52:************************* Folding@home Client *************************
04:31:52:      Website: http://folding.stanford.edu/
04:31:52:    Copyright: (c) 2009-2012 Stanford University
04:31:52:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
04:31:52:         Args: --lifeline 5944 --command-port=36330
04:31:52:       Config: C:/ProgramData/FAHClient/config.xml
04:31:52:******************************** Build ********************************
04:31:52:      Version: 7.1.52
04:31:52:         Date: Mar 20 2012
04:31:52:         Time: 19:37:42
04:31:52:      SVN Rev: 3515
04:31:52:       Branch: fah/trunk/client
04:31:52:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
04:31:52:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
04:31:52:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT
04:31:52:     Platform: win32 XP
04:31:52:         Bits: 32
04:31:52:         Mode: Release
04:31:52:******************************* System ********************************
04:31:52:          CPU: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz
04:31:52:       CPU ID: GenuineIntel Family 6 Model 26 Stepping 5
04:31:52:         CPUs: 8
04:31:52:       Memory: 11.99GiB
04:31:52:  Free Memory: 10.33GiB
04:31:52:      Threads: WINDOWS_THREADS
04:31:52:   On Battery: false
04:31:52:   UTC offset: -3
04:31:52:          PID: 4976
04:31:52:          CWD: C:/ProgramData/FAHClient
04:31:52:           OS: Windows 7 Ultimate N
04:31:52:      OS Arch: AMD64
04:31:52:         GPUs: 2
04:31:52:        GPU 0: UNSUPPORTED: GK104 [Geforce GTX 680]
04:31:52:        GPU 1: FERMI:1 GF114 [GeForce GTX 680]
04:31:52:         CUDA: 3.0
04:31:52:  CUDA Driver: 5000
04:31:52:Win32 Service: false
04:31:52:***********************************************************************
04:31:52:<config>
04:31:52:  <service-description v='Folding@home Client'/>
04:31:52:  <service-restart v='true'/>
04:31:52:  <service-restart-delay v='5000'/>
04:31:52:
04:31:52:  <!-- Client Control -->
04:31:52:  <cycle-rate v='4'/>
04:31:52:  <cycles v='-1'/>
04:31:52:  <data-directory v='.'/>
04:31:52:  <disable-project-lookup v='false'/>
04:31:52:  <exec-directory v='C:\Program Files (x86)\FAHClient'/>
04:31:52:  <exit-when-done v='false'/>
04:31:52:  <threads v='4'/>
04:31:52:
04:31:52:  <!-- Configuration -->
04:31:52:  <config-rotate v='true'/>
04:31:52:  <config-rotate-dir v='configs'/>
04:31:52:  <config-rotate-max v='16'/>
04:31:52:
04:31:52:  <!-- Debugging -->
04:31:52:  <assignment-servers>
04:31:52:    assign3.stanford.edu:8080 assign4.stanford.edu:80
04:31:52:  </assignment-servers>
04:31:52:  <capture-directory v='capture'/>
04:31:52:  <capture-sockets v='false'/>
04:31:52:  <debug-sockets v='false'/>
04:31:52:  <exception-locations v='true'/>
04:31:52:  <gpu-assignment-servers>
04:31:52:    assign-GPU.stanford.edu:80 assign-GPU.stanford.edu:8080
04:31:52:  </gpu-assignment-servers>
04:31:52:  <stack-traces v='false'/>
04:31:52:
04:31:52:  <!-- Error Handling -->
04:31:52:  <max-slot-errors v='5'/>
04:31:52:  <max-unit-errors v='5'/>
04:31:52:
04:31:52:  <!-- FahCore Control -->
04:31:52:  <checkpoint v='15'/>
04:31:52:  <core-dir v='cores'/>
04:31:52:  <core-priority v='idle'/>
04:31:52:  <cpu-affinity v='false'/>
04:31:52:  <cpu-usage v='98'/>
04:31:52:  <no-assembly v='false'/>
04:31:52:
04:31:52:  <!-- Folding Slot Configuration -->
04:31:52:  <client-subtype v='STDCLI'/>
04:31:52:  <client-type v='normal'/>
04:31:52:  <cpu-species v='X86_PENTIUM_II'/>
04:31:52:  <cpu-type v='AMD64'/>
04:31:52:  <cpus v='-1'/>
04:31:52:  <cuda-index v='0'/>
04:31:52:  <gpu v='true'/>
04:31:52:  <gpu-usage v='100'/>
04:31:52:  <max-packet-size v='normal'/>
04:31:52:  <opencl-index v='0'/>
04:31:52:  <os-species v='UNKNOWN'/>
04:31:52:  <os-type v='WIN32'/>
04:31:52:  <project-key v='0'/>
04:31:52:  <smp v='false'/>
04:31:52:
04:31:52:  <!-- Logging -->
04:31:52:  <log v='log.txt'/>
04:31:52:  <log-color v='false'/>
04:31:52:  <log-crlf v='true'/>
04:31:52:  <log-date v='false'/>
04:31:52:  <log-date-periodically v='21600'/>
04:31:52:  <log-debug v='true'/>
04:31:52:  <log-domain v='false'/>
04:31:52:  <log-header v='true'/>
04:31:52:  <log-level v='true'/>
04:31:52:  <log-no-info-header v='true'/>
04:31:52:  <log-redirect v='false'/>
04:31:52:  <log-rotate v='true'/>
04:31:52:  <log-rotate-dir v='logs'/>
04:31:52:  <log-rotate-max v='16'/>
04:31:52:  <log-short-level v='false'/>
04:31:52:  <log-simple-domains v='true'/>
04:31:52:  <log-thread-id v='false'/>
04:31:52:  <log-thread-prefix v='true'/>
04:31:52:  <log-time v='true'/>
04:31:52:  <log-to-screen v='true'/>
04:31:52:  <log-truncate v='false'/>
04:31:52:  <verbosity v='5'/>
04:31:52:
04:31:52:  <!-- Network -->
04:31:52:  <proxy v=':8080'/>
04:31:52:  <proxy-enable v='false'/>
04:31:52:  <proxy-pass v=''/>
04:31:52:  <proxy-user v=''/>
04:31:52:
04:31:52:  <!-- Process Control -->
04:31:52:  <child v='false'/>
04:31:52:  <daemon v='false'/>
04:31:52:  <pid v='false'/>
04:31:52:  <pid-file v='Folding@home Client.pid'/>
04:31:52:  <respawn v='false'/>
04:31:52:  <service v='false'/>
04:31:52:
04:31:52:  <!-- Remote Command Server -->
04:31:52:  <command-address v='0.0.0.0'/>
04:31:52:  <command-allow v='127.0.0.1'/>
04:31:52:  <command-allow-no-pass v='127.0.0.1'/>
04:31:52:  <command-deny v='0.0.0.0/0'/>
04:31:52:  <command-deny-no-pass v='0.0.0.0/0'/>
04:31:52:  <command-port v='36330'/>
04:31:52:
04:31:52:  <!-- Slot Control -->
04:31:52:  <max-shutdown-wait v='60'/>
04:31:52:  <pause-on-battery v='false'/>
04:31:52:  <pause-on-start v='false'/>
04:31:52:
04:31:52:  <!-- User Information -->
04:31:52:  <machine-id v='0'/>
04:31:52:  <passkey v='********************************'/>
04:31:52:  <team v='54196'/>
04:31:52:  <user v='sswilson'/>
04:31:52:
04:31:52:  <!-- Work Unit Control -->
04:31:52:  <dump-after-deadline v='true'/>
04:31:52:  <max-queue v='16'/>
04:31:52:  <max-units v='0'/>
04:31:52:  <next-unit-percentage v='99'/>
04:31:52:
04:31:52:  <!-- Folding Slots -->
04:31:52:  <slot id='0' type='SMP'>
04:31:52:    <client-type v='advanced'/>
04:31:52:    <cpus v='-1'/>
04:31:52:  </slot>
04:31:52:  <slot id='1' type='GPU'>
04:31:52:    <client-type v='advanced'/>
04:31:52:  </slot>
04:31:52:</config>
04:31:53:Trying to access database...
04:31:53:Successfully acquired database lock
04:31:53:Enabled folding slot 00: READY smp:8
04:31:53:Enabled folding slot 01: READY gpu:1:"GF114 [GeForce GTX 680]"
04:31:53:Started thread 3 on PID 4976
04:31:53:Started thread 1 on PID 4976
04:31:53:Started thread 4 on PID 4976
04:31:53:Started thread 5 on PID 4976
04:31:53:Started thread 6 on PID 4976
04:31:53:WU00:FS01:Starting
04:31:53:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/beta/Core_15.fah/FahCore_15.exe -dir 00 -suffix 01 -version 701 -lifeline 4976 -checkpoint 15 -cpu 98 -gpu 0
04:31:53:WU00:FS01:Started FahCore on PID 2508
04:31:53:Started thread 7 on PID 4976
04:31:53:WU00:FS01:Core PID:6056
04:31:53:WU00:FS01:FahCore 0x15 started
04:31:53:WU01:FS00:Starting
04:31:53:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 701 -lifeline 4976 -checkpoint 15 -cpu 98 -np 8
04:31:53:WU01:FS00:Started FahCore on PID 3812
04:31:53:Started thread 8 on PID 4976
04:31:53:WU01:FS00:Core PID:2128
04:31:53:WU01:FS00:FahCore 0xa4 started
04:31:53:WU00:FS01:0x15:
04:31:53:WU00:FS01:0x15:*------------------------------*
04:31:53:WU00:FS01:0x15:Folding@Home GPU Core
04:31:53:WU00:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
04:31:53:WU00:FS01:0x15:Build host             AmoebaRemote
04:31:53:WU00:FS01:0x15:Board Type             NVIDIA/CUDA
04:31:53:WU00:FS01:0x15:Core                   15
04:31:53:WU00:FS01:0x15:
04:31:53:WU00:FS01:0x15:Window's signal control handler registered.
04:31:53:WU00:FS01:0x15:Preparing to commence simulation
04:31:53:WU00:FS01:0x15:- Looking at optimizations...
04:31:53:WU00:FS01:0x15:- Files status OK
04:31:53:WU00:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
04:31:53:WU00:FS01:0x15:- Expanded 145963 -> 660986 (decompressed 452.8 percent)
04:31:53:WU00:FS01:0x15:Called DecompressByteArray: compressed_data_size=145963 data_size=660986, decompressed_data_size=660986 diff=0
04:31:53:WU00:FS01:0x15:- Digital signature verified
04:31:53:WU00:FS01:0x15:
04:31:53:WU00:FS01:0x15:Project: 8018 (Run 249, Clone 0, Gen 8)
04:31:53:WU00:FS01:0x15:
04:31:53:WU00:FS01:0x15:Assembly optimizations on if available.
04:31:53:WU00:FS01:0x15:Entering M.D.
04:31:53:WU01:FS00:0xa4:
04:31:53:WU01:FS00:0xa4:*------------------------------*
04:31:53:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
04:31:53:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
04:31:53:WU01:FS00:0xa4:
04:31:53:WU01:FS00:0xa4:Preparing to commence simulation
04:31:53:WU01:FS00:0xa4:- Looking at optimizations...
04:31:53:WU01:FS00:0xa4:- Files status OK
04:31:53:WU01:FS00:0xa4:- Expanded 544709 -> 1305024 (decompressed 239.5 percent)
04:31:53:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=544709 data_size=1305024, decompressed_data_size=1305024 diff=0
04:31:53:WU01:FS00:0xa4:- Digital signature verified
04:31:53:WU01:FS00:0xa4:
04:31:53:WU01:FS00:0xa4:Project: 8004 (Run 63, Clone 52, Gen 6)
04:31:53:WU01:FS00:0xa4:
04:31:53:WU01:FS00:0xa4:Assembly optimizations on if available.
04:31:53:WU01:FS00:0xa4:Entering M.D.
04:31:55:WU00:FS01:0x15:Will resume from checkpoint file 00/wudata_01.ckp
04:31:55:WU00:FS01:0x15:Tpr hash 00/wudata_01.tpr:  1410605951 2068024195 2384119146 2102169074 420418561
04:31:55:WU00:FS01:0x15:GPU device id=0
04:31:55:WU00:FS01:0x15:Working on GRowing Old MAkes el Chrono Sweat
04:31:55:WU00:FS01:0x15:Client config unavailable.
04:31:55:WU00:FS01:0x15:Starting GUI Server
04:31:56:Server connection id=1 on 0.0.0.0:36330 from 127.0.0.1
04:31:56:Started thread 9 on PID 4976
04:31:59:WU01:FS00:0xa4:Using Gromacs checkpoints
04:31:59:WU01:FS00:0xa4:Mapping NT from 8 to 8 
04:31:59:WU01:FS00:0xa4:Resuming from checkpoint
04:31:59:WU01:FS00:0xa4:Verified 01/wudata_01.log
04:31:59:WU01:FS00:0xa4:Verified 01/wudata_01.trr
04:31:59:WU01:FS00:0xa4:Verified 01/wudata_01.xtc
04:31:59:WU01:FS00:0xa4:Verified 01/wudata_01.edr
04:31:59:WU01:FS00:0xa4:Completed 116560 out of 250000 steps  (46%)
04:32:04:FS01:Paused
04:32:04:FS01:Shutting core down
04:32:09:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
04:32:15:WU01:FS00:0xa4:Completed 117500 out of 250000 steps  (47%)
04:32:54:WU01:FS00:0xa4:Completed 120000 out of 250000 steps  (48%)
04:33:31:WU01:FS00:0xa4:Completed 122500 out of 250000 steps  (49%)
04:34:09:WU01:FS00:0xa4:Completed 125000 out of 250000 steps  (50%)
04:34:47:WU01:FS00:0xa4:Completed 127500 out of 250000 steps  (51%)
04:35:25:WU01:FS00:0xa4:Completed 130000 out of 250000 steps  (52%)
04:36:02:WU01:FS00:0xa4:Completed 132500 out of 250000 steps  (53%)
04:36:40:WU01:FS00:0xa4:Completed 135000 out of 250000 steps  (54%)
04:37:17:WU01:FS00:0xa4:Completed 137500 out of 250000 steps  (55%)
04:37:54:WU01:FS00:0xa4:Completed 140000 out of 250000 steps  (56%)
04:38:32:WU01:FS00:0xa4:Completed 142500 out of 250000 steps  (57%)
04:39:10:WU01:FS00:0xa4:Completed 145000 out of 250000 steps  (58%)
04:39:48:WU01:FS00:0xa4:Completed 147500 out of 250000 steps  (59%)
04:40:26:WU01:FS00:0xa4:Completed 150000 out of 250000 steps  (60%)
04:41:08:WU01:FS00:0xa4:Completed 152500 out of 250000 steps  (61%)
04:41:50:WU01:FS00:0xa4:Completed 155000 out of 250000 steps  (62%)
04:42:31:WU01:FS00:0xa4:Completed 157500 out of 250000 steps  (63%)
04:43:11:WU01:FS00:0xa4:Completed 160000 out of 250000 steps  (64%)
04:43:49:WU01:FS00:0xa4:Completed 162500 out of 250000 steps  (65%)
04:44:28:WU01:FS00:0xa4:Completed 165000 out of 250000 steps  (66%)
04:45:07:WU01:FS00:0xa4:Completed 167500 out of 250000 steps  (67%)
04:45:45:WU01:FS00:0xa4:Completed 170000 out of 250000 steps  (68%)
04:46:24:WU01:FS00:0xa4:Completed 172500 out of 250000 steps  (69%)
04:47:04:WU01:FS00:0xa4:Completed 175000 out of 250000 steps  (70%)
04:47:45:WU01:FS00:0xa4:Completed 177500 out of 250000 steps  (71%)
04:48:23:WU01:FS00:0xa4:Completed 180000 out of 250000 steps  (72%)
04:49:01:WU01:FS00:0xa4:Completed 182500 out of 250000 steps  (73%)
04:49:38:WU01:FS00:0xa4:Completed 185000 out of 250000 steps  (74%)
04:50:16:WU01:FS00:0xa4:Completed 187500 out of 250000 steps  (75%)
04:50:53:WU01:FS00:0xa4:Completed 190000 out of 250000 steps  (76%)
04:51:32:WU01:FS00:0xa4:Completed 192500 out of 250000 steps  (77%)
04:52:17:WU01:FS00:0xa4:Completed 195000 out of 250000 steps  (78%)
04:53:01:WU01:FS00:0xa4:Completed 197500 out of 250000 steps  (79%)
04:53:45:WU01:FS00:0xa4:Completed 200000 out of 250000 steps  (80%)
04:54:29:WU01:FS00:0xa4:Completed 202500 out of 250000 steps  (81%)
04:55:11:WU01:FS00:0xa4:Completed 205000 out of 250000 steps  (82%)
04:55:52:WU01:FS00:0xa4:Completed 207500 out of 250000 steps  (83%)
04:56:33:WU01:FS00:0xa4:Completed 210000 out of 250000 steps  (84%)
04:57:16:WU01:FS00:0xa4:Completed 212500 out of 250000 steps  (85%)
04:57:53:WU01:FS00:0xa4:Completed 215000 out of 250000 steps  (86%)
04:58:33:WU01:FS00:0xa4:Completed 217500 out of 250000 steps  (87%)
04:59:10:WU01:FS00:0xa4:Completed 220000 out of 250000 steps  (88%)
04:59:48:WU01:FS00:0xa4:Completed 222500 out of 250000 steps  (89%)
05:00:26:WU01:FS00:0xa4:Completed 225000 out of 250000 steps  (90%)
05:01:02:WU01:FS00:0xa4:Completed 227500 out of 250000 steps  (91%)
05:01:39:WU01:FS00:0xa4:Completed 230000 out of 250000 steps  (92%)
05:02:16:WU01:FS00:0xa4:Completed 232500 out of 250000 steps  (93%)
05:02:52:WU01:FS00:0xa4:Completed 235000 out of 250000 steps  (94%)
05:03:01:FS01:Unpaused
05:03:01:WU00:FS01:Starting
05:03:01:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/beta/Core_15.fah/FahCore_15.exe -dir 00 -suffix 01 -version 701 -lifeline 4976 -checkpoint 15 -cpu 98 -gpu 0
05:03:01:WU00:FS01:Started FahCore on PID 984
05:03:01:Started thread 10 on PID 4976
05:03:01:WU00:FS01:Core PID:4380
05:03:01:WU00:FS01:FahCore 0x15 started
05:03:02:WU00:FS01:0x15:
05:03:02:WU00:FS01:0x15:*------------------------------*
05:03:02:WU00:FS01:0x15:Folding@Home GPU Core
05:03:02:WU00:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
05:03:02:WU00:FS01:0x15:Build host             AmoebaRemote
05:03:02:WU00:FS01:0x15:Board Type             NVIDIA/CUDA
05:03:02:WU00:FS01:0x15:Core                   15
05:03:02:WU00:FS01:0x15:
05:03:02:WU00:FS01:0x15:Window's signal control handler registered.
05:03:02:WU00:FS01:0x15:Preparing to commence simulation
05:03:02:WU00:FS01:0x15:- Looking at optimizations...
05:03:02:WU00:FS01:0x15:- Files status OK
05:03:02:WU00:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
05:03:02:WU00:FS01:0x15:- Expanded 145963 -> 660986 (decompressed 452.8 percent)
05:03:02:WU00:FS01:0x15:Called DecompressByteArray: compressed_data_size=145963 data_size=660986, decompressed_data_size=660986 diff=0
05:03:02:WU00:FS01:0x15:- Digital signature verified
05:03:02:WU00:FS01:0x15:
05:03:02:WU00:FS01:0x15:Project: 8018 (Run 249, Clone 0, Gen 8)
05:03:02:WU00:FS01:0x15:
05:03:02:WU00:FS01:0x15:Assembly optimizations on if available.
05:03:02:WU00:FS01:0x15:Entering M.D.
05:03:03:WU00:FS01:0x15:Will resume from checkpoint file 00/wudata_01.ckp
05:03:03:WU00:FS01:0x15:Tpr hash 00/wudata_01.tpr:  1410605951 2068024195 2384119146 2102169074 420418561
05:03:03:WU00:FS01:0x15:GPU device id=0
05:03:03:WU00:FS01:0x15:Working on GRowing Old MAkes el Chrono Sweat
05:03:03:WU00:FS01:0x15:Client config unavailable.
05:03:04:WU00:FS01:0x15:Starting GUI Server
05:03:31:WU01:FS00:0xa4:Completed 237500 out of 250000 steps  (95%)
05:04:05:WU00:FS01:0x15:Resuming from checkpoint
05:04:05:WU00:FS01:0x15:fcCheckPointResume: retreived and current tpr file hash:
05:04:05:WU00:FS01:0x15:   0   1410605951   1410605951
05:04:05:WU00:FS01:0x15:   1   2068024195   2068024195
05:04:05:WU00:FS01:0x15:   2   2384119146   2384119146
05:04:05:WU00:FS01:0x15:   3   2102169074   2102169074
05:04:05:WU00:FS01:0x15:   4    420418561    420418561
05:04:05:WU00:FS01:0x15:fcCheckPointResume: file hashes same.
05:04:05:WU00:FS01:0x15:fcCheckPointResume: state restored.
05:04:05:WU00:FS01:0x15:fcCheckPointResume: name 00/wudata_01.log Verified 00/wudata_01.log
05:04:05:WU00:FS01:0x15:fcCheckPointResume: name 00/wudata_01.trr Verified 00/wudata_01.trr
05:04:05:WU00:FS01:0x15:fcCheckPointResume: name 00/wudata_01.xtc Verified 00/wudata_01.xtc
05:04:05:WU00:FS01:0x15:fcCheckPointResume: name 00/wudata_01.edr Verified 00/wudata_01.edr
05:04:05:WU00:FS01:0x15:fcCheckPointResume: state restored 2
05:04:05:WU00:FS01:0x15:Resumed from checkpoint
05:04:05:WU00:FS01:0x15:Setting checkpoint frequency: 250000
05:04:05:WU00:FS01:0x15:Completed  17000001 out of 25000000 steps (68%).
05:04:09:WU01:FS00:0xa4:Completed 240000 out of 250000 steps  (96%)
05:04:48:WU01:FS00:0xa4:Completed 242500 out of 250000 steps  (97%)
05:05:26:WU01:FS00:0xa4:Completed 245000 out of 250000 steps  (98%)
05:06:05:WU01:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
05:06:44:WU01:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
05:06:44:WU01:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
05:06:44:WU02:FS00:Connecting to assign3.stanford.edu:8080
05:06:45:WU02:FS00:News: Welcome to Folding@Home
05:06:45:WU02:FS00:Assigned to work server 129.74.85.15
05:06:45:WU02:FS00:Requesting new work unit for slot 00: RUNNING smp:8 from 129.74.85.15
05:06:45:WU02:FS00:Connecting to 129.74.85.15:8080
05:06:45:WU02:FS00:Downloading 48.88KiB
05:06:45:WU02:FS00:Download complete
05:06:45:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:OK project:10090 run:151 clone:0 gen:171 core:0xa4 unit:0x000001b80001329c4dfb5721b3f98ff1
05:06:45:WU02:FS00:Downloading project 10090 description
05:06:45:WU02:FS00:Connecting to fah-web.stanford.edu:80
05:06:46:WU02:FS00:Project 10090 description downloaded successfully
05:06:54:WU01:FS00:0xa4:
05:06:54:WU01:FS00:0xa4:Finished Work Unit:
05:06:54:WU01:FS00:0xa4:- Reading up to 769668 from "01/wudata_01.trr": Read 769668
05:06:54:WU01:FS00:0xa4:trr file hash check passed.
05:06:54:WU01:FS00:0xa4:- Reading up to 456008 from "01/wudata_01.xtc": Read 456008
05:06:54:WU01:FS00:0xa4:xtc file hash check passed.
05:06:54:WU01:FS00:0xa4:edr file hash check passed.
05:06:54:WU01:FS00:0xa4:logfile size: 23459
05:06:54:WU01:FS00:0xa4:Leaving Run
05:06:54:WU01:FS00:0xa4:- Writing 1254539 bytes of core data to disk...
05:06:54:WU01:FS00:0xa4:Done: 1254027 -> 1193084 (compressed to 95.1 percent)
05:06:54:WU01:FS00:0xa4:  ... Done.
05:06:54:WU01:FS00:0xa4:- Shutting down core
05:06:54:WU01:FS00:0xa4:
05:06:54:WU01:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
05:06:55:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
05:06:55:WU01:FS00:Sending unit results: id:01 state:SEND error:OK project:8004 run:63 clone:52 gen:6 core:0xa4 unit:0x0000000a6652edcb4eee562cb928fb4e
05:06:55:WU01:FS00:Uploading 1.14MiB to 171.67.108.59
05:06:55:WU01:FS00:Connecting to 171.67.108.59:8080
05:06:55:WU02:FS00:Starting
05:06:55:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 02 -suffix 01 -version 701 -lifeline 4976 -checkpoint 15 -cpu 98 -np 8
05:06:55:WU02:FS00:Started FahCore on PID 1952
05:06:55:Started thread 11 on PID 4976
05:06:55:WU02:FS00:Core PID:2204
05:06:55:WU02:FS00:FahCore 0xa4 started
05:06:55:WU02:FS00:0xa4:
05:06:55:WU02:FS00:0xa4:*------------------------------*
05:06:55:WU02:FS00:0xa4:Folding@Home Gromacs GB Core
05:06:55:WU02:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
05:06:55:WU02:FS00:0xa4:
05:06:55:WU02:FS00:0xa4:Preparing to commence simulation
05:06:55:WU02:FS00:0xa4:- Looking at optimizations...
05:06:55:WU02:FS00:0xa4:- Created dyn
05:06:55:WU02:FS00:0xa4:- Files status OK
05:06:55:WU02:FS00:0xa4:- Expanded 49540 -> 197152 (decompressed 397.9 percent)
05:06:55:WU02:FS00:0xa4:Called DecompressByteArray: compressed_data_size=49540 data_size=197152, decompressed_data_size=197152 diff=0
05:06:55:WU02:FS00:0xa4:- Digital signature verified
05:06:55:WU02:FS00:0xa4:
05:06:55:WU02:FS00:0xa4:Project: 10090 (Run 151, Clone 0, Gen 171)
05:06:55:WU02:FS00:0xa4:
05:06:55:WU02:FS00:0xa4:Assembly optimizations on if available.
05:06:55:WU02:FS00:0xa4:Entering M.D.
05:07:01:WU01:FS00:Upload 32.94%
05:07:01:WU02:FS00:0xa4:Mapping NT from 8 to 8 
05:07:01:WU02:FS00:0xa4:Completed 0 out of 10000000 steps  (0%)
05:07:07:WU01:FS00:Upload 60.40%
05:07:13:WU01:FS00:Upload 87.85%
05:07:15:WU01:FS00:Upload complete
05:07:15:WU01:FS00:Server responded WORK_ACK (400)
05:07:15:WU01:FS00:Final credit estimate, 263.00 points
05:07:15:WU01:FS00:Cleaning up
05:07:41:WU00:FS01:0x15:Completed  17250000 out of 25000000 steps (69%).
05:09:11:WU02:FS00:0xa4:Completed 100000 out of 10000000 steps  (1%)
05:11:17:WU00:FS01:0x15:Completed  17500000 out of 25000000 steps (70%).
05:11:21:WU02:FS00:0xa4:Completed 200000 out of 10000000 steps  (2%)
05:13:30:WU02:FS00:0xa4:Completed 300000 out of 10000000 steps  (3%)
05:14:53:WU00:FS01:0x15:Completed  17750000 out of 25000000 steps (71%).
05:15:40:WU02:FS00:0xa4:Completed 400000 out of 10000000 steps  (4%)
05:17:49:WU02:FS00:0xa4:Completed 500000 out of 10000000 steps  (5%)
05:18:30:WU00:FS01:0x15:Completed  18000000 out of 25000000 steps (72%).
05:19:58:WU02:FS00:0xa4:Completed 600000 out of 10000000 steps  (6%)
05:22:05:WU00:FS01:0x15:Completed  18250000 out of 25000000 steps (73%).
05:22:08:WU02:FS00:0xa4:Completed 700000 out of 10000000 steps  (7%)
05:24:17:WU02:FS00:0xa4:Completed 800000 out of 10000000 steps  (8%)
05:25:41:WU00:FS01:0x15:Completed  18500000 out of 25000000 steps (74%).
05:26:26:WU02:FS00:0xa4:Completed 900000 out of 10000000 steps  (9%)
05:29:17:WU00:FS01:0x15:Completed  18750000 out of 25000000 steps (75%).
05:29:43:WU02:FS00:0xa4:Completed 1000000 out of 10000000 steps  (10%)
05:31:52:WU02:FS00:0xa4:Completed 1100000 out of 10000000 steps  (11%)
05:32:52:WU00:FS01:0x15:Completed  19000000 out of 25000000 steps (76%).
05:34:02:WU02:FS00:0xa4:Completed 1200000 out of 10000000 steps  (12%)
05:36:11:WU02:FS00:0xa4:Completed 1300000 out of 10000000 steps  (13%)
05:36:28:WU00:FS01:0x15:Completed  19250000 out of 25000000 steps (77%).
05:38:20:WU02:FS00:0xa4:Completed 1400000 out of 10000000 steps  (14%)
05:40:04:WU00:FS01:0x15:Completed  19500000 out of 25000000 steps (78%).
05:40:29:WU02:FS00:0xa4:Completed 1500000 out of 10000000 steps  (15%)
05:42:38:WU02:FS00:0xa4:Completed 1600000 out of 10000000 steps  (16%)
05:43:39:WU00:FS01:0x15:Completed  19750000 out of 25000000 steps (79%).
05:44:47:WU02:FS00:0xa4:Completed 1700000 out of 10000000 steps  (17%)
05:46:55:WU02:FS00:0xa4:Completed 1800000 out of 10000000 steps  (18%)
05:47:15:WU00:FS01:0x15:Completed  20000000 out of 25000000 steps (80%).
05:49:05:WU02:FS00:0xa4:Completed 1900000 out of 10000000 steps  (19%)
05:50:51:WU00:FS01:0x15:Completed  20250000 out of 25000000 steps (81%).
05:51:14:WU02:FS00:0xa4:Completed 2000000 out of 10000000 steps  (20%)
05:53:23:WU02:FS00:0xa4:Completed 2100000 out of 10000000 steps  (21%)
05:54:27:WU00:FS01:0x15:Completed  20500000 out of 25000000 steps (82%).
05:55:32:WU02:FS00:0xa4:Completed 2200000 out of 10000000 steps  (22%)
05:57:41:WU02:FS00:0xa4:Completed 2300000 out of 10000000 steps  (23%)
05:58:02:WU00:FS01:0x15:Completed  20750000 out of 25000000 steps (83%).
06:00:25:WU02:FS00:0xa4:Completed 2400000 out of 10000000 steps  (24%)
06:01:38:WU00:FS01:0x15:Completed  21000000 out of 25000000 steps (84%).
06:02:34:WU02:FS00:0xa4:Completed 2500000 out of 10000000 steps  (25%)
06:04:43:WU02:FS00:0xa4:Completed 2600000 out of 10000000 steps  (26%)
06:05:14:WU00:FS01:0x15:Completed  21250000 out of 25000000 steps (85%).
06:06:53:WU02:FS00:0xa4:Completed 2700000 out of 10000000 steps  (27%)
06:08:50:WU00:FS01:0x15:Completed  21500000 out of 25000000 steps (86%).
06:09:02:WU02:FS00:0xa4:Completed 2800000 out of 10000000 steps  (28%)
06:11:11:WU02:FS00:0xa4:Completed 2900000 out of 10000000 steps  (29%)
06:12:25:WU00:FS01:0x15:Completed  21750000 out of 25000000 steps (87%).
06:13:20:WU02:FS00:0xa4:Completed 3000000 out of 10000000 steps  (30%)
06:15:29:WU02:FS00:0xa4:Completed 3100000 out of 10000000 steps  (31%)
06:16:01:WU00:FS01:0x15:Completed  22000000 out of 25000000 steps (88%).
06:17:39:WU02:FS00:0xa4:Completed 3200000 out of 10000000 steps  (32%)
06:19:37:WU00:FS01:0x15:Completed  22250000 out of 25000000 steps (89%).
06:19:48:WU02:FS00:0xa4:Completed 3300000 out of 10000000 steps  (33%)
06:21:57:WU02:FS00:0xa4:Completed 3400000 out of 10000000 steps  (34%)
06:23:13:WU00:FS01:0x15:Completed  22500000 out of 25000000 steps (90%).
06:24:06:WU02:FS00:0xa4:Completed 3500000 out of 10000000 steps  (35%)
06:26:15:WU02:FS00:0xa4:Completed 3600000 out of 10000000 steps  (36%)
06:26:48:WU00:FS01:0x15:Completed  22750000 out of 25000000 steps (91%).
06:28:25:WU02:FS00:0xa4:Completed 3700000 out of 10000000 steps  (37%)
06:30:24:WU00:FS01:0x15:Completed  23000000 out of 25000000 steps (92%).
06:30:34:WU02:FS00:0xa4:Completed 3800000 out of 10000000 steps  (38%)
06:32:43:WU02:FS00:0xa4:Completed 3900000 out of 10000000 steps  (39%)
06:34:00:WU00:FS01:0x15:Completed  23250000 out of 25000000 steps (93%).
06:34:52:WU02:FS00:0xa4:Completed 4000000 out of 10000000 steps  (40%)
06:37:01:WU02:FS00:0xa4:Completed 4100000 out of 10000000 steps  (41%)
06:37:36:WU00:FS01:0x15:Completed  23500000 out of 25000000 steps (94%).
06:39:10:WU02:FS00:0xa4:Completed 4200000 out of 10000000 steps  (42%)
06:41:12:WU00:FS01:0x15:Completed  23750000 out of 25000000 steps (95%).
06:41:19:WU02:FS00:0xa4:Completed 4300000 out of 10000000 steps  (43%)
06:43:28:WU02:FS00:0xa4:Completed 4400000 out of 10000000 steps  (44%)
06:44:47:WU00:FS01:0x15:Completed  24000000 out of 25000000 steps (96%).
06:45:38:WU02:FS00:0xa4:Completed 4500000 out of 10000000 steps  (45%)
06:47:47:WU02:FS00:0xa4:Completed 4600000 out of 10000000 steps  (46%)
06:48:23:WU00:FS01:0x15:Completed  24250000 out of 25000000 steps (97%).
06:49:56:WU02:FS00:0xa4:Completed 4700000 out of 10000000 steps  (47%)
06:51:59:WU00:FS01:0x15:Completed  24500000 out of 25000000 steps (98%).
06:52:05:WU02:FS00:0xa4:Completed 4800000 out of 10000000 steps  (48%)
06:54:14:WU02:FS00:0xa4:Completed 4900000 out of 10000000 steps  (49%)
06:55:34:WU00:FS01:0x15:Completed  24750000 out of 25000000 steps (99%).
06:55:35:WU01:FS01:Connecting to assign-GPU.stanford.edu:80
06:55:35:WU01:FS01:News: Welcome to Folding@Home
06:55:35:WU01:FS01:Assigned to work server 171.67.108.141
06:55:35:WU01:FS01:Requesting new work unit for slot 01: RUNNING gpu:1:"GF114 [GeForce GTX 680]" from 171.67.108.141
06:55:35:WU01:FS01:Connecting to 171.67.108.141:8080
06:55:36:WU01:FS01:Downloading 65.06KiB
06:55:36:WU01:FS01:Download complete
06:55:36:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:OK project:8008 run:9 clone:64 gen:124 core:0x15 unit:0x0000008c6953ee2d4f9748ae5a51eb59
06:56:23:WU02:FS00:0xa4:Completed 5000000 out of 10000000 steps  (50%)
06:58:32:WU02:FS00:0xa4:Completed 5100000 out of 10000000 steps  (51%)
06:59:10:WU00:FS01:0x15:Completed  25000000 out of 25000000 steps (100%).
06:59:11:WU00:FS01:0x15:Finished fah_main status=0
06:59:11:WU00:FS01:0x15:Successful run
06:59:11:WU00:FS01:0x15:DynamicWrapper: Finished Work Unit: sleep=10000
06:59:21:WU00:FS01:0x15:Reserved 436028 bytes for xtc file; Cosm status=0
06:59:21:WU00:FS01:0x15:Allocated 436028 bytes for xtc file
06:59:21:WU00:FS01:0x15:- Reading up to 436028 from "00/wudata_01.xtc": Read 436028
06:59:21:WU00:FS01:0x15:Read 436028 bytes from xtc file; available packet space=785994436
06:59:21:WU00:FS01:0x15:xtc file hash check passed.
06:59:21:WU00:FS01:0x15:Reserved 54408 54408 785994436 bytes for arc file=<00/wudata_01.trr> Cosm status=0
06:59:21:WU00:FS01:0x15:Allocated 54408 bytes for arc file
06:59:21:WU00:FS01:0x15:- Reading up to 54408 from "00/wudata_01.trr": Read 54408
06:59:21:WU00:FS01:0x15:Read 54408 bytes from arc file; available packet space=785940028
06:59:21:WU00:FS01:0x15:trr file hash check passed.
06:59:21:WU00:FS01:0x15:Allocated 544 bytes for edr file
06:59:21:WU00:FS01:0x15:Read bedfile
06:59:21:WU00:FS01:0x15:edr file hash check passed.
06:59:21:WU00:FS01:0x15:Allocated 32328 bytes for logfile
06:59:21:WU00:FS01:0x15:Read logfile
06:59:21:WU00:FS01:0x15:GuardedRun: success in DynamicWrapper
06:59:21:WU00:FS01:0x15:GuardedRun: done
06:59:21:WU00:FS01:0x15:Run: GuardedRun completed.
06:59:22:WU00:FS01:0x15:+ Opened results file
06:59:22:WU00:FS01:0x15:- Writing 523820 bytes of core data to disk...
06:59:22:WU00:FS01:0x15:Done: 523308 -> 501118 (compressed to 95.7 percent)
06:59:22:WU00:FS01:0x15:  ... Done.
06:59:22:WU00:FS01:0x15:DeleteFrameFiles: successfully deleted file=00/wudata_01.ckp
06:59:22:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
06:59:22:WU00:FS01:Sending unit results: id:00 state:SEND error:OK project:8018 run:249 clone:0 gen:8 core:0x15 unit:0x0000000a6953ee2e500f1c25fff1fbb7
06:59:22:WU00:FS01:Uploading 489.87KiB to 171.67.108.142
06:59:22:WU00:FS01:Connecting to 171.67.108.142:8080
06:59:22:WU01:FS01:Starting
06:59:22:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 701 -lifeline 4976 -checkpoint 15 -cpu 98 -gpu 0
06:59:22:WU01:FS01:Started FahCore on PID 2156
06:59:22:Started thread 12 on PID 4976
06:59:22:WU01:FS01:Core PID:2908
06:59:22:WU01:FS01:FahCore 0x15 started
06:59:23:WU01:FS01:0x15:
06:59:23:WU01:FS01:0x15:*------------------------------*
06:59:23:WU01:FS01:0x15:Folding@Home GPU Core
06:59:23:WU01:FS01:0x15:Version                2.22 (Thu Dec 8 17:08:05 PST 2011)
06:59:23:WU01:FS01:0x15:Build host             SimbiosNvdWin7
06:59:23:WU01:FS01:0x15:Board Type             NVIDIA/CUDA
06:59:23:WU01:FS01:0x15:Core                   15
06:59:23:WU01:FS01:0x15:
06:59:23:WU01:FS01:0x15:Window's signal control handler registered.
06:59:23:WU01:FS01:0x15:Preparing to commence simulation
06:59:23:WU01:FS01:0x15:- Looking at optimizations...
06:59:23:WU01:FS01:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
06:59:23:WU01:FS01:0x15:- Created dyn
06:59:23:WU01:FS01:0x15:- Files status OK
06:59:23:WU01:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
06:59:23:WU01:FS01:0x15:- Expanded 66112 -> 287126 (decompressed 434.3 percent)
06:59:23:WU01:FS01:0x15:Called DecompressByteArray: compressed_data_size=66112 data_size=287126, decompressed_data_size=287126 diff=0
06:59:23:WU01:FS01:0x15:- Digital signature verified
06:59:23:WU01:FS01:0x15:
06:59:23:WU01:FS01:0x15:Project: 8008 (Run 9, Clone 64, Gen 124)
06:59:23:WU01:FS01:0x15:
06:59:23:WU01:FS01:0x15:Assembly optimizations on if available.
06:59:23:WU01:FS01:0x15:Entering M.D.
06:59:24:WU01:FS01:0x15:Tpr hash 01/wudata_01.tpr:  246663197 1870251084 629074908 2418385872 726513747
06:59:24:WU01:FS01:0x15:GPU device info: vendor=0 device=0 name=<NA> match=0
06:59:24:WU01:FS01:0x15:Working on Gromacs Runs On Most of All Computer Systems
06:59:24:WU01:FS01:0x15:Client config unavailable.
06:59:25:WU01:FS01:0x15:Starting GUI Server
06:59:28:WU00:FS01:Upload 78.39%
06:59:30:WU00:FS01:Upload complete
06:59:30:WU00:FS01:Server responded WORK_ACK (400)
06:59:30:WU00:FS01:Final credit estimate, 5757.00 points
06:59:30:WU00:FS01:Cleaning up
07:54:46:WU02:FS00:0xa4:Completed 5200000 out of 10000000 steps  (52%)
09:28:06:WU02:FS00:0xa4:Completed 5300000 out of 10000000 steps  (53%)
******************************** Date: 01/08/12 ********************************
11:04:32:WU02:FS00:0xa4:Completed 5400000 out of 10000000 steps  (54%)
12:37:42:WU02:FS00:0xa4:Completed 5500000 out of 10000000 steps  (55%)
14:13:35:WU02:FS00:0xa4:Completed 5600000 out of 10000000 steps  (56%)
15:47:21:WU02:FS00:0xa4:Completed 5700000 out of 10000000 steps  (57%)

Guess I'll shut the GPU client down for a while and try in a few days. Does anybody out there know what the life on the 8008 series WUs is?

[sswilson]

Looking at the SMP TPFs it looks like the hung WU on the GPU is also affecting the SMP client. Now that the GPU slot is deleted, the SMP seemed to be back on track.

Code: Select all

*********************** Log Started 2012-08-01T16:31:15Z ***********************
16:31:15:************************* Folding@home Client *************************
16:31:15:      Website: http://folding.stanford.edu/
16:31:15:    Copyright: (c) 2009-2012 Stanford University
16:31:15:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
16:31:15:         Args: --lifeline 5008 --command-port=36330
16:31:15:       Config: C:/ProgramData/FAHClient/config.xml
16:31:15:******************************** Build ********************************
16:31:15:      Version: 7.1.52
16:31:15:         Date: Mar 20 2012
16:31:15:         Time: 19:37:42
16:31:15:      SVN Rev: 3515
16:31:15:       Branch: fah/trunk/client
16:31:15:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
16:31:15:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
16:31:15:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT
16:31:15:     Platform: win32 XP
16:31:15:         Bits: 32
16:31:15:         Mode: Release
16:31:15:******************************* System ********************************
16:31:15:          CPU: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz
16:31:15:       CPU ID: GenuineIntel Family 6 Model 26 Stepping 5
16:31:15:         CPUs: 8
16:31:15:       Memory: 11.99GiB
16:31:15:  Free Memory: 10.26GiB
16:31:15:      Threads: WINDOWS_THREADS
16:31:15:   On Battery: false
16:31:15:   UTC offset: -3
16:31:15:          PID: 4964
16:31:15:          CWD: C:/ProgramData/FAHClient
16:31:15:           OS: Windows 7 Ultimate N
16:31:15:      OS Arch: AMD64
16:31:15:         GPUs: 2
16:31:15:        GPU 0: UNSUPPORTED: GK104 [Geforce GTX 680]
16:31:15:        GPU 1: FERMI:1 GF114 [GeForce GTX 680]
16:31:15:         CUDA: 3.0
16:31:15:  CUDA Driver: 5000
16:31:15:Win32 Service: false
16:31:15:***********************************************************************
16:31:15:<config>
16:31:15:  <service-description v='Folding@home Client'/>
16:31:15:  <service-restart v='true'/>
16:31:15:  <service-restart-delay v='5000'/>
16:31:15:
16:31:15:  <!-- Client Control -->
16:31:15:  <cycle-rate v='4'/>
16:31:15:  <cycles v='-1'/>
16:31:15:  <data-directory v='.'/>
16:31:15:  <disable-project-lookup v='false'/>
16:31:15:  <exec-directory v='C:\Program Files (x86)\FAHClient'/>
16:31:15:  <exit-when-done v='false'/>
16:31:15:  <threads v='4'/>
16:31:15:
16:31:15:  <!-- Configuration -->
16:31:15:  <config-rotate v='true'/>
16:31:15:  <config-rotate-dir v='configs'/>
16:31:15:  <config-rotate-max v='16'/>
16:31:15:
16:31:15:  <!-- Debugging -->
16:31:15:  <assignment-servers>
16:31:15:    assign3.stanford.edu:8080 assign4.stanford.edu:80
16:31:15:  </assignment-servers>
16:31:15:  <capture-directory v='capture'/>
16:31:15:  <capture-sockets v='false'/>
16:31:15:  <debug-sockets v='false'/>
16:31:15:  <exception-locations v='true'/>
16:31:15:  <gpu-assignment-servers>
16:31:15:    assign-GPU.stanford.edu:80 assign-GPU.stanford.edu:8080
16:31:15:  </gpu-assignment-servers>
16:31:15:  <stack-traces v='false'/>
16:31:15:
16:31:15:  <!-- Error Handling -->
16:31:15:  <max-slot-errors v='5'/>
16:31:15:  <max-unit-errors v='5'/>
16:31:15:
16:31:15:  <!-- FahCore Control -->
16:31:15:  <checkpoint v='15'/>
16:31:15:  <core-dir v='cores'/>
16:31:15:  <core-priority v='idle'/>
16:31:15:  <cpu-affinity v='false'/>
16:31:15:  <cpu-usage v='98'/>
16:31:15:  <no-assembly v='false'/>
16:31:15:
16:31:15:  <!-- Folding Slot Configuration -->
16:31:15:  <client-subtype v='STDCLI'/>
16:31:15:  <client-type v='normal'/>
16:31:15:  <cpu-species v='X86_PENTIUM_II'/>
16:31:15:  <cpu-type v='AMD64'/>
16:31:15:  <cpus v='-1'/>
16:31:15:  <cuda-index v='0'/>
16:31:15:  <gpu v='true'/>
16:31:15:  <gpu-usage v='100'/>
16:31:15:  <max-packet-size v='normal'/>
16:31:15:  <opencl-index v='0'/>
16:31:15:  <os-species v='UNKNOWN'/>
16:31:15:  <os-type v='WIN32'/>
16:31:15:  <project-key v='0'/>
16:31:15:  <smp v='false'/>
16:31:15:
16:31:15:  <!-- Logging -->
16:31:15:  <log v='log.txt'/>
16:31:15:  <log-color v='false'/>
16:31:15:  <log-crlf v='true'/>
16:31:15:  <log-date v='false'/>
16:31:15:  <log-date-periodically v='21600'/>
16:31:15:  <log-debug v='true'/>
16:31:15:  <log-domain v='false'/>
16:31:15:  <log-header v='true'/>
16:31:15:  <log-level v='true'/>
16:31:15:  <log-no-info-header v='true'/>
16:31:15:  <log-redirect v='false'/>
16:31:15:  <log-rotate v='true'/>
16:31:15:  <log-rotate-dir v='logs'/>
16:31:15:  <log-rotate-max v='16'/>
16:31:15:  <log-short-level v='false'/>
16:31:15:  <log-simple-domains v='true'/>
16:31:15:  <log-thread-id v='false'/>
16:31:15:  <log-thread-prefix v='true'/>
16:31:15:  <log-time v='true'/>
16:31:15:  <log-to-screen v='true'/>
16:31:15:  <log-truncate v='false'/>
16:31:15:  <verbosity v='5'/>
16:31:15:
16:31:15:  <!-- Network -->
16:31:15:  <proxy v=':8080'/>
16:31:15:  <proxy-enable v='false'/>
16:31:15:  <proxy-pass v=''/>
16:31:15:  <proxy-user v=''/>
16:31:15:
16:31:15:  <!-- Process Control -->
16:31:15:  <child v='false'/>
16:31:15:  <daemon v='false'/>
16:31:15:  <pid v='false'/>
16:31:15:  <pid-file v='Folding@home Client.pid'/>
16:31:15:  <respawn v='false'/>
16:31:15:  <service v='false'/>
16:31:15:
16:31:15:  <!-- Remote Command Server -->
16:31:15:  <command-address v='0.0.0.0'/>
16:31:15:  <command-allow v='127.0.0.1'/>
16:31:15:  <command-allow-no-pass v='127.0.0.1'/>
16:31:15:  <command-deny v='0.0.0.0/0'/>
16:31:15:  <command-deny-no-pass v='0.0.0.0/0'/>
16:31:15:  <command-port v='36330'/>
16:31:15:
16:31:15:  <!-- Slot Control -->
16:31:15:  <max-shutdown-wait v='60'/>
16:31:15:  <pause-on-battery v='false'/>
16:31:15:  <pause-on-start v='false'/>
16:31:15:
16:31:15:  <!-- User Information -->
16:31:15:  <machine-id v='0'/>
16:31:15:  <passkey v='********************************'/>
16:31:15:  <team v='54196'/>
16:31:15:  <user v='sswilson'/>
16:31:15:
16:31:15:  <!-- Work Unit Control -->
16:31:15:  <dump-after-deadline v='true'/>
16:31:15:  <max-queue v='16'/>
16:31:15:  <max-units v='0'/>
16:31:15:  <next-unit-percentage v='99'/>
16:31:15:
16:31:15:  <!-- Folding Slots -->
16:31:15:  <slot id='0' type='SMP'>
16:31:15:    <client-type v='advanced'/>
16:31:15:    <cpus v='-1'/>
16:31:15:  </slot>
16:31:15:</config>
16:31:15:Trying to access database...
16:31:15:Successfully acquired database lock
16:31:15:Enabled folding slot 00: READY smp:8
16:31:15:Started thread 1 on PID 4964
16:31:15:Started thread 5 on PID 4964
16:31:15:Started thread 3 on PID 4964
16:31:15:Started thread 4 on PID 4964
16:31:15:Started thread 6 on PID 4964
16:31:15:WU02:FS00:Starting
16:31:15:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 02 -suffix 01 -version 701 -lifeline 4964 -checkpoint 15 -cpu 98 -np 8
16:31:15:WU02:FS00:Started FahCore on PID 1732
16:31:15:Started thread 7 on PID 4964
16:31:15:WU02:FS00:Core PID:3680
16:31:15:WU02:FS00:FahCore 0xa4 started
16:31:16:WU02:FS00:0xa4:
16:31:16:WU02:FS00:0xa4:*------------------------------*
16:31:16:WU02:FS00:0xa4:Folding@Home Gromacs GB Core
16:31:16:WU02:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
16:31:16:WU02:FS00:0xa4:
16:31:16:WU02:FS00:0xa4:Preparing to commence simulation
16:31:16:WU02:FS00:0xa4:- Looking at optimizations...
16:31:16:WU02:FS00:0xa4:- Files status OK
16:31:16:WU02:FS00:0xa4:- Expanded 49540 -> 197152 (decompressed 397.9 percent)
16:31:16:WU02:FS00:0xa4:Called DecompressByteArray: compressed_data_size=49540 data_size=197152, decompressed_data_size=197152 diff=0
16:31:16:WU02:FS00:0xa4:- Digital signature verified
16:31:16:WU02:FS00:0xa4:
16:31:16:WU02:FS00:0xa4:Project: 10090 (Run 151, Clone 0, Gen 171)
16:31:16:WU02:FS00:0xa4:
16:31:16:WU02:FS00:0xa4:Assembly optimizations on if available.
16:31:16:WU02:FS00:0xa4:Entering M.D.
16:31:18:Started thread 8 on PID 4964
16:31:18:Server connection id=1 on 0.0.0.0:36330 from 127.0.0.1
16:31:21:WU02:FS00:0xa4:Using Gromacs checkpoints
16:31:21:WU02:FS00:0xa4:Mapping NT from 8 to 8 
16:31:21:WU02:FS00:0xa4:Resuming from checkpoint
16:31:21:WU02:FS00:0xa4:Verified 02/wudata_01.log
16:31:21:WU02:FS00:0xa4:Verified 02/wudata_01.trr
16:31:21:WU02:FS00:0xa4:Verified 02/wudata_01.xtc
16:31:21:WU02:FS00:0xa4:Verified 02/wudata_01.edr
16:31:21:WU02:FS00:0xa4:Completed 5800001 out of 10000000 steps  (58%)
16:33:27:WU02:FS00:0xa4:Completed 5900000 out of 10000000 steps  (59%)
16:35:28:WU02:FS00:0xa4:Completed 6000000 out of 10000000 steps  (60%)