7626 (Run 261, Clone 4, Gen 10)

Moderators: Site Moderators, FAHC Science Team

Post Reply
road-runner
Posts: 227
Joined: Sun Dec 02, 2007 4:01 am
Location: Willis, Texas

7626 (Run 261, Clone 4, Gen 10)

Post by road-runner »

I notice this morning it was taking over an hour a frame so I rebooted the machine and checked it this evening. Is this correct or something wrong with the WU?

System is Asus P6T i7- 980x and 2 MSI 560 ti 448 core they do a 8072 @ 2 mins 30 secs

Code: Select all

18:36:52:WU03:FS01:Starting
18:36:52:WU03:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/David/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 03 -suffix 01 -version 702 -lifeline 5952 -checkpoint 15 -gpu 1
18:36:52:WU03:FS01:Started FahCore on PID 6912
18:36:52:WU03:FS01:Core PID:7056
18:36:52:WU03:FS01:FahCore 0x15 started
18:36:52:WU03:FS01:0x15:
18:36:52:WU03:FS01:0x15:*------------------------------*
18:36:52:WU03:FS01:0x15:Folding@Home GPU Core
18:36:52:WU03:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
18:36:52:WU03:FS01:0x15:Build host             AmoebaRemote
18:36:52:WU03:FS01:0x15:Board Type             NVIDIA/CUDA
18:36:52:WU03:FS01:0x15:Core                   15
18:36:52:WU03:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1
18:36:52:WU03:FS01:0x15:
18:36:52:WU03:FS01:0x15:Window's signal control handler registered.
18:36:52:WU03:FS01:0x15:Preparing to commence simulation
18:36:52:WU03:FS01:0x15:- Ensuring status. Please wait.
18:37:02:WU03:FS01:0x15:- Looking at optimizations...
18:37:02:WU03:FS01:0x15:- Working with standard loops on this execution.
18:37:02:WU03:FS01:0x15:- Previous termination of core was improper.
18:37:02:WU03:FS01:0x15:- Files status OK
18:37:02:WU03:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
18:37:02:WU03:FS01:0x15:- Expanded 126062 -> 507182 (decompressed 402.3 percent)
18:37:02:WU03:FS01:0x15:Called DecompressByteArray: compressed_data_size=126062 data_size=507182, decompressed_data_size=507182 diff=0
18:37:02:WU03:FS01:0x15:- Digital signature verified
18:37:02:WU03:FS01:0x15:
18:37:02:WU03:FS01:0x15:Project: 7626 (Run 261, Clone 4, Gen 10)
18:37:02:WU03:FS01:0x15:
18:37:02:WU03:FS01:0x15:Entering M.D.
18:37:04:WU03:FS01:0x15:Will resume from checkpoint file 03/wudata_01.ckp
18:37:04:WU03:FS01:0x15:Tpr hash 03/wudata_01.tpr:  3936660526 2189765616 4101594444 2098173033 560447277
18:37:04:WU03:FS01:0x15:GPU device id=1
18:37:04:WU03:FS01:0x15:Working on Protein
18:37:04:WU03:FS01:0x15:Client config unavailable.
18:37:04:WU03:FS01:0x15:Starting GUI Server
18:38:17:WU03:FS01:0x15:Resuming from checkpoint
18:38:17:WU03:FS01:0x15:fcCheckPointResume: retreived and current tpr file hash:
18:38:17:WU03:FS01:0x15:   0   3936660526   3936660526
18:38:17:WU03:FS01:0x15:   1   2189765616   2189765616
18:38:17:WU03:FS01:0x15:   2   4101594444   4101594444
18:38:17:WU03:FS01:0x15:   3   2098173033   2098173033
18:38:17:WU03:FS01:0x15:   4    560447277    560447277
18:38:17:WU03:FS01:0x15:fcCheckPointResume: file hashes same.
18:38:17:WU03:FS01:0x15:fcCheckPointResume: state restored.
18:38:17:WU03:FS01:0x15:fcCheckPointResume: name 03/wudata_01.log Verified 03/wudata_01.log
18:38:17:WU03:FS01:0x15:fcCheckPointResume: name 03/wudata_01.trr Verified 03/wudata_01.trr
18:38:17:WU03:FS01:0x15:fcCheckPointResume: name 03/wudata_01.xtc Verified 03/wudata_01.xtc
18:38:17:WU03:FS01:0x15:fcCheckPointResume: name 03/wudata_01.edr Verified 03/wudata_01.edr
18:38:17:WU03:FS01:0x15:fcCheckPointResume: state restored 2
18:38:17:WU03:FS01:0x15:Resumed from checkpoint
18:38:17:WU03:FS01:0x15:Setting checkpoint frequency: 400000
18:38:17:WU03:FS01:0x15:Completed  31200001 out of 40000000 steps (78%).
18:38:17:WARNING:WU03:FS01:Detected clock skew (1 mins 16 secs), adjusting time estimates
19:46:19:WU03:FS01:0x15:Completed  31600000 out of 40000000 steps (79%).
20:54:22:WU03:FS01:0x15:Completed  32000000 out of 40000000 steps (80%).
22:02:25:WU03:FS01:0x15:Completed  32400000 out of 40000000 steps (81%).
23:10:12:WU03:FS01:0x15:Completed  32800000 out of 40000000 steps (82%).
00:18:04:WU03:FS01:0x15:Completed  33200000 out of 40000000 steps (83%).

Last edited by road-runner on Tue Jan 22, 2013 5:22 am, edited 3 times in total.
Image
art_l_j_PlanetAMD64
Posts: 472
Joined: Sun May 30, 2010 2:28 pm

Re: 7626 (Run 261, Clone 4, Gen 10)

Post by art_l_j_PlanetAMD64 »

A lot depends on your hardware, I get about 5:20 TPFs on a 7626 WU using a GTX 660 Ti. Could you please post the information from the top of the log file (System Info and Configuration) as described here, and as much of your hardware information as you can find out (CPU, GPU, RAM, PSU, motherboard). Thanks!
art_l_j_PlanetAMD64
Over 1.04 Billion Total Points
Over 185,000 Work Units
Over 3,800,000 PPD
Overall rank (if points are combined) 20 of 1721690
In memory of my Mother May 12th 1923 - February 10th 2012
road-runner
Posts: 227
Joined: Sun Dec 02, 2007 4:01 am
Location: Willis, Texas

Re: 7626 (Run 261, Clone 4, Gen 10)

Post by road-runner »

ok think I got it..
Image
art_l_j_PlanetAMD64
Posts: 472
Joined: Sun May 30, 2010 2:28 pm

Re: 7626 (Run 261, Clone 4, Gen 10)

Post by art_l_j_PlanetAMD64 »

OK, I see your hardware info, but not the information from the top of the log file (System Info and Configuration) as described here.

Anyway, for a 560 Ti, compdewd's excellent Folding@Home GPU Statistics Database shows this data. The TPF for a 7626 WU is 5:54, they take much more Time Per Frame (TPF) than the 8072 WU (TPF = 2:19 in the database).
art_l_j_PlanetAMD64
Over 1.04 Billion Total Points
Over 185,000 Work Units
Over 3,800,000 PPD
Overall rank (if points are combined) 20 of 1721690
In memory of my Mother May 12th 1923 - February 10th 2012
Napoleon
Posts: 887
Joined: Wed May 26, 2010 2:31 pm
Hardware configuration: Atom330 (overclocked):
Windows 7 Ultimate 64bit
Intel Atom330 dualcore (4 HyperThreads)
NVidia GT430, core_15 work
2x2GB Kingston KVR1333D3N9K2/4G 1333MHz memory kit
Asus AT3IONT-I Deluxe motherboard
Location: Finland

Re: 7626 (Run 261, Clone 4, Gen 10)

Post by Napoleon »

It looks like the WU wasn't paused cleanly, whatever the reason may be. Perhaps the checkpoint got corrupted somehow:

Code: Select all

18:36:52:WU03:FS01:0x15:- Ensuring status. Please wait.
18:37:02:WU03:FS01:0x15:- Looking at optimizations...
18:37:02:WU03:FS01:0x15:- Working with standard loops on this execution.
18:37:02:WU03:FS01:0x15:- Previous termination of core was improper.
Win7 64bit, FAH v7, OC'd
2C/4T Atom330 3x667MHz - GT430 2x832.5MHz - ION iGPU 3x466.7MHz
NaCl - Core_15 - display
art_l_j_PlanetAMD64
Posts: 472
Joined: Sun May 30, 2010 2:28 pm

Re: 7626 (Run 261, Clone 4, Gen 10)

Post by art_l_j_PlanetAMD64 »

Napoleon wrote:It looks like the WU wasn't paused cleanly, whatever the reason may be. Perhaps the checkpoint got corrupted somehow:

Code: Select all

18:36:52:WU03:FS01:0x15:- Ensuring status. Please wait.
18:37:02:WU03:FS01:0x15:- Looking at optimizations...
18:37:02:WU03:FS01:0x15:- Working with standard loops on this execution.
18:37:02:WU03:FS01:0x15:- Previous termination of core was improper.
Yes, but then it goes on to say:

Code: Select all

18:37:02:WU03:FS01:0x15:- Files status OK
18:37:04:WU03:FS01:0x15:Will resume from checkpoint file 03/wudata_01.ckp
18:38:17:WU03:FS01:0x15:Resuming from checkpoint
18:38:17:WU03:FS01:0x15:fcCheckPointResume: retreived and current tpr file hash:
18:38:17:WU03:FS01:0x15:   0   3936660526   3936660526
18:38:17:WU03:FS01:0x15:   1   2189765616   2189765616
18:38:17:WU03:FS01:0x15:   2   4101594444   4101594444
18:38:17:WU03:FS01:0x15:   3   2098173033   2098173033
18:38:17:WU03:FS01:0x15:   4    560447277    560447277
18:38:17:WU03:FS01:0x15:fcCheckPointResume: file hashes same.
18:38:17:WU03:FS01:0x15:fcCheckPointResume: state restored.
18:38:17:WU03:FS01:0x15:fcCheckPointResume: name 03/wudata_01.log Verified 03/wudata_01.log
18:38:17:WU03:FS01:0x15:fcCheckPointResume: name 03/wudata_01.trr Verified 03/wudata_01.trr
18:38:17:WU03:FS01:0x15:fcCheckPointResume: name 03/wudata_01.xtc Verified 03/wudata_01.xtc
18:38:17:WU03:FS01:0x15:fcCheckPointResume: name 03/wudata_01.edr Verified 03/wudata_01.edr
18:38:17:WU03:FS01:0x15:fcCheckPointResume: state restored 2
18:38:17:WU03:FS01:0x15:Resumed from checkpoint
I believe the "Previous termination of core was improper." message just means that the user shut down Windows without stopping FAHClient first. It's not a fatal error, more like just a warning or a notification.
art_l_j_PlanetAMD64
Over 1.04 Billion Total Points
Over 185,000 Work Units
Over 3,800,000 PPD
Overall rank (if points are combined) 20 of 1721690
In memory of my Mother May 12th 1923 - February 10th 2012
Napoleon
Posts: 887
Joined: Wed May 26, 2010 2:31 pm
Hardware configuration: Atom330 (overclocked):
Windows 7 Ultimate 64bit
Intel Atom330 dualcore (4 HyperThreads)
NVidia GT430, core_15 work
2x2GB Kingston KVR1333D3N9K2/4G 1333MHz memory kit
Asus AT3IONT-I Deluxe motherboard
Location: Finland

Re: 7626 (Run 261, Clone 4, Gen 10)

Post by Napoleon »

Yep, it shouldn't matter. Purely guesswork this time, just pointed out an anomaly, smarter minds can figure out whether it actually makes any difference or not in this case.

PS: If you happen to see it with FahCore_78, it does matter. That one actually reverts to vanilla FPU instead of using SSE, which slows the processing to a crawl for the rest of the WU. Or until you pause and restart the improperly terminated WU cleanly.
Win7 64bit, FAH v7, OC'd
2C/4T Atom330 3x667MHz - GT430 2x832.5MHz - ION iGPU 3x466.7MHz
NaCl - Core_15 - display
Napoleon
Posts: 887
Joined: Wed May 26, 2010 2:31 pm
Hardware configuration: Atom330 (overclocked):
Windows 7 Ultimate 64bit
Intel Atom330 dualcore (4 HyperThreads)
NVidia GT430, core_15 work
2x2GB Kingston KVR1333D3N9K2/4G 1333MHz memory kit
Asus AT3IONT-I Deluxe motherboard
Location: Finland

Re: 7626 (Run 261, Clone 4, Gen 10)

Post by Napoleon »

Could you post a bit more of the log, that is to say, what happened before "18:36:52:WU03:FS01:Starting"? In the meantime, here's some more guesswork. Just guessing, mind you:
  1. There was a driver crash/GPU recovery or something like that, which dropped the GPU clocks to extremely low values
  2. The driver crash also crashed FahCore_15.exe (improper termination)
  3. After GPU recovery was done, FAHClient restarted the FahCore/WU from a checkpoint, but the GPU clocks were still capped to those low values as a safety measure
  4. Hmm, a reboot should've fixed C. Unless the GPU crashed again at some point during the day. Need more info.
Win7 64bit, FAH v7, OC'd
2C/4T Atom330 3x667MHz - GT430 2x832.5MHz - ION iGPU 3x466.7MHz
NaCl - Core_15 - display
road-runner
Posts: 227
Joined: Sun Dec 02, 2007 4:01 am
Location: Willis, Texas

Re: 7626 (Run 261, Clone 4, Gen 10)

Post by road-runner »

That was all the log file I could see in hfm I cant find it in local/roaming will look more this evening on lunch at work... thanks guys..

Ok found todays log its confusing to me seems 2 wus are running at the same time or is this trying to show both cards in one log file?

Code: Select all

18:37:01:WU01:FS00:0x15:Project: 8072 (Run 0, Clone 1431, Gen 17)
18:37:01:WU01:FS00:0x15:
18:37:01:WU01:FS00:0x15:Entering M.D.
18:37:02:WU03:FS01:0x15:- Looking at optimizations...
18:37:02:WU03:FS01:0x15:- Working with standard loops on this execution.
18:37:02:WU03:FS01:0x15:- Previous termination of core was improper.
18:37:02:WU03:FS01:0x15:- Files status OK
18:37:02:WU03:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
18:37:02:WU03:FS01:0x15:- Expanded 126062 -> 507182 (decompressed 402.3 percent)
18:37:02:WU03:FS01:0x15:Called DecompressByteArray: compressed_data_size=126062 data_size=507182, decompressed_data_size=507182 diff=0
18:37:02:WU03:FS01:0x15:- Digital signature verified
18:37:02:WU03:FS01:0x15:
18:37:02:WU03:FS01:0x15:Project: 7626 (Run 261, Clone 4, Gen 10)
18:37:02:WU03:FS01:0x15:
18:37:02:WU03:FS01:0x15:Entering M.D.
18:37:03:WU01:FS00:0x15:Will resume from checkpoint file 01/wudata_01.ckp
18:37:03:WU01:FS00:0x15:Tpr hash 01/wudata_01.tpr:  1723379980 1342333586 4019784541 2216672630 2223597888
18:37:03:WU01:FS00:0x15:GPU device id=0
18:37:03:WU01:FS00:0x15:Working on Giving Russians Opium May Alter Current Situation
18:37:03:WU01:FS00:0x15:Client config unavailable.
18:37:03:WU01:FS00:0x15:Starting GUI Server
18:37:04:WU03:FS01:0x15:Will resume from checkpoint file 03/wudata_01.ckp
18:37:04:WU03:FS01:0x15:Tpr hash 03/wudata_01.tpr:  3936660526 2189765616 4101594444 2098173033 560447277
18:37:04:WU03:FS01:0x15:GPU device id=1
18:37:04:WU03:FS01:0x15:Working on Protein
18:37:04:WU03:FS01:0x15:Client config unavailable.
18:37:04:WU03:FS01:0x15:Starting GUI Server
18:37:06:WU02:FS02:0xa3:Using Gromacs checkpoints
18:37:07:WU02:FS02:0xa3:Mapping NT from 12 to 12 
18:37:07:WU02:FS02:0xa3:Resuming from checkpoint
18:37:07:WU02:FS02:0xa3:Verified 02/wudata_01.log
18:37:08:WU02:FS02:0xa3:Verified 02/wudata_01.trr
18:37:08:WU02:FS02:0xa3:Verified 02/wudata_01.xtc
18:37:08:WU02:FS02:0xa3:Verified 02/wudata_01.edr
18:37:08:WU02:FS02:0xa3:Completed 289140 out of 500000 steps  (57%)
18:38:08:WU01:FS00:0x15:Resuming from checkpoint
18:38:08:WU01:FS00:0x15:fcCheckPointResume: retreived and current tpr file hash:
18:38:08:WU01:FS00:0x15:   0   1723379980   1723379980
18:38:08:WU01:FS00:0x15:   1   1342333586   1342333586
18:38:08:WU01:FS00:0x15:   2   4019784541   4019784541
18:38:08:WU01:FS00:0x15:   3   2216672630   2216672630
18:38:08:WU01:FS00:0x15:   4   2223597888   2223597888
18:38:08:WU01:FS00:0x15:fcCheckPointResume: file hashes same.
18:38:08:WU01:FS00:0x15:fcCheckPointResume: state restored.
18:38:08:WU01:FS00:0x15:fcCheckPointResume: name 01/wudata_01.log Verified 01/wudata_01.log
18:38:08:WU01:FS00:0x15:fcCheckPointResume: name 01/wudata_01.trr Verified 01/wudata_01.trr
18:38:08:WU01:FS00:0x15:fcCheckPointResume: name 01/wudata_01.xtc Verified 01/wudata_01.xtc
18:38:08:WU01:FS00:0x15:fcCheckPointResume: name 01/wudata_01.edr Verified 01/wudata_01.edr
18:38:08:WU01:FS00:0x15:fcCheckPointResume: state restored 2
18:38:08:WU01:FS00:0x15:Resumed from checkpoint
18:38:08:WU01:FS00:0x15:Setting checkpoint frequency: 500000
18:38:08:WU01:FS00:0x15:Completed  28500001 out of 50000000 steps (57%).
18:38:09:WARNING:WU01:FS00:Detected clock skew (1 mins 08 secs), adjusting time estimates
18:38:17:WU03:FS01:0x15:Resuming from checkpoint
18:38:17:WU03:FS01:0x15:fcCheckPointResume: retreived and current tpr file hash:
18:38:17:WU03:FS01:0x15:   0   3936660526   3936660526
18:38:17:WU03:FS01:0x15:   1   2189765616   2189765616
18:38:17:WU03:FS01:0x15:   2   4101594444   4101594444
18:38:17:WU03:FS01:0x15:   3   2098173033   2098173033
18:38:17:WU03:FS01:0x15:   4    560447277    560447277
18:38:17:WU03:FS01:0x15:fcCheckPointResume: file hashes same.
18:38:17:WU03:FS01:0x15:fcCheckPointResume: state restored.
18:38:17:WU03:FS01:0x15:fcCheckPointResume: name 03/wudata_01.log Verified 03/wudata_01.log
18:38:17:WU03:FS01:0x15:fcCheckPointResume: name 03/wudata_01.trr Verified 03/wudata_01.trr
18:38:17:WU03:FS01:0x15:fcCheckPointResume: name 03/wudata_01.xtc Verified 03/wudata_01.xtc
18:38:17:WU03:FS01:0x15:fcCheckPointResume: name 03/wudata_01.edr Verified 03/wudata_01.edr
18:38:17:WU03:FS01:0x15:fcCheckPointResume: state restored 2
18:38:17:WU03:FS01:0x15:Resumed from checkpoint
18:38:17:WU03:FS01:0x15:Setting checkpoint frequency: 400000
18:38:17:WU03:FS01:0x15:Completed  31200001 out of 40000000 steps (78%).
18:38:17:WARNING:WU03:FS01:Detected clock skew (1 mins 16 secs), adjusting time estimates
18:38:32:WU02:FS02:0xa3:Completed 290000 out of 500000 steps  (58%)
18:40:59:WU01:FS00:0x15:Completed  29000000 out of 50000000 steps (58%).
18:43:30:WU01:FS00:0x15:Completed  29500000 out of 50000000 steps (59%).
18:45:59:WU01:FS00:0x15:Completed  30000000 out of 50000000 steps (60%).
18:48:29:WU02:FS02:0xa3:Completed 295000 out of 500000 steps  (59%)
18:48:29:WU01:FS00:0x15:Completed  30500000 out of 50000000 steps (61%).
18:50:58:WU01:FS00:0x15:Completed  31000000 out of 50000000 steps (62%).
18:53:27:WU01:FS00:0x15:Completed  31500000 out of 50000000 steps (63%).
18:55:56:WU01:FS00:0x15:Completed  32000000 out of 50000000 steps (64%).
18:57:29:WU02:FS02:0xa3:Completed 300000 out of 500000 steps  (60%)
18:58:25:WU01:FS00:0x15:Completed  32500000 out of 50000000 steps (65%).
19:00:55:WU01:FS00:0x15:Completed  33000000 out of 50000000 steps (66%).
19:03:24:WU01:FS00:0x15:Completed  33500000 out of 50000000 steps (67%).
19:05:53:WU01:FS00:0x15:Completed  34000000 out of 50000000 steps (68%).
19:06:13:WU02:FS02:0xa3:Completed 305000 out of 500000 steps  (61%)
19:08:22:WU01:FS00:0x15:Completed  34500000 out of 50000000 steps (69%).
19:10:52:WU01:FS00:0x15:Completed  35000000 out of 50000000 steps (70%).
19:13:21:WU01:FS00:0x15:Completed  35500000 out of 50000000 steps (71%).
19:15:15:WU02:FS02:0xa3:Completed 310000 out of 500000 steps  (62%)
19:15:50:WU01:FS00:0x15:Completed  36000000 out of 50000000 steps (72%).
19:18:20:WU01:FS00:0x15:Completed  36500000 out of 50000000 steps (73%).
19:20:49:WU01:FS00:0x15:Completed  37000000 out of 50000000 steps (74%).
19:23:18:WU01:FS00:0x15:Completed  37500000 out of 50000000 steps (75%).
19:24:16:WU02:FS02:0xa3:Completed 315000 out of 500000 steps  (63%)
19:25:47:WU01:FS00:0x15:Completed  38000000 out of 50000000 steps (76%).
19:28:16:WU01:FS00:0x15:Completed  38500000 out of 50000000 steps (77%).
19:30:46:WU01:FS00:0x15:Completed  39000000 out of 50000000 steps (78%).
19:33:13:WU02:FS02:0xa3:Completed 320000 out of 500000 steps  (64%)
19:33:15:WU01:FS00:0x15:Completed  39500000 out of 50000000 steps (79%).
19:35:44:WU01:FS00:0x15:Completed  40000000 out of 50000000 steps (80%).
19:38:13:WU01:FS00:0x15:Completed  40500000 out of 50000000 steps (81%).
19:40:43:WU01:FS00:0x15:Completed  41000000 out of 50000000 steps (82%).
19:42:07:WU02:FS02:0xa3:Completed 325000 out of 500000 steps  (65%)
19:43:13:WU01:FS00:0x15:Completed  41500000 out of 50000000 steps (83%).
19:45:42:WU01:FS00:0x15:Completed  42000000 out of 50000000 steps (84%).
19:46:19:WU03:FS01:0x15:Completed  31600000 out of 40000000 steps (79%).
19:48:11:WU01:FS00:0x15:Completed  42500000 out of 50000000 steps (85%).
19:50:40:WU01:FS00:0x15:Completed  43000000 out of 50000000 steps (86%).
19:50:47:WU02:FS02:0xa3:Completed 330000 out of 500000 steps  (66%)
19:53:09:WU01:FS00:0x15:Completed  43500000 out of 50000000 steps (87%).
19:55:38:WU01:FS00:0x15:Completed  44000000 out of 50000000 steps (88%).
19:58:07:WU01:FS00:0x15:Completed  44500000 out of 50000000 steps (89%).
19:59:21:WU02:FS02:0xa3:Completed 335000 out of 500000 steps  (67%)
20:00:36:WU01:FS00:0x15:Completed  45000000 out of 50000000 steps (90%).
20:03:05:WU01:FS00:0x15:Completed  45500000 out of 50000000 steps (91%).
20:05:35:WU01:FS00:0x15:Completed  46000000 out of 50000000 steps (92%).
20:08:01:WU02:FS02:0xa3:Completed 340000 out of 500000 steps  (68%)
20:08:04:WU01:FS00:0x15:Completed  46500000 out of 50000000 steps (93%).
20:10:33:WU01:FS00:0x15:Completed  47000000 out of 50000000 steps (94%).
20:13:03:WU01:FS00:0x15:Completed  47500000 out of 50000000 steps (95%).
20:15:32:WU01:FS00:0x15:Completed  48000000 out of 50000000 steps (96%).
20:16:41:WU02:FS02:0xa3:Completed 345000 out of 500000 steps  (69%)
20:18:01:WU01:FS00:0x15:Completed  48500000 out of 50000000 steps (97%).
20:20:31:WU01:FS00:0x15:Completed  49000000 out of 50000000 steps (98%).
20:23:00:WU01:FS00:0x15:Completed  49500000 out of 50000000 steps (99%).
20:25:29:WU01:FS00:0x15:Completed  50000000 out of 50000000 steps (100%).
20:25:29:WU01:FS00:0x15:Finished fah_main status=0
20:25:29:WU01:FS00:0x15:Successful run
20:25:29:WU01:FS00:0x15:DynamicWrapper: Finished Work Unit: sleep=10000
20:25:30:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
20:25:30:WU00:FS00:News: Welcome to Folding@Home
20:25:30:WU00:FS00:Assigned to work server 171.67.108.36
20:25:30:WU00:FS00:Requesting new work unit for slot 00: RUNNING gpu:0:"GF116 [GeForce GT 610]" from 171.67.108.36
20:25:30:WU00:FS00:Connecting to 171.67.108.36:8080
20:25:30:WU00:FS00:Downloading 56.27KiB
20:25:31:WU00:FS00:Download complete
20:25:31:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8072 run:0 clone:915 gen:82 core:0x15 unit:0x000000576652edb450b42a05b7913609
20:25:31:WU02:FS02:0xa3:Completed 350000 out of 500000 steps  (70%)
20:25:39:WU01:FS00:0x15:Reserved 322312 bytes for xtc file; Cosm status=0
20:25:39:WU01:FS00:0x15:Allocated 322312 bytes for xtc file
20:25:39:WU01:FS00:0x15:- Reading up to 322312 from "01/wudata_01.xtc": Read 322312
20:25:39:WU01:FS00:0x15:Read 322312 bytes from xtc file; available packet space=786108152
20:25:39:WU01:FS00:0x15:xtc file hash check passed.
20:25:39:WU01:FS00:0x15:Reserved 20112 20112 786108152 bytes for arc file=<01/wudata_01.trr> Cosm status=0
20:25:39:WU01:FS00:0x15:Allocated 20112 bytes for arc file
20:25:39:WU01:FS00:0x15:- Reading up to 20112 from "01/wudata_01.trr": Read 20112
20:25:39:WU01:FS00:0x15:Read 20112 bytes from arc file; available packet space=786088040
20:25:39:WU01:FS00:0x15:trr file hash check passed.
20:25:39:WU01:FS00:0x15:Allocated 544 bytes for edr file
20:25:39:WU01:FS00:0x15:Read bedfile
20:25:39:WU01:FS00:0x15:edr file hash check passed.
20:25:39:WU01:FS00:0x15:Allocated 36989 bytes for logfile
20:25:39:WU01:FS00:0x15:Read logfile
20:25:39:WU01:FS00:0x15:GuardedRun: success in DynamicWrapper
20:25:39:WU01:FS00:0x15:GuardedRun: done
20:25:39:WU01:FS00:0x15:Run: GuardedRun completed.
20:25:42:WU01:FS00:0x15:+ Opened results file
20:25:42:WU01:FS00:0x15:- Writing 380469 bytes of core data to disk...
20:25:42:WU01:FS00:0x15:Done: 379957 -> 348643 (compressed to 91.7 percent)
20:25:42:WU01:FS00:0x15:  ... Done.
20:25:42:WU01:FS00:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
20:25:43:WU01:FS00:0x15:Shutting down core 
20:25:43:WU01:FS00:0x15:
20:25:43:WU01:FS00:0x15:Folding@home Core Shutdown: FINISHED_UNIT
20:25:43:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
20:25:43:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:8072 run:0 clone:1431 gen:17 core:0x15 unit:0x000000126652edb450b42a3c76928893
20:25:43:WU01:FS00:Uploading 340.97KiB to 171.67.108.36
20:25:43:WU01:FS00:Connecting to 171.67.108.36:8080
20:25:43:WU00:FS00:Starting
20:25:43:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/David/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 00 -suffix 01 -version 702 -lifeline 5952 -checkpoint 15 -gpu 0
20:25:43:WU00:FS00:Started FahCore on PID 2632
20:25:43:WU00:FS00:Core PID:7728
20:25:43:WU00:FS00:FahCore 0x15 started
20:25:44:WU00:FS00:0x15:
20:25:44:WU00:FS00:0x15:*------------------------------*
20:25:44:WU00:FS00:0x15:Folding@Home GPU Core
20:25:44:WU00:FS00:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
20:25:44:WU00:FS00:0x15:Build host             AmoebaRemote
20:25:44:WU00:FS00:0x15:Board Type             NVIDIA/CUDA
20:25:44:WU00:FS00:0x15:Core                   15
20:25:44:WU00:FS00:0x15:
20:25:44:WU00:FS00:0x15:Window's signal control handler registered.
20:25:44:WU00:FS00:0x15:Preparing to commence simulation
20:25:44:WU00:FS00:0x15:- Looking at optimizations...
20:25:44:WU00:FS00:0x15:DeleteFrameFiles: successfully deleted file=00/wudata_01.ckp
20:25:44:WU00:FS00:0x15:- Created dyn
20:25:44:WU00:FS00:0x15:- Files status OK
20:25:44:WU00:FS00:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
20:25:44:WU00:FS00:0x15:- Expanded 57113 -> 257342 (decompressed 450.5 percent)
20:25:44:WU00:FS00:0x15:Called DecompressByteArray: compressed_data_size=57113 data_size=257342, decompressed_data_size=257342 diff=0
20:25:44:WU00:FS00:0x15:- Digital signature verified
20:25:44:WU00:FS00:0x15:
20:25:44:WU00:FS00:0x15:Project: 8072 (Run 0, Clone 915, Gen 82)
20:25:44:WU00:FS00:0x15:
20:25:44:WU00:FS00:0x15:Assembly optimizations on if available.
20:25:44:WU00:FS00:0x15:Entering M.D.
20:25:46:WU00:FS00:0x15:Tpr hash 00/wudata_01.tpr:  128256656 3470129263 3203290284 2520417347 3360108690
20:25:46:WU00:FS00:0x15:GPU device id=0
20:25:46:WU00:FS00:0x15:Working on Giving Russians Opium May Alter Current Situation
20:25:46:WU00:FS00:0x15:Client config unavailable.
20:25:46:WU01:FS00:Upload complete
20:25:46:WU01:FS00:Server responded WORK_ACK (400)
20:25:46:WU01:FS00:Final credit estimate, 3874.00 points
20:25:46:WU00:FS00:0x15:Starting GUI Server
20:25:46:WU01:FS00:Cleaning up
20:26:47:WU00:FS00:0x15:Setting checkpoint frequency: 500000
20:26:47:WU00:FS00:0x15:Completed         3 out of 50000000 steps (0%).
20:29:16:WU00:FS00:0x15:Completed    500000 out of 50000000 steps (1%).
20:31:45:WU00:FS00:0x15:Completed   1000000 out of 50000000 steps (2%).
20:33:57:WU02:FS02:0xa3:Completed 355000 out of 500000 steps  (71%)
20:34:14:WU00:FS00:0x15:Completed   1500000 out of 50000000 steps (3%).
20:36:43:WU00:FS00:0x15:Completed   2000000 out of 50000000 steps (4%).
20:39:12:WU00:FS00:0x15:Completed   2500000 out of 50000000 steps (5%).
20:41:42:WU00:FS00:0x15:Completed   3000000 out of 50000000 steps (6%).
20:42:34:WU02:FS02:0xa3:Completed 360000 out of 500000 steps  (72%)
20:44:11:WU00:FS00:0x15:Completed   3500000 out of 50000000 steps (7%).
20:46:40:WU00:FS00:0x15:Completed   4000000 out of 50000000 steps (8%).
20:49:09:WU00:FS00:0x15:Completed   4500000 out of 50000000 steps (9%).
20:51:02:WU02:FS02:0xa3:Completed 365000 out of 500000 steps  (73%)
20:51:38:WU00:FS00:0x15:Completed   5000000 out of 50000000 steps (10%).
20:54:07:WU00:FS00:0x15:Completed   5500000 out of 50000000 steps (11%).
20:54:22:WU03:FS01:0x15:Completed  32000000 out of 40000000 steps (80%).
20:56:36:WU00:FS00:0x15:Completed   6000000 out of 50000000 steps (12%).
20:59:05:WU00:FS00:0x15:Completed   6500000 out of 50000000 steps (13%).
20:59:29:WU02:FS02:0xa3:Completed 370000 out of 500000 steps  (74%)
21:01:35:WU00:FS00:0x15:Completed   7000000 out of 50000000 steps (14%).
21:04:04:WU00:FS00:0x15:Completed   7500000 out of 50000000 steps (15%).
21:06:33:WU00:FS00:0x15:Completed   8000000 out of 50000000 steps (16%).
21:07:57:WU02:FS02:0xa3:Completed 375000 out of 500000 steps  (75%)
21:09:02:WU00:FS00:0x15:Completed   8500000 out of 50000000 steps (17%).
21:11:31:WU00:FS00:0x15:Completed   9000000 out of 50000000 steps (18%).
21:14:01:WU00:FS00:0x15:Completed   9500000 out of 50000000 steps (19%).
21:16:30:WU00:FS00:0x15:Completed  10000000 out of 50000000 steps (20%).
Edit: I did add a gt 610 video card to the middle slot of the 3 pcie slots to have enough plugs for my monitors wonder if there is a conflict now?
Image
Joe_H
Site Admin
Posts: 7856
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: 7626 (Run 261, Clone 4, Gen 10)

Post by Joe_H »

Yes, there is one log file for all slots. It can be a bit confusing at first, but each line has information on which WU is being worked on and the slot number, WU01 vs. WU03 and FS00 vs. FS01. In FAHControl you do have an option in Advanced mode of looking at the log file and filtering by WU or folding slot as well as just errors.

As for adding the GT610 card, that can sometimes be an issue. There is a problem where the client does not always get the right cards ID'd in a multiple card setup, so sometimes work is given to a different card than intended. It is an open issue that some work has been done to see if there can be a fix so the client will properly ID each card automatically. There have been some posts in the past from persons who have figured out how to manually configure the client. That goes over my head, I have not dealt with a multiple GPU setup myself. Hopefully with mention of this, someone can point you towards a fix if one is needed.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
road-runner
Posts: 227
Joined: Sun Dec 02, 2007 4:01 am
Location: Willis, Texas

Re: 7626 (Run 261, Clone 4, Gen 10)

Post by road-runner »

Ok I think I see whats going on, I think its running my second client on the GT610 which is actually in the middle slot or 2nd slot now. I had 2 560 ti one in the first slot and third slot but did not have enough connections for 6 monitors so I added the 610 its running the WU on it cause now I have a 8074 and its taking 25 min 49 secs a frame. Guess I will try uninstalling and reinstalling the client unless someone knows how to configure it cause I sure dont...
Image
Joe_H
Site Admin
Posts: 7856
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: 7626 (Run 261, Clone 4, Gen 10)

Post by Joe_H »

One older topic where this problem was discussed was here. Possibly that can get you started on getting folding back onto the right GPU.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
7im
Posts: 10189
Joined: Thu Nov 29, 2007 4:30 pm
Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
Location: Arizona
Contact:

Re: 7626 (Run 261, Clone 4, Gen 10)

Post by 7im »

No need to uninstall, but reinstalling is the first best option to resolve this. The installer will re-detect the hardware changes and try to auto configure the changes. The installer isn't always perfect, but works for most...
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
road-runner
Posts: 227
Joined: Sun Dec 02, 2007 4:01 am
Location: Willis, Texas

Re: 7626 (Run 261, Clone 4, Gen 10)

Post by road-runner »

Yea that is what it was, I unistalled reinstalled it detected all 3 cards then I just removed the 610 everything is working fine now thanks..
Image
Post Reply