9401 fails on GM107 but not GK106 {Hopefully fixed}

JimF · Post by **JimF** » Sun Oct 05, 2014 2:52 am

Freightanimal wrote:Today I got one that failed, then another that failed, then several more failures. Not sure what to make of it. Just looking for some feedback. Has this happened to anyone else?

I have been getting only failures on the Core 17s v0.52 for my GTX 750 Ti's too for at least the last 24 hours. This is most recently for P13000 and P13001, but for any others I received too. I was originally on the 340.52 drivers, but tried the 344.11 drivers too with the same result (Win7 64-bit). Prior to that, I had no failures at all. The cards are stable and not overclocked. Something is very wrong.

Code: Select all

*********************** Log Started 2014-10-05T02:38:12Z ***********************
02:38:12:************************* Folding@home Client *************************
02:38:12:      Website: http://folding.stanford.edu/
02:38:12:    Copyright: (c) 2009-2014 Stanford University
02:38:12:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
02:38:12:         Args: 
02:38:12:       Config: C:/ProgramData/FAHClient/config.xml
02:38:12:******************************** Build ********************************
02:38:12:      Version: 7.4.4
02:38:12:         Date: Mar 4 2014
02:38:12:         Time: 20:26:54
02:38:12:      SVN Rev: 4130
02:38:12:       Branch: fah/trunk/client
02:38:12:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
02:38:12:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
02:38:12:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
02:38:12:     Platform: win32 XP
02:38:12:         Bits: 32
02:38:12:         Mode: Release
02:38:12:******************************* System ********************************
02:38:12:          CPU: Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
02:38:12:       CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
02:38:12:         CPUs: 8
02:38:12:       Memory: 15.93GiB
02:38:12:  Free Memory: 2.77GiB
02:38:12:      Threads: WINDOWS_THREADS
02:38:12:   OS Version: 6.1
02:38:12:  Has Battery: false
02:38:12:   On Battery: false
02:38:12:   UTC Offset: -4
02:38:12:          PID: 2144
02:38:12:          CWD: C:/ProgramData/FAHClient
02:38:12:           OS: Windows 7 Home Premium
02:38:12:      OS Arch: AMD64
02:38:12:         GPUs: 2
02:38:12:        GPU 0: NVIDIA:4 GM107 [GeForce GTX 750 Ti]
02:38:12:        GPU 1: NVIDIA:4 GM107 [GeForce GTX 750 Ti]
02:38:12:         CUDA: 5.0
02:38:12:  CUDA Driver: 6050
02:38:12:Win32 Service: false
02:38:12:***********************************************************************
02:38:12:<config>
02:38:12:  <!-- HTTP Server -->
02:38:12:  <allow v='127.0.0.1,192.168.0.107'/>
02:38:12:
02:38:12:  <!-- Network -->
02:38:12:  <proxy v=':8080'/>
02:38:12:
02:38:12:  <!-- Remote Command Server -->
02:38:12:  <command-allow-no-pass v='127.0.0.1,192.168.0.107'/>
02:38:12:
02:38:12:  <!-- Slot Control -->
02:38:12:  <power v='FULL'/>
02:38:12:
02:38:12:  <!-- User Information -->
02:38:12:  <passkey v='********************************'/>
02:38:12:  <user v='Jim1348'/>
02:38:12:
02:38:12:  <!-- Folding Slots -->
02:38:12:  <slot id='1' type='GPU'/>
02:38:12:  <slot id='2' type='GPU'/>
02:38:12:</config>
02:38:12:Trying to access database...
02:38:12:Successfully acquired database lock
02:38:12:Enabled folding slot 01: READY gpu:0:GM107 [GeForce GTX 750 Ti]
02:38:12:Enabled folding slot 02: READY gpu:1:GM107 [GeForce GTX 750 Ti]
02:38:12:WARNING:WU00:FS01:Exception: Could not get IP address for assign-GPU.stanford.edu: No such host is known. 
02:38:12:ERROR:WU00:FS01:Exception: Could not get an assignment
02:38:12:WARNING:WU01:FS02:Exception: Could not get IP address for assign-GPU.stanford.edu: No such host is known. 
02:38:12:ERROR:WU01:FS02:Exception: Could not get an assignment
02:38:12:WARNING:WU00:FS01:Exception: Could not get IP address for assign-GPU.stanford.edu: No such host is known. 
02:38:12:ERROR:WU00:FS01:Exception: Could not get an assignment
02:38:12:WARNING:WU01:FS02:Exception: Could not get IP address for assign-GPU.stanford.edu: No such host is known. 
02:38:12:ERROR:WU01:FS02:Exception: Could not get an assignment
02:39:13:WU00:FS01:Connecting to 171.67.108.201:80
02:39:13:WU01:FS02:Connecting to 171.67.108.201:80
02:39:14:WU00:FS01:Assigned to work server 140.163.4.231
02:39:14:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
02:39:14:WU01:FS02:Assigned to work server 140.163.4.231
02:39:14:WU00:FS01:Connecting to 140.163.4.231:8080
02:39:14:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
02:39:14:WU01:FS02:Connecting to 140.163.4.231:8080
02:39:14:WU01:FS02:Downloading 4.84MiB
02:39:14:WU00:FS01:Downloading 4.84MiB
02:39:17:WU01:FS02:Download complete
02:39:17:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13001 run:327 clone:3 gen:73 core:0x17 unit:0x00000098538b3db75328ac7113fd9932
02:39:17:WU01:FS02:Downloading core from http://web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah
02:39:17:WU01:FS02:Connecting to web.stanford.edu:80
02:39:17:WU01:FS02:FahCore 17: Downloading 2.55MiB
02:39:17:WU00:FS01:Download complete
02:39:18:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13000 run:1951 clone:4 gen:13 core:0x17 unit:0x00000017538b3db75311c38e95e1509b
02:39:23:WU01:FS02:FahCore 17: 93.12%
02:39:23:WU01:FS02:FahCore 17: Download complete
02:39:23:WU01:FS02:Valid core signature
02:39:23:WU01:FS02:Unpacked 8.60MiB to cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe
02:39:23:WU01:FS02:Starting
02:39:23:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 2144 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
02:39:23:WU01:FS02:Started FahCore on PID 3456
02:39:23:WU01:FS02:Core PID:3468
02:39:23:WU01:FS02:FahCore 0x17 started
02:39:23:WU00:FS01:Starting
02:39:23:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 2144 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
02:39:23:WU00:FS01:Started FahCore on PID 3476
02:39:23:WU00:FS01:Core PID:3488
02:39:23:WU00:FS01:FahCore 0x17 started
02:39:24:WU01:FS02:0x17:*********************** Log Started 2014-10-05T02:39:23Z ***********************
02:39:24:WU01:FS02:0x17:Project: 13001 (Run 327, Clone 3, Gen 73)
02:39:24:WU01:FS02:0x17:Unit: 0x00000098538b3db75328ac7113fd9932
02:39:24:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
02:39:24:WU01:FS02:0x17:Machine: 2
02:39:24:WU01:FS02:0x17:Reading tar file state.xml
02:39:24:WU00:FS01:0x17:*********************** Log Started 2014-10-05T02:39:23Z ***********************
02:39:24:WU00:FS01:0x17:Project: 13000 (Run 1951, Clone 4, Gen 13)
02:39:24:WU00:FS01:0x17:Unit: 0x00000017538b3db75311c38e95e1509b
02:39:24:WU00:FS01:0x17:CPU: 0x00000000000000000000000000000000
02:39:24:WU00:FS01:0x17:Machine: 1
02:39:24:WU00:FS01:0x17:Reading tar file state.xml
02:39:24:WU01:FS02:0x17:Reading tar file system.xml
02:39:24:WU00:FS01:0x17:Reading tar file system.xml
02:39:25:WU01:FS02:0x17:Reading tar file integrator.xml
02:39:25:WU01:FS02:0x17:Reading tar file core.xml
02:39:25:WU01:FS02:0x17:Digital signatures verified
02:39:25:WU01:FS02:0x17:Folding@home GPU core17
02:39:25:WU01:FS02:0x17:Version 0.0.52
02:39:25:WU00:FS01:0x17:Reading tar file integrator.xml
02:39:25:WU00:FS01:0x17:Reading tar file core.xml
02:39:25:WU00:FS01:0x17:Digital signatures verified
02:39:25:WU00:FS01:0x17:Folding@home GPU core17
02:39:25:WU00:FS01:0x17:Version 0.0.52
02:42:31:WU00:FS01:0x17:ERROR:exception: Force RMSE error of 453.185 with threshold of 5
02:42:31:WU00:FS01:0x17:Saving result file logfile_01.txt
02:42:31:WU00:FS01:0x17:Saving result file log.txt
02:42:31:WU00:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
02:42:31:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
02:42:31:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:13000 run:1951 clone:4 gen:13 core:0x17 unit:0x00000017538b3db75311c38e95e1509b
02:42:31:WU00:FS01:Uploading 2.26KiB to 140.163.4.231
02:42:31:WU00:FS01:Connecting to 140.163.4.231:8080
02:42:31:WU00:FS01:Upload complete
02:42:32:WU00:FS01:Server responded WORK_ACK (400)
02:42:32:WU00:FS01:Cleaning up
02:42:32:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
02:42:32:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:13001 run:327 clone:3 gen:73 core:0x17 unit:0x00000098538b3db75328ac7113fd9932
02:42:32:WU01:FS02:Uploading 2.25KiB to 140.163.4.231
02:42:32:WU01:FS02:Connecting to 140.163.4.231:8080
02:42:32:WU02:FS01:Connecting to 171.67.108.201:80
02:42:32:WU01:FS02:Upload complete
02:42:32:WU01:FS02:Server responded WORK_ACK (400)
02:42:32:WU01:FS02:Cleaning up
02:42:32:WU00:FS02:Connecting to 171.67.108.201:80
02:42:32:WU02:FS01:Assigned to work server 140.163.4.231
02:42:32:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
02:42:32:WU02:FS01:Connecting to 140.163.4.231:8080
02:42:32:WU00:FS02:Assigned to work server 140.163.4.231
02:42:32:WU02:FS01:Downloading 4.83MiB
02:42:32:WU00:FS02:Requesting new work unit for slot 02: READY gpu:1:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
02:42:32:WU00:FS02:Connecting to 140.163.4.231:8080
02:42:33:WU00:FS02:Downloading 4.84MiB
02:42:36:WU00:FS02:Download complete
02:42:36:WU00:FS02:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13000 run:530 clone:5 gen:13 core:0x17 unit:0x00000016538b3db753103187803b7579
02:42:36:WU00:FS02:Starting
02:42:36:WU00:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 2144 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
02:42:36:WU00:FS02:Started FahCore on PID 2568
02:42:36:WU00:FS02:Core PID:560
02:42:36:WU00:FS02:FahCore 0x17 started
02:42:36:WU02:FS01:Download complete
02:42:36:WU00:FS02:0x17:*********************** Log Started 2014-10-05T02:42:36Z ***********************
02:42:36:WU00:FS02:0x17:Project: 13000 (Run 530, Clone 5, Gen 13)
02:42:36:WU00:FS02:0x17:Unit: 0x00000016538b3db753103187803b7579
02:42:36:WU00:FS02:0x17:CPU: 0x00000000000000000000000000000000
02:42:36:WU00:FS02:0x17:Machine: 2
02:42:36:WU00:FS02:0x17:Reading tar file state.xml
02:42:36:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13001 run:173 clone:8 gen:13 core:0x17 unit:0x00000017538b3db7532880e6ffa4530d
02:42:36:WU02:FS01:Starting
02:42:36:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 2144 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
02:42:36:WU02:FS01:Started FahCore on PID 512
02:42:36:WU02:FS01:Core PID:984
02:42:36:WU02:FS01:FahCore 0x17 started
02:42:37:WU00:FS02:0x17:Reading tar file system.xml
02:42:37:WU02:FS01:0x17:*********************** Log Started 2014-10-05T02:42:36Z ***********************
02:42:37:WU02:FS01:0x17:Project: 13001 (Run 173, Clone 8, Gen 13)
02:42:37:WU02:FS01:0x17:Unit: 0x00000017538b3db7532880e6ffa4530d
02:42:37:WU02:FS01:0x17:CPU: 0x00000000000000000000000000000000
02:42:37:WU02:FS01:0x17:Machine: 1
02:42:37:WU02:FS01:0x17:Reading tar file state.xml
02:42:37:WU02:FS01:0x17:Reading tar file system.xml
02:42:38:WU00:FS02:0x17:Reading tar file integrator.xml
02:42:38:WU00:FS02:0x17:Reading tar file core.xml
02:42:38:WU00:FS02:0x17:Digital signatures verified
02:42:38:WU00:FS02:0x17:Folding@home GPU core17
02:42:38:WU00:FS02:0x17:Version 0.0.52
02:42:38:WU02:FS01:0x17:Reading tar file integrator.xml
02:42:38:WU02:FS01:0x17:Reading tar file core.xml
02:42:38:WU02:FS01:0x17:Digital signatures verified
02:42:38:WU02:FS01:0x17:Folding@home GPU core17
02:42:38:WU02:FS01:0x17:Version 0.0.52
02:45:43:WU02:FS01:0x17:ERROR:exception: Force RMSE error of 450.183 with threshold of 5
02:45:43:WU02:FS01:0x17:Saving result file logfile_01.txt
02:45:43:WU02:FS01:0x17:Saving result file log.txt
02:45:43:WU02:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
02:45:43:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
02:45:43:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:13001 run:173 clone:8 gen:13 core:0x17 unit:0x00000017538b3db7532880e6ffa4530d
02:45:43:WU02:FS01:Uploading 2.26KiB to 140.163.4.231
02:45:43:WU02:FS01:Connecting to 140.163.4.231:8080
02:45:43:WU02:FS01:Upload complete
02:45:43:WU02:FS01:Server responded WORK_ACK (400)
02:45:43:WU02:FS01:Cleaning up
02:45:43:WU01:FS01:Connecting to 171.67.108.201:80
02:45:44:WU00:FS02:0x17:ERROR:exception: Force RMSE error of 450.472 with threshold of 5
02:45:44:WU00:FS02:0x17:Saving result file logfile_01.txt
02:45:44:WU00:FS02:0x17:Saving result file log.txt
02:45:44:WU00:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
02:45:44:WU01:FS01:Assigned to work server 140.163.4.231
02:45:44:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
02:45:44:WU01:FS01:Connecting to 140.163.4.231:8080
02:45:44:WARNING:WU00:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
02:45:44:WU00:FS02:Sending unit results: id:00 state:SEND error:FAULTY project:13000 run:530 clone:5 gen:13 core:0x17 unit:0x00000016538b3db753103187803b7579
02:45:44:WU00:FS02:Uploading 2.25KiB to 140.163.4.231
02:45:44:WU00:FS02:Connecting to 140.163.4.231:8080
02:45:44:WU01:FS01:Downloading 4.84MiB
02:45:44:WU00:FS02:Upload complete
02:45:44:WU00:FS02:Server responded WORK_ACK (400)
02:45:44:WU00:FS02:Cleaning up
02:45:44:WU00:FS02:Connecting to 171.67.108.201:80
02:45:45:WU00:FS02:Assigned to work server 140.163.4.231
02:45:45:WU00:FS02:Requesting new work unit for slot 02: READY gpu:1:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
02:45:45:WU00:FS02:Connecting to 140.163.4.231:8080
02:45:45:WU00:FS02:Downloading 4.84MiB
02:45:47:WU01:FS01:Download complete
02:45:47:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13001 run:371 clone:9 gen:17 core:0x17 unit:0x00000023538b3db75328b913e9bb2cce
02:45:47:WU01:FS01:Starting
02:45:47:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 2144 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
02:45:47:WU01:FS01:Started FahCore on PID 156
02:45:47:WU01:FS01:Core PID:1360
02:45:47:WU01:FS01:FahCore 0x17 started
02:45:47:WU01:FS01:0x17:*********************** Log Started 2014-10-05T02:45:47Z ***********************
02:45:47:WU01:FS01:0x17:Project: 13001 (Run 371, Clone 9, Gen 17)
02:45:47:WU01:FS01:0x17:Unit: 0x00000023538b3db75328b913e9bb2cce
02:45:47:WU01:FS01:0x17:CPU: 0x00000000000000000000000000000000
02:45:47:WU01:FS01:0x17:Machine: 1
02:45:47:WU01:FS01:0x17:Reading tar file state.xml
02:45:48:WU01:FS01:0x17:Reading tar file system.xml
02:45:49:WU01:FS01:0x17:Reading tar file integrator.xml
02:45:49:WU01:FS01:0x17:Reading tar file core.xml
02:45:49:WU01:FS01:0x17:Digital signatures verified
02:45:49:WU01:FS01:0x17:Folding@home GPU core17
02:45:49:WU01:FS01:0x17:Version 0.0.52
02:45:50:WU00:FS02:Download complete
02:45:50:WU00:FS02:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13000 run:1172 clone:5 gen:13 core:0x17 unit:0x0000001b538b3db75310e6e025f4ef16
02:45:50:WU00:FS02:Starting
02:45:50:WU00:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 2144 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
02:45:50:WU00:FS02:Started FahCore on PID 1624
02:45:50:WU00:FS02:Core PID:2480
02:45:50:WU00:FS02:FahCore 0x17 started
02:45:50:WU00:FS02:0x17:*********************** Log Started 2014-10-05T02:45:50Z ***********************
02:45:50:WU00:FS02:0x17:Project: 13000 (Run 1172, Clone 5, Gen 13)
02:45:50:WU00:FS02:0x17:Unit: 0x0000001b538b3db75310e6e025f4ef16
02:45:50:WU00:FS02:0x17:CPU: 0x00000000000000000000000000000000
02:45:50:WU00:FS02:0x17:Machine: 2
02:45:50:WU00:FS02:0x17:Reading tar file state.xml
02:45:51:WU00:FS02:0x17:Reading tar file system.xml
02:45:52:WU00:FS02:0x17:Reading tar file integrator.xml
02:45:52:WU00:FS02:0x17:Reading tar file core.xml
02:45:52:WU00:FS02:0x17:Digital signatures verified
02:45:52:WU00:FS02:0x17:Folding@home GPU core17
02:45:52:WU00:FS02:0x17:Version 0.0.52
02:48:52:WU01:FS01:0x17:ERROR:exception: Force RMSE error of 453.657 with threshold of 5
02:48:52:WU01:FS01:0x17:Saving result file logfile_01.txt
02:48:52:WU01:FS01:0x17:Saving result file log.txt
02:48:52:WU01:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
02:48:52:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
02:48:52:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:13001 run:371 clone:9 gen:17 core:0x17 unit:0x00000023538b3db75328b913e9bb2cce
02:48:52:WU01:FS01:Uploading 2.27KiB to 140.163.4.231
02:48:52:WU01:FS01:Connecting to 140.163.4.231:8080
02:48:52:WU01:FS01:Upload complete
02:48:52:WU01:FS01:Server responded WORK_ACK (400)
02:48:52:WU01:FS01:Cleaning up
02:48:52:WU02:FS01:Connecting to 171.67.108.201:80
02:48:53:WU02:FS01:Assigned to work server 140.163.4.231
02:48:53:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
02:48:53:WU02:FS01:Connecting to 140.163.4.231:8080
02:48:53:WU02:FS01:Downloading 4.84MiB
02:48:55:WU02:FS01:Download complete
02:48:55:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13001 run:345 clone:2 gen:83 core:0x17 unit:0x00000098538b3db75328b18417c5bd32
02:48:55:WU02:FS01:Starting
02:48:55:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 2144 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
02:48:55:WU02:FS01:Started FahCore on PID 3536
02:48:55:WU02:FS01:Core PID:3656
02:48:55:WU02:FS01:FahCore 0x17 started
02:48:56:WU02:FS01:0x17:*********************** Log Started 2014-10-05T02:48:56Z ***********************
02:48:56:WU02:FS01:0x17:Project: 13001 (Run 345, Clone 2, Gen 83)
02:48:56:WU02:FS01:0x17:Unit: 0x00000098538b3db75328b18417c5bd32
02:48:56:WU02:FS01:0x17:CPU: 0x00000000000000000000000000000000
02:48:56:WU02:FS01:0x17:Machine: 1
02:48:56:WU02:FS01:0x17:Reading tar file state.xml
02:48:57:WU00:FS02:0x17:ERROR:exception: Force RMSE error of 454.939 with threshold of 5
02:48:57:WU00:FS02:0x17:Saving result file logfile_01.txt
02:48:57:WU00:FS02:0x17:Saving result file log.txt
02:48:57:WU00:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
02:48:57:WU02:FS01:0x17:Reading tar file system.xml
02:48:57:WARNING:WU00:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
02:48:57:WU00:FS02:Sending unit results: id:00 state:SEND error:FAULTY project:13000 run:1172 clone:5 gen:13 core:0x17 unit:0x0000001b538b3db75310e6e025f4ef16
02:48:57:WU00:FS02:Uploading 2.26KiB to 140.163.4.231
02:48:57:WU00:FS02:Connecting to 140.163.4.231:8080
02:48:57:WU00:FS02:Upload complete
02:48:57:WU00:FS02:Server responded WORK_ACK (400)
02:48:57:WU00:FS02:Cleaning up
02:48:57:WU01:FS02:Connecting to 171.67.108.201:80
02:48:57:WU02:FS01:0x17:Reading tar file integrator.xml
02:48:57:WU02:FS01:0x17:Reading tar file core.xml
02:48:57:WU02:FS01:0x17:Digital signatures verified
02:48:57:WU02:FS01:0x17:Folding@home GPU core17
02:48:57:WU02:FS01:0x17:Version 0.0.52
02:48:58:WU01:FS02:Assigned to work server 140.163.4.231
02:48:58:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
02:48:58:WU01:FS02:Connecting to 140.163.4.231:8080
02:48:58:WU01:FS02:Downloading 4.84MiB
02:49:00:WU01:FS02:Download complete
02:49:00:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13000 run:1278 clone:5 gen:13 core:0x17 unit:0x00000016538b3db7531104ea601b7410
02:49:00:WU01:FS02:Starting
02:49:00:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 2144 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
02:49:00:WU01:FS02:Started FahCore on PID 3580
02:49:00:WU01:FS02:Core PID:3488
02:49:00:WU01:FS02:FahCore 0x17 started
02:49:00:WU01:FS02:0x17:*********************** Log Started 2014-10-05T02:49:00Z ***********************
02:49:00:WU01:FS02:0x17:Project: 13000 (Run 1278, Clone 5, Gen 13)
02:49:00:WU01:FS02:0x17:Unit: 0x00000016538b3db7531104ea601b7410
02:49:00:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
02:49:00:WU01:FS02:0x17:Machine: 2
02:49:00:WU01:FS02:0x17:Reading tar file state.xml
02:49:01:WU01:FS02:0x17:Reading tar file system.xml
02:49:02:WU01:FS02:0x17:Reading tar file integrator.xml
02:49:02:WU01:FS02:0x17:Reading tar file core.xml
02:49:02:WU01:FS02:0x17:Digital signatures verified
02:49:02:WU01:FS02:0x17:Folding@home GPU core17
02:49:02:WU01:FS02:0x17:Version 0.0.52
02:52:08:WU02:FS01:0x17:ERROR:exception: Force RMSE error of 450.77 with threshold of 5
02:52:08:WU02:FS01:0x17:Saving result file logfile_01.txt
02:52:08:WU02:FS01:0x17:Saving result file log.txt
02:52:08:WU02:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
02:52:08:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
02:52:08:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:13001 run:345 clone:2 gen:83 core:0x17 unit:0x00000098538b3db75328b18417c5bd32
02:52:08:WU02:FS01:Uploading 2.26KiB to 140.163.4.231
02:52:08:WU02:FS01:Connecting to 140.163.4.231:8080
02:52:09:WU00:FS01:Connecting to 171.67.108.201:80
02:52:09:WU00:FS01:Assigned to work server 140.163.4.231
02:52:09:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
02:52:09:WU00:FS01:Connecting to 140.163.4.231:8080
02:52:11:WU02:FS01:Upload complete
02:52:11:WU02:FS01:Server responded WORK_ACK (400)
02:52:11:WU02:FS01:Cleaning up
02:52:12:WU00:FS01:Downloading 4.84MiB
02:52:12:WU01:FS02:0x17:ERROR:exception: Force RMSE error of 457.081 with threshold of 5
02:52:12:WU01:FS02:0x17:Saving result file logfile_01.txt
02:52:12:WU01:FS02:0x17:Saving result file log.txt
02:52:12:WU01:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
02:52:12:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
02:52:12:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:13000 run:1278 clone:5 gen:13 core:0x17 unit:0x00000016538b3db7531104ea601b7410
02:52:12:WU01:FS02:Uploading 2.25KiB to 140.163.4.231
02:52:12:WU01:FS02:Connecting to 140.163.4.231:8080
02:52:12:WU01:FS02:Upload complete
02:52:12:WU01:FS02:Server responded WORK_ACK (400)
02:52:12:WU01:FS02:Cleaning up
02:52:12:WU02:FS02:Connecting to 171.67.108.201:80
02:52:13:WU02:FS02:Assigned to work server 140.163.4.231
02:52:13:WU02:FS02:Requesting new work unit for slot 02: READY gpu:1:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
02:52:13:WU02:FS02:Connecting to 140.163.4.231:8080
02:52:13:WU02:FS02:Downloading 4.84MiB
02:52:14:WU00:FS01:Download complete
02:52:14:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13001 run:194 clone:1 gen:67 core:0x17 unit:0x0000006e538b3db7532886af44cf04e1
02:52:14:WU00:FS01:Starting
02:52:14:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 2144 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
02:52:14:WU00:FS01:Started FahCore on PID 728
02:52:14:WU00:FS01:Core PID:3320
02:52:14:WU00:FS01:FahCore 0x17 started
02:52:15:WU00:FS01:0x17:*********************** Log Started 2014-10-05T02:52:14Z ***********************
02:52:15:WU00:FS01:0x17:Project: 13001 (Run 194, Clone 1, Gen 67)
02:52:15:WU00:FS01:0x17:Unit: 0x0000006e538b3db7532886af44cf04e1
02:52:15:WU00:FS01:0x17:CPU: 0x00000000000000000000000000000000
02:52:15:WU00:FS01:0x17:Machine: 1
02:52:15:WU00:FS01:0x17:Reading tar file state.xml
02:52:15:WU00:FS01:0x17:Reading tar file system.xml
02:52:16:WU02:FS02:Download complete
02:52:16:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13000 run:502 clone:6 gen:13 core:0x17 unit:0x00000014538b3db7531029ab7b06291f
02:52:16:WU00:FS01:0x17:Reading tar file integrator.xml
02:52:16:WU00:FS01:0x17:Reading tar file core.xml
02:52:16:WU00:FS01:0x17:Digital signatures verified
02:52:16:WU00:FS01:0x17:Folding@home GPU core17
02:52:16:WU00:FS01:0x17:Version 0.0.52
02:52:16:WU02:FS02:Starting
02:52:16:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 2144 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
02:52:16:WU02:FS02:Started FahCore on PID 916
02:52:16:WU02:FS02:Core PID:592
02:52:16:WU02:FS02:FahCore 0x17 started
02:52:17:WU02:FS02:0x17:*********************** Log Started 2014-10-05T02:52:16Z ***********************
02:52:17:WU02:FS02:0x17:Project: 13000 (Run 502, Clone 6, Gen 13)
02:52:17:WU02:FS02:0x17:Unit: 0x00000014538b3db7531029ab7b06291f
02:52:17:WU02:FS02:0x17:CPU: 0x00000000000000000000000000000000
02:52:17:WU02:FS02:0x17:Machine: 2
02:52:17:WU02:FS02:0x17:Reading tar file state.xml
02:52:17:WU02:FS02:0x17:Reading tar file system.xml
02:52:18:WU02:FS02:0x17:Reading tar file integrator.xml
02:52:18:WU02:FS02:0x17:Reading tar file core.xml
02:52:18:WU02:FS02:0x17:Digital signatures verified
02:52:18:WU02:FS02:0x17:Folding@home GPU core17
02:52:18:WU02:FS02:0x17:Version 0.0.52

soa_rru · Post by **soa_rru** » Sun Oct 05, 2014 10:06 am

Same problem here, 9406 & 13001 wu's just sit doing nothing for 5-10mins then get dumped and so on, exactly the same problem when i 1st started folding with my 750Ti.

Like many others my card has been folding core17 for months without any problems but now it's all gone abit Pete Tong

uddarts · Post by **uddarts** » Sun Oct 05, 2014 11:29 am

same here, 750ti, win7/64, 337.88, v7.4.4

ud

Nert · Post by **Nert** » Sun Oct 05, 2014 2:07 pm

I don't know if I should start a new thread or tack onto this one. I believe I experienced the problem described here for project 9406. My system is running Windows Vista and the graphics card is a GTX 750 TI. Everything is stock, and the system has been stable for a long time. Here is the log:

Code: Select all

*********************** Log Started 2014-10-03T19:46:38Z ***********************
19:46:38:************************* Folding@home Client *************************
19:46:38:      Website: http://folding.stanford.edu/
19:46:38:    Copyright: (c) 2009-2013 Stanford University
19:46:38:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
19:46:38:         Args: 
19:46:38:       Config: C:/ProgramData/FAHClient/config.xml
19:46:38:******************************** Build ********************************
19:46:38:      Version: 7.3.6
19:46:38:         Date: Feb 18 2013
19:46:38:         Time: 15:25:17
19:46:38:      SVN Rev: 3923
19:46:38:       Branch: fah/trunk/client
19:46:38:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
19:46:38:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
19:46:38:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
19:46:38:     Platform: win32 XP
19:46:38:         Bits: 32
19:46:38:         Mode: Release
19:46:38:******************************* System ********************************
19:46:38:          CPU: Intel(R) Core(TM)2 CPU 6600 @ 2.40GHz
19:46:38:       CPU ID: GenuineIntel Family 6 Model 15 Stepping 6
19:46:38:         CPUs: 2
19:46:38:       Memory: 2.87GiB
19:46:38:  Free Memory: 1.69GiB
19:46:38:      Threads: WINDOWS_THREADS
19:46:38:  Has Battery: false
19:46:38:   On Battery: false
19:46:38:   UTC offset: -5
19:46:38:          PID: 2912
19:46:38:          CWD: C:/ProgramData/FAHClient
19:46:38:           OS: Windows Vista (TM) Home Premium Service Pack 2
19:46:38:      OS Arch: X86
19:46:38:         GPUs: 1
19:46:38:        GPU 0: NVIDIA:4 GM107 [GeForce GTX 750 Ti]
19:46:38:         CUDA: 5.0
19:46:38:  CUDA Driver: 6050
19:46:38:Win32 Service: false
19:46:38:***********************************************************************
19:46:38:<config>
19:46:38:  <!-- Folding Core -->
19:46:38:  <checkpoint v='30'/>
19:46:38:
19:46:38:  <!-- Folding Slot Configuration -->
19:46:38:  <client-type v='advanced'/>
19:46:38:  <power v='FULL'/>
19:46:38:
19:46:38:  <!-- Network -->
19:46:38:  <proxy v=':8080'/>
19:46:38:
19:46:38:  <!-- User Information -->
19:46:38:  <passkey v='********************************'/>
19:46:38:  <team v='165780'/>
19:46:38:  <user v='nert'/>
19:46:38:
19:46:38:  <!-- Folding Slots -->
19:46:38:  <slot id='0' type='GPU'/>
19:46:38:</config>
19:46:38:Trying to access database...
19:46:53:Successfully acquired database lock
19:46:53:Enabled folding slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti]
19:46:56:WU01:FS00:Starting
19:46:56:WU01:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 703 -lifeline 2912 -checkpoint 30 -gpu 0 -gpu-vendor nvidia
19:46:57:WU01:FS00:Started FahCore on PID 5776
19:47:02:WU01:FS00:Core PID:5820
19:47:02:WU01:FS00:FahCore 0x15 started
19:47:03:WU01:FS00:0x15:
19:47:03:WU01:FS00:0x15:*------------------------------*
19:47:03:WU01:FS00:0x15:Folding@Home GPU Core
19:47:03:WU01:FS00:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
19:47:03:WU01:FS00:0x15:Build host             AmoebaRemote
19:47:03:WU01:FS00:0x15:Board Type             NVIDIA/CUDA
19:47:03:WU01:FS00:0x15:Core                   15
19:47:03:WU01:FS00:0x15:
19:47:03:WU01:FS00:0x15:Window's signal control handler registered.
19:47:03:WU01:FS00:0x15:Preparing to commence simulation
19:47:03:WU01:FS00:0x15:- Looking at optimizations...
19:47:03:WU01:FS00:0x15:- Files status OK
19:47:03:WU01:FS00:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:47:03:WU01:FS00:0x15:- Expanded 125041 -> 501826 (decompressed 401.3 percent)
19:47:03:WU01:FS00:0x15:Called DecompressByteArray: compressed_data_size=125041 data_size=501826, decompressed_data_size=501826 diff=0
19:47:03:WU01:FS00:0x15:- Digital signature verified
19:47:03:WU01:FS00:0x15:
19:47:03:WU01:FS00:0x15:Project: 7620 (Run 822, Clone 0, Gen 205)
19:47:03:WU01:FS00:0x15:
19:47:04:WU01:FS00:0x15:Assembly optimizations on if available.
19:47:04:WU01:FS00:0x15:Entering M.D.
19:47:06:WU01:FS00:0x15:Will resume from checkpoint file 01/wudata_01.ckp
19:47:06:WU01:FS00:0x15:Tpr hash 01/wudata_01.tpr:  1702531542 1041547298 2000879970 326690035 4116792553
19:47:06:WU01:FS00:0x15:GPU device id=0
19:47:10:WU01:FS00:0x15:Working on Protein
19:47:10:WU01:FS00:0x15:Client config unavailable.
19:47:10:WU01:FS00:0x15:Starting GUI Server
19:49:34:WU01:FS00:0x15:Resuming from checkpoint
19:49:34:WU01:FS00:0x15:fcCheckPointResume: retreived and current tpr file hash:
19:49:34:WU01:FS00:0x15:   0   1702531542   1702531542
19:49:34:WU01:FS00:0x15:   1   1041547298   1041547298
19:49:34:WU01:FS00:0x15:   2   2000879970   2000879970
19:49:34:WU01:FS00:0x15:   3    326690035    326690035
19:49:34:WU01:FS00:0x15:   4   4116792553   4116792553
19:49:34:WU01:FS00:0x15:fcCheckPointResume: file hashes same.
19:49:34:WU01:FS00:0x15:fcCheckPointResume: state restored.
19:49:34:WU01:FS00:0x15:fcCheckPointResume: name 01/wudata_01.log Verified 01/wudata_01.log
19:49:34:WU01:FS00:0x15:fcCheckPointResume: name 01/wudata_01.trr Verified 01/wudata_01.trr
19:49:34:WU01:FS00:0x15:fcCheckPointResume: name 01/wudata_01.xtc Verified 01/wudata_01.xtc
19:49:34:WU01:FS00:0x15:fcCheckPointResume: name 01/wudata_01.edr Verified 01/wudata_01.edr
19:49:34:WU01:FS00:0x15:fcCheckPointResume: state restored 2
19:49:34:WU01:FS00:0x15:Resumed from checkpoint
19:49:34:WU01:FS00:0x15:Setting checkpoint frequency: 400000
19:49:34:WU01:FS00:0x15:Completed  16400001 out of 40000000 steps (41%).
19:56:47:WU01:FS00:0x15:Completed  16800000 out of 40000000 steps (42%).
20:03:56:WU01:FS00:0x15:Completed  17200000 out of 40000000 steps (43%).
20:11:09:WU01:FS00:0x15:Completed  17600000 out of 40000000 steps (44%).
20:18:26:WU01:FS00:0x15:Completed  18000000 out of 40000000 steps (45%).
20:25:56:WU01:FS00:0x15:Completed  18400000 out of 40000000 steps (46%).
20:33:10:WU01:FS00:0x15:Completed  18800000 out of 40000000 steps (47%).
20:40:25:WU01:FS00:0x15:Completed  19200000 out of 40000000 steps (48%).
20:47:40:WU01:FS00:0x15:Completed  19600000 out of 40000000 steps (49%).
20:54:54:WU01:FS00:0x15:Completed  20000000 out of 40000000 steps (50%).
21:01:59:WU01:FS00:0x15:Completed  20400000 out of 40000000 steps (51%).
21:09:05:WU01:FS00:0x15:Completed  20800000 out of 40000000 steps (52%).
21:16:10:WU01:FS00:0x15:Completed  21200000 out of 40000000 steps (53%).
21:23:15:WU01:FS00:0x15:Completed  21600000 out of 40000000 steps (54%).
21:30:22:WU01:FS00:0x15:Completed  22000000 out of 40000000 steps (55%).
21:37:28:WU01:FS00:0x15:Completed  22400000 out of 40000000 steps (56%).
21:44:33:WU01:FS00:0x15:Completed  22800000 out of 40000000 steps (57%).
21:51:38:WU01:FS00:0x15:Completed  23200000 out of 40000000 steps (58%).
21:58:43:WU01:FS00:0x15:Completed  23600000 out of 40000000 steps (59%).
22:05:48:WU01:FS00:0x15:Completed  24000000 out of 40000000 steps (60%).
22:12:53:WU01:FS00:0x15:Completed  24400000 out of 40000000 steps (61%).
22:19:59:WU01:FS00:0x15:Completed  24800000 out of 40000000 steps (62%).
22:27:04:WU01:FS00:0x15:Completed  25200000 out of 40000000 steps (63%).
22:34:09:WU01:FS00:0x15:Completed  25600000 out of 40000000 steps (64%).
22:41:14:WU01:FS00:0x15:Completed  26000000 out of 40000000 steps (65%).
22:48:19:WU01:FS00:0x15:Completed  26400000 out of 40000000 steps (66%).
22:55:24:WU01:FS00:0x15:Completed  26800000 out of 40000000 steps (67%).
23:02:30:WU01:FS00:0x15:Completed  27200000 out of 40000000 steps (68%).
23:09:35:WU01:FS00:0x15:Completed  27600000 out of 40000000 steps (69%).
23:16:40:WU01:FS00:0x15:Completed  28000000 out of 40000000 steps (70%).
23:23:45:WU01:FS00:0x15:Completed  28400000 out of 40000000 steps (71%).
23:30:50:WU01:FS00:0x15:Completed  28800000 out of 40000000 steps (72%).
23:37:55:WU01:FS00:0x15:Completed  29200000 out of 40000000 steps (73%).
23:45:01:WU01:FS00:0x15:Completed  29600000 out of 40000000 steps (74%).
23:52:06:WU01:FS00:0x15:Completed  30000000 out of 40000000 steps (75%).
23:59:11:WU01:FS00:0x15:Completed  30400000 out of 40000000 steps (76%).
00:06:16:WU01:FS00:0x15:Completed  30800000 out of 40000000 steps (77%).
00:13:21:WU01:FS00:0x15:Completed  31200000 out of 40000000 steps (78%).
00:20:26:WU01:FS00:0x15:Completed  31600000 out of 40000000 steps (79%).
00:27:32:WU01:FS00:0x15:Completed  32000000 out of 40000000 steps (80%).
00:34:37:WU01:FS00:0x15:Completed  32400000 out of 40000000 steps (81%).
00:41:42:WU01:FS00:0x15:Completed  32800000 out of 40000000 steps (82%).
00:48:47:WU01:FS00:0x15:Completed  33200000 out of 40000000 steps (83%).
00:55:52:WU01:FS00:0x15:Completed  33600000 out of 40000000 steps (84%).
01:02:57:WU01:FS00:0x15:Completed  34000000 out of 40000000 steps (85%).
01:10:02:WU01:FS00:0x15:Completed  34400000 out of 40000000 steps (86%).
01:17:07:WU01:FS00:0x15:Completed  34800000 out of 40000000 steps (87%).
01:24:13:WU01:FS00:0x15:Completed  35200000 out of 40000000 steps (88%).
01:31:18:WU01:FS00:0x15:Completed  35600000 out of 40000000 steps (89%).
01:38:23:WU01:FS00:0x15:Completed  36000000 out of 40000000 steps (90%).
01:45:31:WU01:FS00:0x15:Completed  36400000 out of 40000000 steps (91%).
******************************* Date: 2014-10-04 *******************************
01:52:45:WU01:FS00:0x15:Completed  36800000 out of 40000000 steps (92%).
02:00:00:WU01:FS00:0x15:Completed  37200000 out of 40000000 steps (93%).
02:07:24:WU01:FS00:0x15:Completed  37600000 out of 40000000 steps (94%).
02:14:44:WU01:FS00:0x15:Completed  38000000 out of 40000000 steps (95%).
02:21:58:WU01:FS00:0x15:Completed  38400000 out of 40000000 steps (96%).
02:29:11:WU01:FS00:0x15:Completed  38800000 out of 40000000 steps (97%).
02:36:25:WU01:FS00:0x15:Completed  39200000 out of 40000000 steps (98%).
02:36:25:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
02:36:26:WU00:FS00:News: 
02:36:26:WU00:FS00:Assigned to work server 171.64.65.105
02:36:26:WU00:FS00:Requesting new work unit for slot 00: RUNNING gpu:0:GM107 [GeForce GTX 750 Ti] from 171.64.65.105
02:36:26:WU00:FS00:Connecting to 171.64.65.105:8080
02:36:27:WU00:FS00:Downloading 122.50KiB
02:36:27:WU00:FS00:Download complete
02:36:27:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:7621 run:734 clone:0 gen:152 core:0x15 unit:0x000000b5664f2dd14e4308db3a58fbe1
02:43:30:WU01:FS00:0x15:Completed  39600000 out of 40000000 steps (99%).
02:50:35:WU01:FS00:0x15:Completed  40000000 out of 40000000 steps (100%).
02:50:36:WU01:FS00:0x15:Finished fah_main status=0
02:50:36:WU01:FS00:0x15:Successful run
02:50:36:WU01:FS00:0x15:DynamicWrapper: Finished Work Unit: sleep=10000
02:50:46:WU01:FS00:0x15:Reserved 759968 bytes for xtc file; Cosm status=0
02:50:46:WU01:FS00:0x15:Allocated 759968 bytes for xtc file
02:50:46:WU01:FS00:0x15:- Reading up to 759968 from "01/wudata_01.xtc": Read 759968
02:50:46:WU01:FS00:0x15:Read 759968 bytes from xtc file; available packet space=785670496
02:50:46:WU01:FS00:0x15:xtc file hash check passed.
02:50:46:WU01:FS00:0x15:Reserved 47688 47688 785670496 bytes for arc file=<01/wudata_01.trr> Cosm status=0
02:50:46:WU01:FS00:0x15:Allocated 47688 bytes for arc file
02:50:46:WU01:FS00:0x15:- Reading up to 47688 from "01/wudata_01.trr": Read 47688
02:50:46:WU01:FS00:0x15:Read 47688 bytes from arc file; available packet space=785622808
02:50:46:WU01:FS00:0x15:trr file hash check passed.
02:50:46:WU01:FS00:0x15:Allocated 544 bytes for edr file
02:50:46:WU01:FS00:0x15:Read bedfile
02:50:46:WU01:FS00:0x15:edr file hash check passed.
02:50:46:WU01:FS00:0x15:Allocated 36955 bytes for logfile
02:50:46:WU01:FS00:0x15:Read logfile
02:50:46:WU01:FS00:0x15:GuardedRun: success in DynamicWrapper
02:50:46:WU01:FS00:0x15:GuardedRun: done
02:50:46:WU01:FS00:0x15:Run: GuardedRun completed.
02:50:50:WU01:FS00:0x15:+ Opened results file
02:50:50:WU01:FS00:0x15:- Writing 845667 bytes of core data to disk...
02:50:50:WU01:FS00:0x15:Done: 845155 -> 816963 (compressed to 96.6 percent)
02:50:50:WU01:FS00:0x15:  ... Done.
02:50:50:WU01:FS00:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
02:50:51:WU01:FS00:0x15:Shutting down core 
02:50:51:WU01:FS00:0x15:
02:50:51:WU01:FS00:0x15:Folding@home Core Shutdown: FINISHED_UNIT
02:50:52:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
02:50:52:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:7620 run:822 clone:0 gen:205 core:0x15 unit:0x00000112664f2dd14e42f7be2dc99088
02:50:52:WU01:FS00:Uploading 798.32KiB to 171.64.65.105
02:50:52:WU00:FS00:Starting
02:50:52:WU01:FS00:Connecting to 171.64.65.105:8080
02:50:52:WU00:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 00 -suffix 01 -version 703 -lifeline 2912 -checkpoint 30 -gpu 0 -gpu-vendor nvidia
02:50:52:WU00:FS00:Started FahCore on PID 4848
02:50:52:WU00:FS00:Core PID:4844
02:50:52:WU00:FS00:FahCore 0x15 started
02:50:53:WU00:FS00:0x15:
02:50:53:WU00:FS00:0x15:*------------------------------*
02:50:53:WU00:FS00:0x15:Folding@Home GPU Core
02:50:53:WU00:FS00:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
02:50:53:WU00:FS00:0x15:Build host             AmoebaRemote
02:50:53:WU00:FS00:0x15:Board Type             NVIDIA/CUDA
02:50:53:WU00:FS00:0x15:Core                   15
02:50:53:WU00:FS00:0x15:
02:50:53:WU00:FS00:0x15:Window's signal control handler registered.
02:50:53:WU00:FS00:0x15:Preparing to commence simulation
02:50:53:WU00:FS00:0x15:- Looking at optimizations...
02:50:53:WU00:FS00:0x15:DeleteFrameFiles: successfully deleted file=00/wudata_01.ckp
02:50:53:WU00:FS00:0x15:- Created dyn
02:50:53:WU00:FS00:0x15:- Files status OK
02:50:53:WU00:FS00:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
02:50:53:WU00:FS00:0x15:- Expanded 124927 -> 501826 (decompressed 401.6 percent)
02:50:53:WU00:FS00:0x15:Called DecompressByteArray: compressed_data_size=124927 data_size=501826, decompressed_data_size=501826 diff=0
02:50:53:WU00:FS00:0x15:- Digital signature verified
02:50:53:WU00:FS00:0x15:
02:50:53:WU00:FS00:0x15:Project: 7621 (Run 734, Clone 0, Gen 152)
02:50:53:WU00:FS00:0x15:
02:50:53:WU00:FS00:0x15:Assembly optimizations on if available.
02:50:53:WU00:FS00:0x15:Entering M.D.
02:50:55:WU00:FS00:0x15:Tpr hash 00/wudata_01.tpr:  1411028397 2720458862 465562056 801132076 4107038546
02:50:55:WU00:FS00:0x15:GPU device id=0
02:50:55:WU00:FS00:0x15:Working on Protein
02:50:55:WU00:FS00:0x15:Client config unavailable.
02:50:55:WU00:FS00:0x15:Starting GUI Server
02:50:58:WU01:FS00:Upload 72.15%
02:51:01:WU01:FS00:Upload complete
02:51:01:WU01:FS00:Server responded WORK_ACK (400)
02:51:01:WU01:FS00:Final credit estimate, 14093.00 points
02:51:01:WU01:FS00:Cleaning up
02:52:05:WU00:FS00:0x15:Setting checkpoint frequency: 400000
02:52:05:WU00:FS00:0x15:Completed         3 out of 40000000 steps (0%).
02:59:10:WU00:FS00:0x15:Completed    400000 out of 40000000 steps (1%).
03:06:15:WU00:FS00:0x15:Completed    800000 out of 40000000 steps (2%).
03:13:20:WU00:FS00:0x15:Completed   1200000 out of 40000000 steps (3%).
03:20:25:WU00:FS00:0x15:Completed   1600000 out of 40000000 steps (4%).
03:27:30:WU00:FS00:0x15:Completed   2000000 out of 40000000 steps (5%).
03:34:35:WU00:FS00:0x15:Completed   2400000 out of 40000000 steps (6%).
03:41:40:WU00:FS00:0x15:Completed   2800000 out of 40000000 steps (7%).
03:48:45:WU00:FS00:0x15:Completed   3200000 out of 40000000 steps (8%).
03:55:50:WU00:FS00:0x15:Completed   3600000 out of 40000000 steps (9%).
04:02:55:WU00:FS00:0x15:Completed   4000000 out of 40000000 steps (10%).
04:10:00:WU00:FS00:0x15:Completed   4400000 out of 40000000 steps (11%).
04:17:04:WU00:FS00:0x15:Completed   4800000 out of 40000000 steps (12%).
04:24:09:WU00:FS00:0x15:Completed   5200000 out of 40000000 steps (13%).
04:31:14:WU00:FS00:0x15:Completed   5600000 out of 40000000 steps (14%).
04:38:19:WU00:FS00:0x15:Completed   6000000 out of 40000000 steps (15%).
04:45:24:WU00:FS00:0x15:Completed   6400000 out of 40000000 steps (16%).
04:52:29:WU00:FS00:0x15:Completed   6800000 out of 40000000 steps (17%).
04:59:34:WU00:FS00:0x15:Completed   7200000 out of 40000000 steps (18%).
05:06:39:WU00:FS00:0x15:Completed   7600000 out of 40000000 steps (19%).
05:13:43:WU00:FS00:0x15:Completed   8000000 out of 40000000 steps (20%).
05:20:48:WU00:FS00:0x15:Completed   8400000 out of 40000000 steps (21%).
05:27:53:WU00:FS00:0x15:Completed   8800000 out of 40000000 steps (22%).
05:34:58:WU00:FS00:0x15:Completed   9200000 out of 40000000 steps (23%).
05:42:03:WU00:FS00:0x15:Completed   9600000 out of 40000000 steps (24%).
05:49:08:WU00:FS00:0x15:Completed  10000000 out of 40000000 steps (25%).
05:56:13:WU00:FS00:0x15:Completed  10400000 out of 40000000 steps (26%).
06:03:18:WU00:FS00:0x15:Completed  10800000 out of 40000000 steps (27%).
06:10:22:WU00:FS00:0x15:Completed  11200000 out of 40000000 steps (28%).
06:17:27:WU00:FS00:0x15:Completed  11600000 out of 40000000 steps (29%).
06:24:32:WU00:FS00:0x15:Completed  12000000 out of 40000000 steps (30%).
06:31:37:WU00:FS00:0x15:Completed  12400000 out of 40000000 steps (31%).
06:38:42:WU00:FS00:0x15:Completed  12800000 out of 40000000 steps (32%).
06:45:47:WU00:FS00:0x15:Completed  13200000 out of 40000000 steps (33%).
06:52:52:WU00:FS00:0x15:Completed  13600000 out of 40000000 steps (34%).
06:59:57:WU00:FS00:0x15:Completed  14000000 out of 40000000 steps (35%).
07:07:02:WU00:FS00:0x15:Completed  14400000 out of 40000000 steps (36%).
07:14:08:WU00:FS00:0x15:Completed  14800000 out of 40000000 steps (37%).
07:21:13:WU00:FS00:0x15:Completed  15200000 out of 40000000 steps (38%).
07:28:18:WU00:FS00:0x15:Completed  15600000 out of 40000000 steps (39%).
07:35:23:WU00:FS00:0x15:Completed  16000000 out of 40000000 steps (40%).
07:42:28:WU00:FS00:0x15:Completed  16400000 out of 40000000 steps (41%).
07:49:33:WU00:FS00:0x15:Completed  16800000 out of 40000000 steps (42%).
******************************* Date: 2014-10-04 *******************************
07:56:39:WU00:FS00:0x15:Completed  17200000 out of 40000000 steps (43%).
08:03:44:WU00:FS00:0x15:Completed  17600000 out of 40000000 steps (44%).
08:10:49:WU00:FS00:0x15:Completed  18000000 out of 40000000 steps (45%).
08:17:54:WU00:FS00:0x15:Completed  18400000 out of 40000000 steps (46%).
08:24:59:WU00:FS00:0x15:Completed  18800000 out of 40000000 steps (47%).
08:32:04:WU00:FS00:0x15:Completed  19200000 out of 40000000 steps (48%).
08:39:09:WU00:FS00:0x15:Completed  19600000 out of 40000000 steps (49%).
08:46:14:WU00:FS00:0x15:Completed  20000000 out of 40000000 steps (50%).
08:53:19:WU00:FS00:0x15:Completed  20400000 out of 40000000 steps (51%).
09:00:24:WU00:FS00:0x15:Completed  20800000 out of 40000000 steps (52%).
09:07:30:WU00:FS00:0x15:Completed  21200000 out of 40000000 steps (53%).
09:14:35:WU00:FS00:0x15:Completed  21600000 out of 40000000 steps (54%).
09:21:40:WU00:FS00:0x15:Completed  22000000 out of 40000000 steps (55%).
09:28:45:WU00:FS00:0x15:Completed  22400000 out of 40000000 steps (56%).
09:35:50:WU00:FS00:0x15:Completed  22800000 out of 40000000 steps (57%).
09:42:55:WU00:FS00:0x15:Completed  23200000 out of 40000000 steps (58%).
09:50:00:WU00:FS00:0x15:Completed  23600000 out of 40000000 steps (59%).
09:57:05:WU00:FS00:0x15:Completed  24000000 out of 40000000 steps (60%).
10:04:10:WU00:FS00:0x15:Completed  24400000 out of 40000000 steps (61%).
10:11:15:WU00:FS00:0x15:Completed  24800000 out of 40000000 steps (62%).
10:18:20:WU00:FS00:0x15:Completed  25200000 out of 40000000 steps (63%).
10:25:25:WU00:FS00:0x15:Completed  25600000 out of 40000000 steps (64%).
10:32:30:WU00:FS00:0x15:Completed  26000000 out of 40000000 steps (65%).
10:39:35:WU00:FS00:0x15:Completed  26400000 out of 40000000 steps (66%).
10:46:40:WU00:FS00:0x15:Completed  26800000 out of 40000000 steps (67%).
10:53:45:WU00:FS00:0x15:Completed  27200000 out of 40000000 steps (68%).
11:00:50:WU00:FS00:0x15:Completed  27600000 out of 40000000 steps (69%).
11:07:55:WU00:FS00:0x15:Completed  28000000 out of 40000000 steps (70%).
11:15:00:WU00:FS00:0x15:Completed  28400000 out of 40000000 steps (71%).
11:22:05:WU00:FS00:0x15:Completed  28800000 out of 40000000 steps (72%).
11:29:10:WU00:FS00:0x15:Completed  29200000 out of 40000000 steps (73%).
11:36:14:WU00:FS00:0x15:Completed  29600000 out of 40000000 steps (74%).
11:43:19:WU00:FS00:0x15:Completed  30000000 out of 40000000 steps (75%).
11:50:24:WU00:FS00:0x15:Completed  30400000 out of 40000000 steps (76%).
11:57:29:WU00:FS00:0x15:Completed  30800000 out of 40000000 steps (77%).
12:04:34:WU00:FS00:0x15:Completed  31200000 out of 40000000 steps (78%).
12:11:39:WU00:FS00:0x15:Completed  31600000 out of 40000000 steps (79%).
12:18:44:WU00:FS00:0x15:Completed  32000000 out of 40000000 steps (80%).
12:25:49:WU00:FS00:0x15:Completed  32400000 out of 40000000 steps (81%).
12:32:54:WU00:FS00:0x15:Completed  32800000 out of 40000000 steps (82%).
12:39:59:WU00:FS00:0x15:Completed  33200000 out of 40000000 steps (83%).
12:47:04:WU00:FS00:0x15:Completed  33600000 out of 40000000 steps (84%).
12:54:09:WU00:FS00:0x15:Completed  34000000 out of 40000000 steps (85%).
13:01:14:WU00:FS00:0x15:Completed  34400000 out of 40000000 steps (86%).
13:08:19:WU00:FS00:0x15:Completed  34800000 out of 40000000 steps (87%).
13:15:24:WU00:FS00:0x15:Completed  35200000 out of 40000000 steps (88%).
13:22:29:WU00:FS00:0x15:Completed  35600000 out of 40000000 steps (89%).
13:29:34:WU00:FS00:0x15:Completed  36000000 out of 40000000 steps (90%).
13:36:39:WU00:FS00:0x15:Completed  36400000 out of 40000000 steps (91%).
13:43:44:WU00:FS00:0x15:Completed  36800000 out of 40000000 steps (92%).
13:50:49:WU00:FS00:0x15:Completed  37200000 out of 40000000 steps (93%).
******************************* Date: 2014-10-04 *******************************
13:57:54:WU00:FS00:0x15:Completed  37600000 out of 40000000 steps (94%).
14:05:00:WU00:FS00:0x15:Completed  38000000 out of 40000000 steps (95%).
14:12:06:WU00:FS00:0x15:Completed  38400000 out of 40000000 steps (96%).
14:19:15:WU00:FS00:0x15:Completed  38800000 out of 40000000 steps (97%).
14:26:24:WU00:FS00:0x15:Completed  39200000 out of 40000000 steps (98%).
14:26:24:WU01:FS00:Connecting to assign-GPU.stanford.edu:80
14:26:25:WU01:FS00:News: 
14:26:25:WU01:FS00:Assigned to work server 171.64.65.56
14:26:25:WU01:FS00:Requesting new work unit for slot 00: RUNNING gpu:0:GM107 [GeForce GTX 750 Ti] from 171.64.65.56
14:26:25:WU01:FS00:Connecting to 171.64.65.56:8080
14:26:26:WU01:FS00:Downloading 4.84MiB
14:26:31:WU01:FS00:Download complete
14:26:31:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9406 run:542 clone:0 gen:148 core:0x17 unit:0x000000f10a3b1e5c533e2cf18ce124b5
14:33:32:WU00:FS00:0x15:Completed  39600000 out of 40000000 steps (99%).
14:40:43:WU00:FS00:0x15:Completed  40000000 out of 40000000 steps (100%).
14:40:45:WU00:FS00:0x15:Finished fah_main status=0
14:40:45:WU00:FS00:0x15:Successful run
14:40:45:WU00:FS00:0x15:DynamicWrapper: Finished Work Unit: sleep=10000
14:40:55:WU00:FS00:0x15:Reserved 760116 bytes for xtc file; Cosm status=0
14:40:55:WU00:FS00:0x15:Allocated 760116 bytes for xtc file
14:40:55:WU00:FS00:0x15:- Reading up to 760116 from "00/wudata_01.xtc": Read 760116
14:40:55:WU00:FS00:0x15:Read 760116 bytes from xtc file; available packet space=785670348
14:40:55:WU00:FS00:0x15:xtc file hash check passed.
14:40:55:WU00:FS00:0x15:Reserved 47688 47688 785670348 bytes for arc file=<00/wudata_01.trr> Cosm status=0
14:40:55:WU00:FS00:0x15:Allocated 47688 bytes for arc file
14:40:55:WU00:FS00:0x15:- Reading up to 47688 from "00/wudata_01.trr": Read 47688
14:40:55:WU00:FS00:0x15:Read 47688 bytes from arc file; available packet space=785622660
14:40:55:WU00:FS00:0x15:trr file hash check passed.
14:40:55:WU00:FS00:0x15:Allocated 544 bytes for edr file
14:40:55:WU00:FS00:0x15:Read bedfile
14:40:55:WU00:FS00:0x15:edr file hash check passed.
14:40:55:WU00:FS00:0x15:Allocated 36748 bytes for logfile
14:40:55:WU00:FS00:0x15:Read logfile
14:40:55:WU00:FS00:0x15:GuardedRun: success in DynamicWrapper
14:40:55:WU00:FS00:0x15:GuardedRun: done
14:40:55:WU00:FS00:0x15:Run: GuardedRun completed.
14:40:58:WU00:FS00:0x15:+ Opened results file
14:40:58:WU00:FS00:0x15:- Writing 845608 bytes of core data to disk...
14:40:59:WU00:FS00:0x15:Done: 845096 -> 816977 (compressed to 96.6 percent)
14:40:59:WU00:FS00:0x15:  ... Done.
14:40:59:WU00:FS00:0x15:DeleteFrameFiles: successfully deleted file=00/wudata_01.ckp
14:40:59:WU00:FS00:0x15:Shutting down core 
14:40:59:WU00:FS00:0x15:
14:40:59:WU00:FS00:0x15:Folding@home Core Shutdown: FINISHED_UNIT
14:41:00:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
14:41:00:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:7621 run:734 clone:0 gen:152 core:0x15 unit:0x000000b5664f2dd14e4308db3a58fbe1
14:41:00:WU00:FS00:Uploading 798.33KiB to 171.64.65.105
14:41:00:WU01:FS00:Starting
14:41:00:WU00:FS00:Connecting to 171.64.65.105:8080
14:41:00:WU01:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 703 -lifeline 2912 -checkpoint 30 -gpu 0 -gpu-vendor nvidia
14:41:00:WU01:FS00:Started FahCore on PID 3960
14:41:03:WU01:FS00:Core PID:3104
14:41:03:WU01:FS00:FahCore 0x17 started
14:41:04:WU01:FS00:0x17:*********************** Log Started 2014-10-04T14:41:04Z ***********************
14:41:04:WU01:FS00:0x17:Project: 9406 (Run 542, Clone 0, Gen 148)
14:41:04:WU01:FS00:0x17:Unit: 0x000000f10a3b1e5c533e2cf18ce124b5
14:41:04:WU01:FS00:0x17:CPU: 0x00000000000000000000000000000000
14:41:04:WU01:FS00:0x17:Machine: 0
14:41:04:WU01:FS00:0x17:Reading tar file state.xml
14:41:05:WU01:FS00:0x17:Reading tar file system.xml
14:41:06:WU01:FS00:0x17:Reading tar file integrator.xml
14:41:06:WU01:FS00:0x17:Reading tar file core.xml
14:41:06:WU01:FS00:0x17:Digital signatures verified
14:41:06:WU01:FS00:0x17:Folding@home GPU core17
14:41:06:WU01:FS00:0x17:Version 0.0.52
14:41:06:WU00:FS00:Upload 72.15%
14:41:09:WU00:FS00:Upload complete
14:41:09:WU00:FS00:Server responded WORK_ACK (400)
14:41:09:WU00:FS00:Final credit estimate, 14093.00 points
14:41:10:WU00:FS00:Cleaning up
14:46:47:WU01:FS00:0x17:ERROR:exception: Force RMSE error of 452.867 with threshold of 5
14:46:47:WU01:FS00:0x17:Saving result file logfile_01.txt
14:46:47:WU01:FS00:0x17:Saving result file log.txt
14:46:47:WU01:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
14:46:47:WARNING:WU01:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
14:46:47:WU01:FS00:Sending unit results: id:01 state:SEND error:FAULTY project:9406 run:542 clone:0 gen:148 core:0x17 unit:0x000000f10a3b1e5c533e2cf18ce124b5
14:46:47:WU01:FS00:Uploading 2.25KiB to 171.64.65.56
14:46:47:WU01:FS00:Connecting to 171.64.65.56:8080
14:46:47:WU01:FS00:Upload complete
14:46:48:WU01:FS00:Server responded WORK_ACK (400)
14:46:48:WU01:FS00:Cleaning up
14:46:48:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
14:46:48:WU00:FS00:News: 
14:46:48:WU00:FS00:Assigned to work server 171.64.65.105
14:46:48:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 171.64.65.105
14:46:48:WU00:FS00:Connecting to 171.64.65.105:8080
14:46:49:WU00:FS00:Downloading 122.00KiB
14:46:49:WU00:FS00:Download complete
14:46:49:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:7623 run:579 clone:3 gen:35 core:0x15 unit:0x00000032664f2dd14fe4fbb2508c244f
14:46:49:WU00:FS00:Starting
14:46:49:WU00:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 00 -suffix 01 -version 703 -lifeline 2912 -checkpoint 30 -gpu 0 -gpu-vendor nvidia
14:46:49:WU00:FS00:Started FahCore on PID 6108
14:46:50:WU00:FS00:Core PID:1404
14:46:50:WU00:FS00:FahCore 0x15 started
14:46:50:WU00:FS00:0x15:
14:46:50:WU00:FS00:0x15:*------------------------------*
14:46:50:WU00:FS00:0x15:Folding@Home GPU Core
14:46:50:WU00:FS00:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
14:46:50:WU00:FS00:0x15:Build host             AmoebaRemote
14:46:50:WU00:FS00:0x15:Board Type             NVIDIA/CUDA
14:46:50:WU00:FS00:0x15:Core                   15
14:46:50:WU00:FS00:0x15:
14:46:50:WU00:FS00:0x15:Window's signal control handler registered.
14:46:50:WU00:FS00:0x15:Preparing to commence simulation
14:46:50:WU00:FS00:0x15:- Looking at optimizations...
14:46:50:WU00:FS00:0x15:DeleteFrameFiles: successfully deleted file=00/wudata_01.ckp
14:46:50:WU00:FS00:0x15:- Created dyn
14:46:50:WU00:FS00:0x15:- Files status OK
14:46:50:WU00:FS00:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
14:46:50:WU00:FS00:0x15:- Expanded 124417 -> 501826 (decompressed 403.3 percent)
14:46:50:WU00:FS00:0x15:Called DecompressByteArray: compressed_data_size=124417 data_size=501826, decompressed_data_size=501826 diff=0
14:46:50:WU00:FS00:0x15:- Digital signature verified
14:46:50:WU00:FS00:0x15:
14:46:50:WU00:FS00:0x15:Project: 7623 (Run 579, Clone 3, Gen 35)
14:46:50:WU00:FS00:0x15:
14:46:50:WU00:FS00:0x15:Assembly optimizations on if available.
14:46:50:WU00:FS00:0x15:Entering M.D.
14:46:52:WU00:FS00:0x15:Tpr hash 00/wudata_01.tpr:  3259905943 3099031630 3644904764 2012330934 2150208595
14:46:52:WU00:FS00:0x15:GPU device id=0
14:46:52:WU00:FS00:0x15:Working on Protein
14:46:52:WU00:FS00:0x15:Client config unavailable.
14:46:52:WU00:FS00:0x15:Starting GUI Server
14:48:03:WU00:FS00:0x15:Setting checkpoint frequency: 400000
14:48:03:WU00:FS00:0x15:Completed         3 out of 40000000 steps (0%).
14:55:14:WU00:FS00:0x15:Completed    400000 out of 40000000 steps (1%).
15:02:24:WU00:FS00:0x15:Completed    800000 out of 40000000 steps (2%).
15:09:34:WU00:FS00:0x15:Completed   1200000 out of 40000000 steps (3%).
15:16:40:WU00:FS00:0x15:Completed   1600000 out of 40000000 steps (4%).
15:23:45:WU00:FS00:0x15:Completed   2000000 out of 40000000 steps (5%).
15:30:51:WU00:FS00:0x15:Completed   2400000 out of 40000000 steps (6%).
15:39:08:WU00:FS00:0x15:Completed   2800000 out of 40000000 steps (7%).
15:47:11:WU00:FS00:0x15:Completed   3200000 out of 40000000 steps (8%).
15:54:21:WU00:FS00:0x15:Completed   3600000 out of 40000000 steps (9%).
16:01:35:WU00:FS00:0x15:Completed   4000000 out of 40000000 steps (10%).
16:08:45:WU00:FS00:0x15:Completed   4400000 out of 40000000 steps (11%).
16:15:56:WU00:FS00:0x15:Completed   4800000 out of 40000000 steps (12%).
16:23:06:WU00:FS00:0x15:Completed   5200000 out of 40000000 steps (13%).
16:30:13:WU00:FS00:0x15:Completed   5600000 out of 40000000 steps (14%).
16:37:19:WU00:FS00:0x15:Completed   6000000 out of 40000000 steps (15%).
16:44:26:WU00:FS00:0x15:Completed   6400000 out of 40000000 steps (16%).
16:51:34:WU00:FS00:0x15:Completed   6800000 out of 40000000 steps (17%).
16:58:51:WU00:FS00:0x15:Completed   7200000 out of 40000000 steps (18%).
17:05:58:WU00:FS00:0x15:Completed   7600000 out of 40000000 steps (19%).
17:13:08:WU00:FS00:0x15:Completed   8000000 out of 40000000 steps (20%).
17:20:20:WU00:FS00:0x15:Completed   8400000 out of 40000000 steps (21%).
17:27:34:WU00:FS00:0x15:Completed   8800000 out of 40000000 steps (22%).
17:34:45:WU00:FS00:0x15:Completed   9200000 out of 40000000 steps (23%).
17:41:54:WU00:FS00:0x15:Completed   9600000 out of 40000000 steps (24%).
17:49:04:WU00:FS00:0x15:Completed  10000000 out of 40000000 steps (25%).
17:56:10:WU00:FS00:0x15:Completed  10400000 out of 40000000 steps (26%).
18:03:16:WU00:FS00:0x15:Completed  10800000 out of 40000000 steps (27%).
18:10:21:WU00:FS00:0x15:Completed  11200000 out of 40000000 steps (28%).
18:17:27:WU00:FS00:0x15:Completed  11600000 out of 40000000 steps (29%).
18:24:32:WU00:FS00:0x15:Completed  12000000 out of 40000000 steps (30%).
18:31:38:WU00:FS00:0x15:Completed  12400000 out of 40000000 steps (31%).
18:38:43:WU00:FS00:0x15:Completed  12800000 out of 40000000 steps (32%).
18:45:48:WU00:FS00:0x15:Completed  13200000 out of 40000000 steps (33%).
18:52:54:WU00:FS00:0x15:Completed  13600000 out of 40000000 steps (34%).
18:59:59:WU00:FS00:0x15:Completed  14000000 out of 40000000 steps (35%).
19:07:05:WU00:FS00:0x15:Completed  14400000 out of 40000000 steps (36%).
19:14:10:WU00:FS00:0x15:Completed  14800000 out of 40000000 steps (37%).
19:21:16:WU00:FS00:0x15:Completed  15200000 out of 40000000 steps (38%).
19:28:21:WU00:FS00:0x15:Completed  15600000 out of 40000000 steps (39%).
19:35:27:WU00:FS00:0x15:Completed  16000000 out of 40000000 steps (40%).
19:42:32:WU00:FS00:0x15:Completed  16400000 out of 40000000 steps (41%).
19:49:38:WU00:FS00:0x15:Completed  16800000 out of 40000000 steps (42%).
19:56:43:WU00:FS00:0x15:Completed  17200000 out of 40000000 steps (43%).
******************************* Date: 2014-10-04 *******************************
20:03:49:WU00:FS00:0x15:Completed  17600000 out of 40000000 steps (44%).
20:10:54:WU00:FS00:0x15:Completed  18000000 out of 40000000 steps (45%).
20:18:00:WU00:FS00:0x15:Completed  18400000 out of 40000000 steps (46%).
20:25:05:WU00:FS00:0x15:Completed  18800000 out of 40000000 steps (47%).
20:32:11:WU00:FS00:0x15:Completed  19200000 out of 40000000 steps (48%).
20:39:16:WU00:FS00:0x15:Completed  19600000 out of 40000000 steps (49%).
20:46:22:WU00:FS00:0x15:Completed  20000000 out of 40000000 steps (50%).
20:53:27:WU00:FS00:0x15:Completed  20400000 out of 40000000 steps (51%).
21:00:33:WU00:FS00:0x15:Completed  20800000 out of 40000000 steps (52%).
21:07:38:WU00:FS00:0x15:Completed  21200000 out of 40000000 steps (53%).
21:14:44:WU00:FS00:0x15:Completed  21600000 out of 40000000 steps (54%).
21:21:49:WU00:FS00:0x15:Completed  22000000 out of 40000000 steps (55%).
21:28:55:WU00:FS00:0x15:Completed  22400000 out of 40000000 steps (56%).
21:36:00:WU00:FS00:0x15:Completed  22800000 out of 40000000 steps (57%).
21:43:05:WU00:FS00:0x15:Completed  23200000 out of 40000000 steps (58%).
21:50:11:WU00:FS00:0x15:Completed  23600000 out of 40000000 steps (59%).
21:57:16:WU00:FS00:0x15:Completed  24000000 out of 40000000 steps (60%).
22:04:22:WU00:FS00:0x15:Completed  24400000 out of 40000000 steps (61%).
22:11:28:WU00:FS00:0x15:Completed  24800000 out of 40000000 steps (62%).
22:18:33:WU00:FS00:0x15:Completed  25200000 out of 40000000 steps (63%).
22:25:39:WU00:FS00:0x15:Completed  25600000 out of 40000000 steps (64%).
22:32:44:WU00:FS00:0x15:Completed  26000000 out of 40000000 steps (65%).
22:39:50:WU00:FS00:0x15:Completed  26400000 out of 40000000 steps (66%).
22:46:55:WU00:FS00:0x15:Completed  26800000 out of 40000000 steps (67%).
22:54:01:WU00:FS00:0x15:Completed  27200000 out of 40000000 steps (68%).
23:01:11:WU00:FS00:0x15:Completed  27600000 out of 40000000 steps (69%).
23:08:24:WU00:FS00:0x15:Completed  28000000 out of 40000000 steps (70%).
23:15:38:WU00:FS00:0x15:Completed  28400000 out of 40000000 steps (71%).
23:22:44:WU00:FS00:0x15:Completed  28800000 out of 40000000 steps (72%).
23:29:49:WU00:FS00:0x15:Completed  29200000 out of 40000000 steps (73%).
23:36:55:WU00:FS00:0x15:Completed  29600000 out of 40000000 steps (74%).
23:44:00:WU00:FS00:0x15:Completed  30000000 out of 40000000 steps (75%).
23:51:06:WU00:FS00:0x15:Completed  30400000 out of 40000000 steps (76%).
23:58:11:WU00:FS00:0x15:Completed  30800000 out of 40000000 steps (77%).
00:05:16:WU00:FS00:0x15:Completed  31200000 out of 40000000 steps (78%).
00:12:22:WU00:FS00:0x15:Completed  31600000 out of 40000000 steps (79%).
00:19:27:WU00:FS00:0x15:Completed  32000000 out of 40000000 steps (80%).
00:26:33:WU00:FS00:0x15:Completed  32400000 out of 40000000 steps (81%).
00:33:38:WU00:FS00:0x15:Completed  32800000 out of 40000000 steps (82%).
00:40:44:WU00:FS00:0x15:Completed  33200000 out of 40000000 steps (83%).
00:47:49:WU00:FS00:0x15:Completed  33600000 out of 40000000 steps (84%).
00:54:54:WU00:FS00:0x15:Completed  34000000 out of 40000000 steps (85%).
01:02:00:WU00:FS00:0x15:Completed  34400000 out of 40000000 steps (86%).
01:09:05:WU00:FS00:0x15:Completed  34800000 out of 40000000 steps (87%).
01:16:11:WU00:FS00:0x15:Completed  35200000 out of 40000000 steps (88%).
01:23:16:WU00:FS00:0x15:Completed  35600000 out of 40000000 steps (89%).
01:30:22:WU00:FS00:0x15:Completed  36000000 out of 40000000 steps (90%).
01:37:27:WU00:FS00:0x15:Completed  36400000 out of 40000000 steps (91%).
01:44:33:WU00:FS00:0x15:Completed  36800000 out of 40000000 steps (92%).
01:51:38:WU00:FS00:0x15:Completed  37200000 out of 40000000 steps (93%).
01:58:44:WU00:FS00:0x15:Completed  37600000 out of 40000000 steps (94%).
******************************* Date: 2014-10-05 *******************************
02:05:49:WU00:FS00:0x15:Completed  38000000 out of 40000000 steps (95%).
02:12:54:WU00:FS00:0x15:Completed  38400000 out of 40000000 steps (96%).
02:20:00:WU00:FS00:0x15:Completed  38800000 out of 40000000 steps (97%).
02:27:05:WU00:FS00:0x15:Completed  39200000 out of 40000000 steps (98%).
02:27:06:WU01:FS00:Connecting to assign-GPU.stanford.edu:80
02:27:07:WU01:FS00:News: 
02:27:07:WU01:FS00:Assigned to work server 171.64.65.56
02:27:07:WU01:FS00:Requesting new work unit for slot 00: RUNNING gpu:0:GM107 [GeForce GTX 750 Ti] from 171.64.65.56
02:27:07:WU01:FS00:Connecting to 171.64.65.56:8080
02:27:08:WU01:FS00:Downloading 4.98MiB
02:27:14:WU01:FS00:Download 100.00%
02:27:14:WU01:FS00:Download complete
02:27:14:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9406 run:829 clone:2 gen:8 core:0x17 unit:0x0000000c0a3b1e5c533e7f1ebc2e245c
02:34:11:WU00:FS00:0x15:Completed  39600000 out of 40000000 steps (99%).
02:41:16:WU00:FS00:0x15:Completed  40000000 out of 40000000 steps (100%).
02:41:17:WU00:FS00:0x15:Finished fah_main status=0
02:41:17:WU00:FS00:0x15:Successful run
02:41:17:WU00:FS00:0x15:DynamicWrapper: Finished Work Unit: sleep=10000
02:41:27:WU00:FS00:0x15:Reserved 761520 bytes for xtc file; Cosm status=0
02:41:27:WU00:FS00:0x15:Allocated 761520 bytes for xtc file
02:41:27:WU00:FS00:0x15:- Reading up to 761520 from "00/wudata_01.xtc": Read 761520
02:41:27:WU00:FS00:0x15:Read 761520 bytes from xtc file; available packet space=785668944
02:41:27:WU00:FS00:0x15:xtc file hash check passed.
02:41:27:WU00:FS00:0x15:Reserved 47688 47688 785668944 bytes for arc file=<00/wudata_01.trr> Cosm status=0
02:41:27:WU00:FS00:0x15:Allocated 47688 bytes for arc file
02:41:27:WU00:FS00:0x15:- Reading up to 47688 from "00/wudata_01.trr": Read 47688
02:41:27:WU00:FS00:0x15:Read 47688 bytes from arc file; available packet space=785621256
02:41:27:WU00:FS00:0x15:trr file hash check passed.
02:41:27:WU00:FS00:0x15:Allocated 544 bytes for edr file
02:41:27:WU00:FS00:0x15:Read bedfile
02:41:27:WU00:FS00:0x15:edr file hash check passed.
02:41:27:WU00:FS00:0x15:Allocated 36749 bytes for logfile
02:41:27:WU00:FS00:0x15:Read logfile
02:41:27:WU00:FS00:0x15:GuardedRun: success in DynamicWrapper
02:41:27:WU00:FS00:0x15:GuardedRun: done
02:41:27:WU00:FS00:0x15:Run: GuardedRun completed.
02:41:31:WU00:FS00:0x15:+ Opened results file
02:41:31:WU00:FS00:0x15:- Writing 847013 bytes of core data to disk...
02:41:32:WU00:FS00:0x15:Done: 846501 -> 818380 (compressed to 96.6 percent)
02:41:32:WU00:FS00:0x15:  ... Done.
02:41:32:WU00:FS00:0x15:DeleteFrameFiles: successfully deleted file=00/wudata_01.ckp
02:41:32:WU00:FS00:0x15:Shutting down core 
02:41:32:WU00:FS00:0x15:
02:41:32:WU00:FS00:0x15:Folding@home Core Shutdown: FINISHED_UNIT
02:41:32:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
02:41:32:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:7623 run:579 clone:3 gen:35 core:0x15 unit:0x00000032664f2dd14fe4fbb2508c244f
02:41:32:WU00:FS00:Uploading 799.70KiB to 171.64.65.105
02:41:32:WU00:FS00:Connecting to 171.64.65.105:8080
02:41:32:WU01:FS00:Starting
02:41:32:WU01:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 703 -lifeline 2912 -checkpoint 30 -gpu 0 -gpu-vendor nvidia
02:41:32:WU01:FS00:Started FahCore on PID 6076
02:41:32:WU01:FS00:Core PID:1960
02:41:32:WU01:FS00:FahCore 0x17 started
02:41:33:WU01:FS00:0x17:*********************** Log Started 2014-10-05T02:41:33Z ***********************
02:41:33:WU01:FS00:0x17:Project: 9406 (Run 829, Clone 2, Gen 8)
02:41:33:WU01:FS00:0x17:Unit: 0x0000000c0a3b1e5c533e7f1ebc2e245c
02:41:33:WU01:FS00:0x17:CPU: 0x00000000000000000000000000000000
02:41:33:WU01:FS00:0x17:Machine: 0
02:41:33:WU01:FS00:0x17:Reading tar file state.xml
02:41:34:WU01:FS00:0x17:Reading tar file system.xml
02:41:35:WU01:FS00:0x17:Reading tar file integrator.xml
02:41:35:WU01:FS00:0x17:Reading tar file core.xml
02:41:35:WU01:FS00:0x17:Digital signatures verified
02:41:35:WU01:FS00:0x17:Folding@home GPU core17
02:41:35:WU01:FS00:0x17:Version 0.0.52
02:41:38:WU00:FS00:Upload 80.03%
02:41:41:WU00:FS00:Upload complete
02:41:41:WU00:FS00:Server responded WORK_ACK (400)
02:41:41:WU00:FS00:Final credit estimate, 14093.00 points
02:41:41:WU00:FS00:Cleaning up
02:47:23:WU01:FS00:0x17:ERROR:exception: Force RMSE error of 613.371 with threshold of 5
02:47:23:WU01:FS00:0x17:Saving result file logfile_01.txt
02:47:23:WU01:FS00:0x17:Saving result file log.txt
02:47:23:WU01:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
02:47:24:WARNING:WU01:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
02:47:24:WU01:FS00:Sending unit results: id:01 state:SEND error:FAULTY project:9406 run:829 clone:2 gen:8 core:0x17 unit:0x0000000c0a3b1e5c533e7f1ebc2e245c
02:47:24:WU01:FS00:Uploading 2.25KiB to 171.64.65.56
02:47:24:WU01:FS00:Connecting to 171.64.65.56:8080
02:47:24:WU01:FS00:Upload complete
02:47:24:WU01:FS00:Server responded WORK_ACK (400)
02:47:24:WU01:FS00:Cleaning up
02:47:24:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
02:47:25:WU00:FS00:News: 
02:47:25:WU00:FS00:Assigned to work server 171.64.65.56
02:47:25:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 171.64.65.56
02:47:25:WU00:FS00:Connecting to 171.64.65.56:8080
02:47:26:WU00:FS00:Downloading 4.96MiB
02:47:32:WU00:FS00:Download 100.00%
02:47:32:WU00:FS00:Download complete
02:47:32:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9406 run:656 clone:0 gen:73 core:0x17 unit:0x000000830a3b1e5c533e42b3ad98fa0b
02:47:32:WU00:FS00:Starting
02:47:32:WU00:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 703 -lifeline 2912 -checkpoint 30 -gpu 0 -gpu-vendor nvidia
02:47:32:WU00:FS00:Started FahCore on PID 4948
02:47:32:WU00:FS00:Core PID:4848
02:47:32:WU00:FS00:FahCore 0x17 started
02:47:33:WU00:FS00:0x17:*********************** Log Started 2014-10-05T02:47:33Z ***********************
02:47:33:WU00:FS00:0x17:Project: 9406 (Run 656, Clone 0, Gen 73)
02:47:33:WU00:FS00:0x17:Unit: 0x000000830a3b1e5c533e42b3ad98fa0b
02:47:33:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
02:47:33:WU00:FS00:0x17:Machine: 0
02:47:33:WU00:FS00:0x17:Reading tar file state.xml
02:47:34:WU00:FS00:0x17:Reading tar file system.xml
02:47:35:WU00:FS00:0x17:Reading tar file integrator.xml
02:47:35:WU00:FS00:0x17:Reading tar file core.xml
02:47:35:WU00:FS00:0x17:Digital signatures verified
02:47:35:WU00:FS00:0x17:Folding@home GPU core17
02:47:35:WU00:FS00:0x17:Version 0.0.52
02:53:06:WU00:FS00:0x17:ERROR:exception: Force RMSE error of 633.245 with threshold of 5
02:53:06:WU00:FS00:0x17:Saving result file logfile_01.txt
02:53:06:WU00:FS00:0x17:Saving result file log.txt
02:53:06:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
02:53:06:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
02:53:06:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:9406 run:656 clone:0 gen:73 core:0x17 unit:0x000000830a3b1e5c533e42b3ad98fa0b
02:53:06:WU00:FS00:Uploading 2.24KiB to 171.64.65.56
02:53:06:WU00:FS00:Connecting to 171.64.65.56:8080
02:53:07:WU00:FS00:Upload complete
02:53:07:WU00:FS00:Server responded WORK_ACK (400)
02:53:07:WU00:FS00:Cleaning up
02:53:07:WU01:FS00:Connecting to assign-GPU.stanford.edu:80
02:53:07:WU01:FS00:News: 
02:53:07:WU01:FS00:Assigned to work server 171.64.65.56
02:53:07:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 171.64.65.56
02:53:07:WU01:FS00:Connecting to 171.64.65.56:8080
02:53:09:WU01:FS00:Downloading 5.06MiB
02:53:15:WU01:FS00:Download 84.06%
02:53:16:WU01:FS00:Download complete
02:53:16:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9406 run:776 clone:3 gen:7 core:0x17 unit:0x000000090a3b1e5c533e5a67951147fd
02:53:17:WU01:FS00:Starting
02:53:17:WU01:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 703 -lifeline 2912 -checkpoint 30 -gpu 0 -gpu-vendor nvidia
02:53:17:WU01:FS00:Started FahCore on PID 4280
02:53:17:WU01:FS00:Core PID:5288
02:53:17:WU01:FS00:FahCore 0x17 started
02:53:18:WU01:FS00:0x17:*********************** Log Started 2014-10-05T02:53:17Z ***********************
02:53:18:WU01:FS00:0x17:Project: 9406 (Run 776, Clone 3, Gen 7)
02:53:18:WU01:FS00:0x17:Unit: 0x000000090a3b1e5c533e5a67951147fd
02:53:18:WU01:FS00:0x17:CPU: 0x00000000000000000000000000000000
02:53:18:WU01:FS00:0x17:Machine: 0
02:53:18:WU01:FS00:0x17:Reading tar file state.xml
02:53:18:WU01:FS00:0x17:Reading tar file system.xml
02:53:19:WU01:FS00:0x17:Reading tar file integrator.xml
02:53:19:WU01:FS00:0x17:Reading tar file core.xml
02:53:19:WU01:FS00:0x17:Digital signatures verified
02:53:19:WU01:FS00:0x17:Folding@home GPU core17
02:53:19:WU01:FS00:0x17:Version 0.0.52
02:59:04:WU01:FS00:0x17:ERROR:exception: Force RMSE error of 634.636 with threshold of 5
02:59:04:WU01:FS00:0x17:Saving result file logfile_01.txt
02:59:04:WU01:FS00:0x17:Saving result file log.txt
02:59:04:WU01:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
02:59:05:WARNING:WU01:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
02:59:05:WU01:FS00:Sending unit results: id:01 state:SEND error:FAULTY project:9406 run:776 clone:3 gen:7 core:0x17 unit:0x000000090a3b1e5c533e5a67951147fd
02:59:05:WU01:FS00:Uploading 2.25KiB to 171.64.65.56
02:59:05:WU01:FS00:Connecting to 171.64.65.56:8080
02:59:05:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
02:59:05:WU01:FS00:Upload complete
02:59:05:WU01:FS00:Server responded WORK_ACK (400)
02:59:05:WU01:FS00:Cleaning up
02:59:06:WU00:FS00:News: 
02:59:06:WU00:FS00:Assigned to work server 171.64.65.56
02:59:06:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 171.64.65.56
02:59:06:WU00:FS00:Connecting to 171.64.65.56:8080
02:59:07:WU00:FS00:Downloading 5.06MiB
02:59:11:WU00:FS00:Download complete
02:59:12:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9406 run:152 clone:0 gen:164 core:0x17 unit:0x000000f30a3b1e5c533de47529c264c7
02:59:12:WU00:FS00:Starting
02:59:12:WU00:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 703 -lifeline 2912 -checkpoint 30 -gpu 0 -gpu-vendor nvidia
02:59:12:WU00:FS00:Started FahCore on PID 2692
02:59:12:WU00:FS00:Core PID:4412
02:59:12:WU00:FS00:FahCore 0x17 started
02:59:13:WU00:FS00:0x17:*********************** Log Started 2014-10-05T02:59:12Z ***********************
02:59:13:WU00:FS00:0x17:Project: 9406 (Run 152, Clone 0, Gen 164)
02:59:13:WU00:FS00:0x17:Unit: 0x000000f30a3b1e5c533de47529c264c7
02:59:13:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
02:59:13:WU00:FS00:0x17:Machine: 0
02:59:13:WU00:FS00:0x17:Reading tar file state.xml
02:59:14:WU00:FS00:0x17:Reading tar file system.xml
02:59:14:WU00:FS00:0x17:Reading tar file integrator.xml
02:59:14:WU00:FS00:0x17:Reading tar file core.xml
02:59:14:WU00:FS00:0x17:Digital signatures verified
02:59:14:WU00:FS00:0x17:Folding@home GPU core17
02:59:14:WU00:FS00:0x17:Version 0.0.52
03:04:59:WU00:FS00:0x17:ERROR:exception: Force RMSE error of 633.472 with threshold of 5
03:04:59:WU00:FS00:0x17:Saving result file logfile_01.txt
03:04:59:WU00:FS00:0x17:Saving result file log.txt
03:04:59:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
03:04:59:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
03:04:59:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:9406 run:152 clone:0 gen:164 core:0x17 unit:0x000000f30a3b1e5c533de47529c264c7
03:04:59:WU00:FS00:Uploading 2.24KiB to 171.64.65.56
03:04:59:WU00:FS00:Connecting to 171.64.65.56:8080
03:04:59:WU00:FS00:Upload complete
03:04:59:WU00:FS00:Server responded WORK_ACK (400)
03:04:59:WU00:FS00:Cleaning up
03:04:59:WU01:FS00:Connecting to assign-GPU.stanford.edu:80
03:05:00:WU01:FS00:News: 
03:05:00:WU01:FS00:Assigned to work server 171.64.65.56
03:05:00:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 171.64.65.56
03:05:00:WU01:FS00:Connecting to 171.64.65.56:8080
03:05:01:WU01:FS00:Downloading 5.28MiB
03:05:07:WU01:FS00:Download 100.00%
03:05:07:WU01:FS00:Download complete
03:05:07:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9406 run:102 clone:0 gen:156 core:0x17 unit:0x000000e90a3b1e5c533ddb1e30155293
03:05:07:WU01:FS00:Starting
03:05:07:WU01:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 703 -lifeline 2912 -checkpoint 30 -gpu 0 -gpu-vendor nvidia
03:05:07:WU01:FS00:Started FahCore on PID 4716
03:05:07:WU01:FS00:Core PID:4232
03:05:07:WU01:FS00:FahCore 0x17 started
03:05:08:WU01:FS00:0x17:*********************** Log Started 2014-10-05T03:05:08Z ***********************
03:05:08:WU01:FS00:0x17:Project: 9406 (Run 102, Clone 0, Gen 156)
03:05:08:WU01:FS00:0x17:Unit: 0x000000e90a3b1e5c533ddb1e30155293
03:05:08:WU01:FS00:0x17:CPU: 0x00000000000000000000000000000000
03:05:08:WU01:FS00:0x17:Machine: 0
03:05:08:WU01:FS00:0x17:Reading tar file state.xml
03:05:09:WU01:FS00:0x17:Reading tar file system.xml
03:05:10:WU01:FS00:0x17:Reading tar file integrator.xml
03:05:10:WU01:FS00:0x17:Reading tar file core.xml
03:05:10:WU01:FS00:0x17:Digital signatures verified
03:05:10:WU01:FS00:0x17:Folding@home GPU core17
03:05:10:WU01:FS00:0x17:Version 0.0.52
03:11:27:WU01:FS00:0x17:ERROR:exception: Force RMSE error of 620.423 with threshold of 5
03:11:27:WU01:FS00:0x17:Saving result file logfile_01.txt
03:11:27:WU01:FS00:0x17:Saving result file log.txt
03:11:27:WU01:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
03:11:28:WARNING:WU01:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
03:11:28:WU01:FS00:Sending unit results: id:01 state:SEND error:FAULTY project:9406 run:102 clone:0 gen:156 core:0x17 unit:0x000000e90a3b1e5c533ddb1e30155293
03:11:28:WU01:FS00:Uploading 2.24KiB to 171.64.65.56
03:11:28:WU01:FS00:Connecting to 171.64.65.56:8080
03:11:28:WU01:FS00:Upload complete
03:11:29:WU01:FS00:Server responded WORK_ACK (400)
03:11:29:WU01:FS00:Cleaning up

After the error folding has stopped. How do I get it started again ?

uddarts · Post by **uddarts** » Sun Oct 05, 2014 3:47 pm

your good here. your one of us.

after a set number of failures, it shuts down for a predetermined period and will start on it own. i'd shut down the slot until they make a correction with the core 17s or down grade us to the core 15s again.

there are several threads going in other sub forums now. it's a maxwell thing which now includes the new 9xx series.

ud

Freightanimal · Post by **Freightanimal** » Sun Oct 05, 2014 3:54 pm

Just some details for my setup, I have not changed a thing. I am using Windows 7 Home premium As other posters have stated I started on the previous driver then tried an upgrade to see if it made a difference. No improvement at all. This is the same behavior that I noticed before when core17 WSUs wouldn't work. GUP-Z shows a bit of activity when starting then pretty much none until it fails. For a while a few months ago all was good on core17 WUs. Will post log if needed.

heikosch · Post by **heikosch** » Sun Oct 05, 2014 6:29 pm

My GTX 750 Ti doesn´t fold any Core 17 WUs any more.

Heiko

kerbos5 · Post by **kerbos5** » Sun Oct 05, 2014 9:14 pm

Having same problems as everyone else.

Biffa · Post by **Biffa** » Sun Oct 05, 2014 9:59 pm

Its a problem with the work units.

gwildperson · Post by **gwildperson** » Mon Oct 06, 2014 12:51 am

Biffa wrote:Its a problem with the work units.

Are you certain?

I'd be interested in who is running which version of the drivers.

There were two WHQL drivers release 5 days apart. That is unusual.

Biffa · Post by **Biffa** » Mon Oct 06, 2014 7:48 am

gwildperson wrote:
Biffa wrote:Its a problem with the work units.
Are you certain?

I'd be interested in who is running which version of the drivers.

There were two WHQL drivers release 5 days apart. That is unusual.

The drivers you are talking about are for the 970/980 Maxwell cards

344.11 - Sept 18, 2014
344.16 - Sept 23, 2014

That doesn't take into account that the problem manifests itself on 750 Maxwell cards as well, of which the only driver is still on 344.11

Also many people have not changed drivers and are still getting the issue.

OK so it appears to be limited to Maxwell, AMD and earlier NVidia Arch cards are still able to fold Core_17 without issue.

Nick200 · Post by **Nick200** » Mon Oct 06, 2014 9:48 am

Hi

I am getting a constant stream of WU fails on one machine with a GTX750 card in it, which I installed some three months ago. Until about a week ago, it has been folding without problems. I have had a number of Core 17 projects fail including this one.

Is the Bad Unit message related to the Core or to the card's handling of it?

Code: Select all

*********************** Log Started 2014-10-06T05:59:43Z ***********************
05:59:43:************************* Folding@home Client *************************
05:59:43:      Website: http://folding.stanford.edu/
05:59:43:    Copyright: (c) 2009-2014 Stanford University
05:59:43:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
05:59:43:         Args: 
05:59:43:       Config: C:/ProgramData/FAHClient/config.xml
05:59:43:******************************** Build ********************************
05:59:43:      Version: 7.4.4
05:59:43:         Date: Mar 4 2014
05:59:43:         Time: 20:26:54
05:59:43:      SVN Rev: 4130
05:59:43:       Branch: fah/trunk/client
05:59:43:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
05:59:43:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
05:59:43:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
05:59:43:     Platform: win32 XP
05:59:43:         Bits: 32
05:59:43:         Mode: Release
05:59:43:******************************* System ********************************
05:59:43:          CPU: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz
05:59:43:       CPU ID: GenuineIntel Family 6 Model 15 Stepping 11
05:59:43:         CPUs: 4
05:59:43:       Memory: 4.00GiB
05:59:43:  Free Memory: 2.19GiB
05:59:43:      Threads: WINDOWS_THREADS
05:59:43:   OS Version: 6.2
05:59:43:  Has Battery: false
05:59:43:   On Battery: false
05:59:43:   UTC Offset: 13
05:59:43:          PID: 10212
05:59:43:          CWD: C:/ProgramData/FAHClient
05:59:43:           OS: Windows 8.1 Pro with Media Center
05:59:43:      OS Arch: AMD64
05:59:43:         GPUs: 1
05:59:43:        GPU 0: NVIDIA:4 GM107 [GeForce GTX 750]
05:59:43:         CUDA: 5.0
05:59:43:  CUDA Driver: 6050
05:59:43:Win32 Service: false
05:59:43:***********************************************************************
05:59:43:<config>
05:59:43:  <!-- Network -->
05:59:43:  <proxy v=':8080'/>
05:59:43:
05:59:43:  <!-- Slot Control -->
05:59:43:  <power v='FULL'/>
05:59:43:
05:59:43:  <!-- User Information -->
05:59:43:  <passkey v='********************************'/>
05:59:43:  <team v='142900'/>
05:59:43:  <user v='Montague-Cripps'/>
05:59:43:
05:59:43:  <!-- Folding Slots -->
05:59:43:  <slot id='0' type='CPU'>
05:59:43:    <client-type v='advanced'/>
05:59:43:    <paused v='true'/>
05:59:43:  </slot>
05:59:43:  <slot id='1' type='GPU'>
05:59:43:    <client-type v='advanced'/>
05:59:43:  </slot>
05:59:43:</config>
05:59:43:Trying to access database...
05:59:43:Successfully acquired database lock
05:59:43:Enabled folding slot 00: PAUSED cpu:3 (by user)
05:59:43:Enabled folding slot 01: READY gpu:0:GM107 [GeForce GTX 750]
05:59:44:WU00:FS01:Connecting to 171.67.108.201:80
05:59:46:WU00:FS01:Assigned to work server 171.64.65.56
05:59:46:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:GM107 [GeForce GTX 750] from 171.64.65.56
05:59:46:WU00:FS01:Connecting to 171.64.65.56:8080
05:59:48:WU00:FS01:Downloading 4.95MiB
05:59:51:WU00:FS01:Download complete
05:59:51:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9406 run:623 clone:1 gen:4 core:0x17 unit:0x000000070a3b1e5c533e3c6160096865
05:59:51:WU00:FS01:Starting
05:59:51:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 10212 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
05:59:51:WU00:FS01:Started FahCore on PID 9472
05:59:51:WU00:FS01:Core PID:7604
05:59:51:WU00:FS01:FahCore 0x17 started
05:59:57:WU00:FS01:0x17:*********************** Log Started 2014-10-06T05:59:57Z ***********************
05:59:57:WU00:FS01:0x17:Project: 9406 (Run 623, Clone 1, Gen 4)
05:59:57:WU00:FS01:0x17:Unit: 0x000000070a3b1e5c533e3c6160096865
05:59:57:WU00:FS01:0x17:CPU: 0x00000000000000000000000000000000
05:59:57:WU00:FS01:0x17:Machine: 1
05:59:57:WU00:FS01:0x17:Reading tar file state.xml
05:59:58:FS00:Unpaused
05:59:58:WU01:FS00:Starting
05:59:58:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 704 -lifeline 10212 -checkpoint 15 -np 3
05:59:58:WU01:FS00:Started FahCore on PID 9372
05:59:58:WU01:FS00:Core PID:196
05:59:58:WU01:FS00:FahCore 0xa4 started
05:59:58:WU01:FS00:0xa4:
05:59:58:WU01:FS00:0xa4:*------------------------------*
05:59:58:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
05:59:58:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
05:59:58:WU01:FS00:0xa4:
05:59:58:WU01:FS00:0xa4:Preparing to commence simulation
05:59:58:WU01:FS00:0xa4:- Looking at optimizations...
05:59:58:WU00:FS01:0x17:Reading tar file system.xml
05:59:58:WU01:FS00:0xa4:- Files status OK
05:59:58:WU01:FS00:0xa4:- Expanded 201944 -> 424164 (decompressed 210.0 percent)
05:59:58:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=201944 data_size=424164, decompressed_data_size=424164 diff=0
05:59:58:WU01:FS00:0xa4:- Digital signature verified
05:59:58:WU01:FS00:0xa4:
05:59:58:WU01:FS00:0xa4:Project: 6383 (Run 8, Clone 2, Gen 20)
05:59:58:WU01:FS00:0xa4:
05:59:58:WU01:FS00:0xa4:Assembly optimizations on if available.
05:59:58:WU01:FS00:0xa4:Entering M.D.
05:59:59:WU00:FS01:0x17:Reading tar file integrator.xml
05:59:59:WU00:FS01:0x17:Reading tar file core.xml
05:59:59:WU00:FS01:0x17:Digital signatures verified
05:59:59:WU00:FS01:0x17:Folding@home GPU core17
05:59:59:WU00:FS01:0x17:Version 0.0.52
06:00:04:WU01:FS00:0xa4:Using Gromacs checkpoints
06:00:04:WU01:FS00:0xa4:Mapping NT from 3 to 3 
06:00:05:WU01:FS00:0xa4:Resuming from checkpoint
06:00:05:WU01:FS00:0xa4:Verified 01/wudata_01.log
06:00:05:WU01:FS00:0xa4:Verified 01/wudata_01.trr
06:00:05:WU01:FS00:0xa4:Verified 01/wudata_01.xtc
06:00:05:WU01:FS00:0xa4:Verified 01/wudata_01.edr
06:00:05:WU01:FS00:0xa4:Completed 2316200 out of 2500000 steps  (92%)
06:00:44:Removing old file 'configs/config-20141002-043533.xml'
06:00:44:Saving configuration to config.xml
06:00:44:<config>
06:00:44:  <!-- Network -->
06:00:44:  <proxy v=':8080'/>
06:00:44:
06:00:44:  <!-- Slot Control -->
06:00:44:  <power v='FULL'/>
06:00:44:
06:00:44:  <!-- User Information -->
06:00:44:  <passkey v='********************************'/>
06:00:44:  <team v='142900'/>
06:00:44:  <user v='Montague-Cripps'/>
06:00:44:
06:00:44:  <!-- Folding Slots -->
06:00:44:  <slot id='0' type='CPU'>
06:00:44:    <client-type v='advanced'/>
06:00:44:  </slot>
06:00:44:  <slot id='1' type='GPU'>
06:00:44:    <client-type v='advanced'/>
06:00:44:  </slot>
06:00:44:</config>
06:02:13:WU01:FS00:0xa4:Completed 2325000 out of 2500000 steps  (93%)
06:05:12:WU00:FS01:0x17:ERROR:exception: Error downloading array interactionCount: clEnqueueReadBuffer (-36)
06:05:12:WU00:FS01:0x17:Saving result file logfile_01.txt
06:05:12:WU00:FS01:0x17:Saving result file log.txt
06:05:12:WU00:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
06:05:15:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
06:05:15:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:9406 run:623 clone:1 gen:4 core:0x17 unit:0x000000070a3b1e5c533e3c6160096865
06:05:15:WU00:FS01:Uploading 2.26KiB to 171.64.65.56
06:05:15:WU00:FS01:Connecting to 171.64.65.56:8080
06:05:16:WU02:FS01:Connecting to 171.67.108.201:80
06:05:16:WU00:FS01:Upload complete
06:05:16:WU00:FS01:Server responded WORK_ACK (400)
06:05:16:WU00:FS01:Cleaning up
06:05:17:WU02:FS01:Assigned to work server 171.64.65.56
06:05:17:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GM107 [GeForce GTX 750] from 171.64.65.56
06:05:17:WU02:FS01:Connecting to 171.64.65.56:8080
06:05:19:WU02:FS01:Downloading 4.95MiB
06:05:21:WU02:FS01:Download complete
06:05:21:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9406 run:105 clone:0 gen:98 core:0x17 unit:0x000000bb0a3b1e5c533ddbb051905aa1
06:05:22:WU02:FS01:Starting
06:05:22:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 10212 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
06:05:22:WU02:FS01:Started FahCore on PID 5112
06:05:22:WU02:FS01:Core PID:7852
06:05:22:WU02:FS01:FahCore 0x17 started
06:05:24:WU02:FS01:0x17:*********************** Log Started 2014-10-06T06:05:24Z ***********************
06:05:24:WU02:FS01:0x17:Project: 9406 (Run 105, Clone 0, Gen 98)
06:05:24:WU02:FS01:0x17:Unit: 0x000000bb0a3b1e5c533ddbb051905aa1
06:05:24:WU02:FS01:0x17:CPU: 0x00000000000000000000000000000000
06:05:24:WU02:FS01:0x17:Machine: 1
06:05:24:WU02:FS01:0x17:Reading tar file state.xml
06:05:25:WU02:FS01:0x17:Reading tar file system.xml
06:05:26:WU02:FS01:0x17:Reading tar file integrator.xml
06:05:26:WU02:FS01:0x17:Reading tar file core.xml
06:05:26:WU02:FS01:0x17:Digital signatures verified
06:05:26:WU02:FS01:0x17:Folding@home GPU core17
06:05:26:WU02:FS01:0x17:Version 0.0.52
06:07:59:WU01:FS00:0xa4:Completed 2350000 out of 2500000 steps  (94%)
06:11:25:WU02:FS01:0x17:ERROR:exception: Force RMSE error of 612.359 with threshold of 5
06:11:25:WU02:FS01:0x17:Saving result file logfile_01.txt
06:11:25:WU02:FS01:0x17:Saving result file log.txt
06:11:25:WU02:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
06:11:25:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
06:11:26:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:9406 run:105 clone:0 gen:98 core:0x17 unit:0x000000bb0a3b1e5c533ddbb051905aa1
06:11:26:WU02:FS01:Uploading 2.25KiB to 171.64.65.56
06:11:26:WU02:FS01:Connecting to 171.64.65.56:8080
06:11:26:WU00:FS01:Connecting to 171.67.108.201:80
06:11:26:WU02:FS01:Upload complete
06:11:26:WU02:FS01:Server responded WORK_ACK (400)
06:11:26:WU02:FS01:Cleaning up
06:11:27:WU00:FS01:Assigned to work server 171.64.65.56
06:11:27:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:GM107 [GeForce GTX 750] from 171.64.65.56
06:11:27:WU00:FS01:Connecting to 171.64.65.56:8080
06:11:27:WU00:FS01:Downloading 5.06MiB
06:11:33:WU00:FS01:Download 99.96%
06:11:33:WU00:FS01:Download complete
06:11:33:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9406 run:272 clone:2 gen:8 core:0x17 unit:0x0000000c0a3b1e5c533dfb3345081357
06:11:34:WU00:FS01:Starting
06:11:34:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 10212 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
06:11:34:WU00:FS01:Started FahCore on PID 6300
06:11:34:WU00:FS01:Core PID:8740
06:11:34:WU00:FS01:FahCore 0x17 started
06:11:35:WU00:FS01:0x17:*********************** Log Started 2014-10-06T06:11:34Z ***********************
06:11:35:WU00:FS01:0x17:Project: 9406 (Run 272, Clone 2, Gen 8)
06:11:35:WU00:FS01:0x17:Unit: 0x0000000c0a3b1e5c533dfb3345081357
06:11:35:WU00:FS01:0x17:CPU: 0x00000000000000000000000000000000
06:11:35:WU00:FS01:0x17:Machine: 1
06:11:35:WU00:FS01:0x17:Reading tar file state.xml
06:11:36:WU00:FS01:0x17:Reading tar file system.xml
06:11:37:WU00:FS01:0x17:Reading tar file integrator.xml
06:11:37:WU00:FS01:0x17:Reading tar file core.xml
06:11:37:WU00:FS01:0x17:Digital signatures verified
06:11:37:WU00:FS01:0x17:Folding@home GPU core17
06:11:37:WU00:FS01:0x17:Version 0.0.52
06:13:34:WU01:FS00:0xa4:Completed 2375000 out of 2500000 steps  (95%)
06:17:44:WU00:FS01:0x17:ERROR:exception: Force RMSE error of 630.603 with threshold of 5
06:17:44:WU00:FS01:0x17:Saving result file logfile_01.txt
06:17:44:WU00:FS01:0x17:Saving result file log.txt
06:17:44:WU00:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
06:17:45:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
06:17:45:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:9406 run:272 clone:2 gen:8 core:0x17 unit:0x0000000c0a3b1e5c533dfb3345081357
06:17:45:WU00:FS01:Uploading 2.23KiB to 171.64.65.56
06:17:45:WU00:FS01:Connecting to 171.64.65.56:8080
06:17:45:WU02:FS01:Connecting to 171.67.108.201:80
06:17:46:WU00:FS01:Upload complete
06:17:46:WU00:FS01:Server responded WORK_ACK (400)
06:17:46:WU00:FS01:Cleaning up
06:17:46:WU02:FS01:Assigned to work server 171.64.65.56
06:17:46:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GM107 [GeForce GTX 750] from 171.64.65.56
06:17:46:WU02:FS01:Connecting to 171.64.65.56:8080
06:17:47:WU02:FS01:Downloading 5.07MiB
06:17:50:WU02:FS01:Download complete
06:17:51:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9406 run:555 clone:2 gen:1 core:0x17 unit:0x000000030a3b1e5c533e2f86f7249508
06:17:51:WU02:FS01:Starting
06:17:51:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 10212 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
06:17:51:WU02:FS01:Started FahCore on PID 8888
06:17:51:WU02:FS01:Core PID:8892
06:17:51:WU02:FS01:FahCore 0x17 started
06:17:52:WU02:FS01:0x17:*********************** Log Started 2014-10-06T06:17:52Z ***********************
06:17:52:WU02:FS01:0x17:Project: 9406 (Run 555, Clone 2, Gen 1)
06:17:52:WU02:FS01:0x17:Unit: 0x000000030a3b1e5c533e2f86f7249508
06:17:52:WU02:FS01:0x17:CPU: 0x00000000000000000000000000000000
06:17:52:WU02:FS01:0x17:Machine: 1
06:17:52:WU02:FS01:0x17:Reading tar file state.xml
06:17:53:WU02:FS01:0x17:Reading tar file system.xml
06:17:54:WU02:FS01:0x17:Reading tar file integrator.xml
06:17:54:WU02:FS01:0x17:Reading tar file core.xml
06:17:54:WU02:FS01:0x17:Digital signatures verified
06:17:54:WU02:FS01:0x17:Folding@home GPU core17
06:17:54:WU02:FS01:0x17:Version 0.0.52
06:19:11:WU01:FS00:0xa4:Completed 2400000 out of 2500000 steps  (96%)
06:23:56:WU02:FS01:0x17:ERROR:exception: Force RMSE error of 612.928 with threshold of 5
06:23:56:WU02:FS01:0x17:Saving result file logfile_01.txt
06:23:56:WU02:FS01:0x17:Saving result file log.txt
06:23:56:WU02:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
06:23:57:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
06:23:57:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:9406 run:555 clone:2 gen:1 core:0x17 unit:0x000000030a3b1e5c533e2f86f7249508
06:23:57:WU02:FS01:Uploading 2.24KiB to 171.64.65.56
06:23:57:WU02:FS01:Connecting to 171.64.65.56:8080
06:23:57:WU00:FS01:Connecting to 171.67.108.201:80
06:23:57:WU02:FS01:Upload complete
06:23:57:WU02:FS01:Server responded WORK_ACK (400)
06:23:57:WU02:FS01:Cleaning up
06:23:58:WU00:FS01:Assigned to work server 140.163.4.231
06:23:58:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:GM107 [GeForce GTX 750] from 140.163.4.231
06:23:58:WU00:FS01:Connecting to 140.163.4.231:8080
06:23:59:WU00:FS01:Downloading 4.83MiB
06:24:03:WU00:FS01:Download complete
06:24:03:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13000 run:2068 clone:0 gen:77 core:0x17 unit:0x00000075538b3db75311e497cdee6779
06:24:03:WU00:FS01:Starting
06:24:03:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 10212 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
06:24:03:WU00:FS01:Started FahCore on PID 8128
06:24:03:WU00:FS01:Core PID:7112
06:24:03:WU00:FS01:FahCore 0x17 started
06:24:04:WU00:FS01:0x17:*********************** Log Started 2014-10-06T06:24:04Z ***********************
06:24:04:WU00:FS01:0x17:Project: 13000 (Run 2068, Clone 0, Gen 77)
06:24:04:WU00:FS01:0x17:Unit: 0x00000075538b3db75311e497cdee6779
06:24:04:WU00:FS01:0x17:CPU: 0x00000000000000000000000000000000
06:24:04:WU00:FS01:0x17:Machine: 1
06:24:04:WU00:FS01:0x17:Reading tar file state.xml
06:24:05:WU00:FS01:0x17:Reading tar file system.xml
06:24:06:WU00:FS01:0x17:Reading tar file integrator.xml
06:24:06:WU00:FS01:0x17:Reading tar file core.xml
06:24:06:WU00:FS01:0x17:Digital signatures verified
06:24:06:WU00:FS01:0x17:Folding@home GPU core17
06:24:06:WU00:FS01:0x17:Version 0.0.52
06:24:47:WU01:FS00:0xa4:Completed 2425000 out of 2500000 steps  (97%)
06:30:02:WU00:FS01:0x17:ERROR:exception: Force RMSE error of 456.965 with threshold of 5
06:30:02:WU00:FS01:0x17:Saving result file logfile_01.txt
06:30:02:WU00:FS01:0x17:Saving result file log.txt
06:30:02:WU00:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
06:30:02:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
06:30:02:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:13000 run:2068 clone:0 gen:77 core:0x17 unit:0x00000075538b3db75311e497cdee6779
06:30:02:WU00:FS01:Uploading 2.24KiB to 140.163.4.231
06:30:02:WU00:FS01:Connecting to 140.163.4.231:8080
06:30:03:WU00:FS01:Upload complete
06:30:03:WU02:FS01:Connecting to 171.67.108.201:80
06:30:03:WU00:FS01:Server responded WORK_ACK (400)
06:30:03:WU00:FS01:Cleaning up
06:30:04:WU02:FS01:Assigned to work server 140.163.4.231
06:30:04:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GM107 [GeForce GTX 750] from 140.163.4.231
06:30:04:WU02:FS01:Connecting to 140.163.4.231:8080
06:30:05:WU02:FS01:Downloading 4.83MiB
06:30:08:WU02:FS01:Download complete
06:30:09:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13000 run:1014 clone:0 gen:74 core:0x17 unit:0x0000008b538b3db75310ba0599edb098
06:30:09:WU02:FS01:Starting
06:30:09:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 10212 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
06:30:09:WU02:FS01:Started FahCore on PID 9460
06:30:09:WU02:FS01:Core PID:9288
06:30:09:WU02:FS01:FahCore 0x17 started
06:30:10:WU02:FS01:0x17:*********************** Log Started 2014-10-06T06:30:09Z ***********************
06:30:10:WU02:FS01:0x17:Project: 13000 (Run 1014, Clone 0, Gen 74)
06:30:10:WU02:FS01:0x17:Unit: 0x0000008b538b3db75310ba0599edb098
06:30:10:WU02:FS01:0x17:CPU: 0x00000000000000000000000000000000
06:30:10:WU02:FS01:0x17:Machine: 1
06:30:10:WU02:FS01:0x17:Reading tar file state.xml
06:30:11:WU02:FS01:0x17:Reading tar file system.xml
06:30:12:WU02:FS01:0x17:Reading tar file integrator.xml
06:30:12:WU02:FS01:0x17:Reading tar file core.xml
06:30:12:WU02:FS01:0x17:Digital signatures verified
06:30:12:WU02:FS01:0x17:Folding@home GPU core17
06:30:12:WU02:FS01:0x17:Version 0.0.52
06:30:21:WU01:FS00:0xa4:Completed 2450000 out of 2500000 steps  (98%)
06:35:59:WU02:FS01:0x17:ERROR:exception: Force RMSE error of 453.885 with threshold of 5
06:35:59:WU02:FS01:0x17:Saving result file logfile_01.txt
06:35:59:WU02:FS01:0x17:Saving result file log.txt
06:35:59:WU02:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
06:35:59:WU01:FS00:0xa4:Completed 2475000 out of 2500000 steps  (99%)
06:35:59:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
06:35:59:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:13000 run:1014 clone:0 gen:74 core:0x17 unit:0x0000008b538b3db75310ba0599edb098
06:36:00:WU02:FS01:Uploading 2.24KiB to 140.163.4.231
06:36:00:WU02:FS01:Connecting to 140.163.4.231:8080
06:36:00:WU02:FS01:Upload complete
06:36:01:WU00:FS00:Connecting to 171.67.108.200:8080
06:36:01:WU02:FS01:Server responded WORK_ACK (400)
06:36:01:WU02:FS01:Cleaning up
06:36:01:WU03:FS01:Connecting to 171.67.108.201:80
06:36:02:WU00:FS00:Assigned to work server 155.247.166.220
06:36:02:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 155.247.166.220
06:36:02:WU00:FS00:Connecting to 155.247.166.220:8080
06:36:02:WU03:FS01:Assigned to work server 140.163.4.231
06:36:02:WU03:FS01:Requesting new work unit for slot 01: READY gpu:0:GM107 [GeForce GTX 750] from 140.163.4.231
06:36:02:WU03:FS01:Connecting to 140.163.4.231:8080
06:36:03:WU03:FS01:Downloading 4.83MiB
06:36:03:WU00:FS00:Downloading 552.02KiB
06:36:05:WU00:FS00:Download complete
06:36:05:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:6381 run:1 clone:0 gen:84 core:0xa4 unit:0x000000580002894c53d25fb8846e8918
06:36:07:WU03:FS01:Download complete
06:36:07:WU03:FS01:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:13001 run:522 clone:1 gen:27 core:0x17 unit:0x00000048538b3db7532c90257f6fa459
06:36:07:WU03:FS01:Starting
06:36:07:WU03:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 704 -lifeline 10212 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
06:36:07:WU03:FS01:Started FahCore on PID 10016
06:36:07:WU03:FS01:Core PID:1800
06:36:07:WU03:FS01:FahCore 0x17 started
06:36:09:WU03:FS01:0x17:*********************** Log Started 2014-10-06T06:36:09Z ***********************
06:36:09:WU03:FS01:0x17:Project: 13001 (Run 522, Clone 1, Gen 27)
06:36:09:WU03:FS01:0x17:Unit: 0x00000048538b3db7532c90257f6fa459
06:36:09:WU03:FS01:0x17:CPU: 0x00000000000000000000000000000000
06:36:09:WU03:FS01:0x17:Machine: 1
06:36:09:WU03:FS01:0x17:Reading tar file state.xml
06:36:10:WU03:FS01:0x17:Reading tar file system.xml
06:36:11:WU03:FS01:0x17:Reading tar file integrator.xml
06:36:11:WU03:FS01:0x17:Reading tar file core.xml
06:36:11:WU03:FS01:0x17:Digital signatures verified
06:36:11:WU03:FS01:0x17:Folding@home GPU core17
06:36:11:WU03:FS01:0x17:Version 0.0.52
06:41:45:WU01:FS00:0xa4:Completed 2500000 out of 2500000 steps  (100%)
06:41:46:WU01:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
06:41:56:WU01:FS00:0xa4:
06:41:56:WU01:FS00:0xa4:Finished Work Unit:
06:41:56:WU01:FS00:0xa4:- Reading up to 1283904 from "01/wudata_01.trr": Read 1283904
06:41:56:WU01:FS00:0xa4:trr file hash check passed.
06:41:56:WU01:FS00:0xa4:- Reading up to 50092 from "01/wudata_01.xtc": Read 50092
06:41:56:WU01:FS00:0xa4:xtc file hash check passed.
06:41:56:WU01:FS00:0xa4:edr file hash check passed.
06:41:56:WU01:FS00:0xa4:logfile size: 53691
06:41:56:WU01:FS00:0xa4:Leaving Run
06:42:00:WU01:FS00:0xa4:- Writing 1424787 bytes of core data to disk...
06:42:00:WU01:FS00:0xa4:Done: 1424275 -> 1212805 (compressed to 85.1 percent)
06:42:00:WU01:FS00:0xa4:  ... Done.
06:42:01:WU01:FS00:0xa4:- Shutting down core
06:42:01:WU01:FS00:0xa4:
06:42:01:WU01:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
06:42:02:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
06:42:02:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:6383 run:8 clone:2 gen:20 core:0xa4 unit:0x000000140002894c541738663939d539
06:42:02:WU01:FS00:Uploading 1.16MiB to 155.247.166.220
06:42:02:WU00:FS00:Starting
06:42:02:WU01:FS00:Connecting to 155.247.166.220:8080
06:42:02:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 10212 -checkpoint 15 -np 3
06:42:02:WU00:FS00:Started FahCore on PID 9472
06:42:02:WU00:FS00:Core PID:10092
06:42:02:WU00:FS00:FahCore 0xa4 started
06:42:03:WU00:FS00:0xa4:
06:42:03:WU00:FS00:0xa4:*------------------------------*
06:42:03:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
06:42:03:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
06:42:03:WU00:FS00:0xa4:
06:42:03:WU00:FS00:0xa4:Preparing to commence simulation
06:42:03:WU00:FS00:0xa4:- Looking at optimizations...
06:42:03:WU00:FS00:0xa4:- Created dyn
06:42:03:WU00:FS00:0xa4:- Files status OK
06:42:03:WU00:FS00:0xa4:- Expanded 564756 -> 1381464 (decompressed 244.6 percent)
06:42:03:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=564756 data_size=1381464, decompressed_data_size=1381464 diff=0
06:42:03:WU00:FS00:0xa4:- Digital signature verified
06:42:03:WU00:FS00:0xa4:
06:42:03:WU00:FS00:0xa4:Project: 6381 (Run 1, Clone 0, Gen 84)
06:42:03:WU00:FS00:0xa4:
06:42:03:WU00:FS00:0xa4:Assembly optimizations on if available.
06:42:03:WU00:FS00:0xa4:Entering M.D.
06:42:06:WU03:FS01:0x17:ERROR:exception: Force RMSE error of 450.881 with threshold of 5
06:42:06:WU03:FS01:0x17:Saving result file logfile_01.txt
06:42:06:WU03:FS01:0x17:Saving result file log.txt
06:42:06:WU03:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
06:42:07:WARNING:WU03:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
06:42:07:WU03:FS01:Sending unit results: id:03 state:SEND error:FAULTY project:13001 run:522 clone:1 gen:27 core:0x17 unit:0x00000048538b3db7532c90257f6fa459
06:42:07:WU03:FS01:Uploading 2.26KiB to 140.163.4.231
06:42:07:WU03:FS01:Connecting to 140.163.4.231:8080
06:42:07:WU02:FS01:Connecting to 171.67.108.201:80
06:42:07:WU03:FS01:Upload complete
06:42:07:WU03:FS01:Server responded WORK_ACK (400)
06:42:07:WU03:FS01:Cleaning up
06:42:08:WU02:FS01:Assigned to work server 140.163.4.231
06:42:08:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GM107 [GeForce GTX 750] from 140.163.4.231
06:42:08:WU02:FS01:Connecting to 140.163.4.231:8080
06:42:08:WU01:FS00:Upload complete
06:42:08:WU01:FS00:Server responded WORK_ACK (400)
06:42:08:WU01:FS00:Final credit estimate, 1128.00 points
06:42:08:WU01:FS00:Cleaning up
06:42:09:WU00:FS00:0xa4:Mapping NT from 3 to 3 
06:42:09:WU00:FS00:0xa4:Completed 0 out of 2500000 steps  (0%)
06:42:09:WU02:FS01:Downloading 4.83MiB
06:42:13:WU02:FS01:Download complete
06:42:13:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13001 run:93 clone:3 gen:72 core:0x17 unit:0x0000008c538b3db753286a0f31db273f
06:42:13:WU02:FS01:Starting
06:42:13:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 10212 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
06:42:13:WU02:FS01:Started FahCore on PID 9388
06:42:13:WU02:FS01:Core PID:1320
06:42:13:WU02:FS01:FahCore 0x17 started
06:42:14:WU02:FS01:0x17:*********************** Log Started 2014-10-06T06:42:14Z ***********************
06:42:14:WU02:FS01:0x17:Project: 13001 (Run 93, Clone 3, Gen 72)
06:42:14:WU02:FS01:0x17:Unit: 0x0000008c538b3db753286a0f31db273f
06:42:14:WU02:FS01:0x17:CPU: 0x00000000000000000000000000000000
06:42:14:WU02:FS01:0x17:Machine: 1
06:42:14:WU02:FS01:0x17:Reading tar file state.xml
06:42:15:WU02:FS01:0x17:Reading tar file system.xml
06:42:16:WU02:FS01:0x17:Reading tar file integrator.xml
06:42:16:WU02:FS01:0x17:Reading tar file core.xml
06:42:16:WU02:FS01:0x17:Digital signatures verified
06:42:16:WU02:FS01:0x17:Folding@home GPU core17
06:42:16:WU02:FS01:0x17:Version 0.0.52
06:48:24:WU02:FS01:0x17:ERROR:exception: Force RMSE error of 450.162 with threshold of 5
06:48:24:WU02:FS01:0x17:Saving result file logfile_01.txt
06:48:24:WU02:FS01:0x17:Saving result file log.txt
06:48:24:WU02:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
06:48:24:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
06:48:24:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:13001 run:93 clone:3 gen:72 core:0x17 unit:0x0000008c538b3db753286a0f31db273f
06:48:24:WU02:FS01:Uploading 2.24KiB to 140.163.4.231
06:48:24:WU02:FS01:Connecting to 140.163.4.231:8080
06:48:24:WU01:FS01:Connecting to 171.67.108.201:80
06:48:24:WU02:FS01:Upload complete
06:48:24:WU02:FS01:Server responded WORK_ACK (400)
06:48:24:WU02:FS01:Cleaning up
06:48:25:WU01:FS01:Assigned to work server 140.163.4.231
06:48:25:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GM107 [GeForce GTX 750] from 140.163.4.231
06:48:25:WU01:FS01:Connecting to 140.163.4.231:8080
06:48:26:WU01:FS01:Downloading 4.84MiB
06:48:29:WU01:FS01:Download complete
06:48:29:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13001 run:208 clone:1 gen:71 core:0x17 unit:0x00000072538b3db753288aa5de2c63ec
06:48:29:WU01:FS01:Starting
06:48:29:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 10212 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
06:48:29:WU01:FS01:Started FahCore on PID 10168
06:48:29:WU01:FS01:Core PID:9332
06:48:29:WU01:FS01:FahCore 0x17 started
06:48:31:WU01:FS01:0x17:*********************** Log Started 2014-10-06T06:48:30Z ***********************
06:48:31:WU01:FS01:0x17:Project: 13001 (Run 208, Clone 1, Gen 71)
06:48:31:WU01:FS01:0x17:Unit: 0x00000072538b3db753288aa5de2c63ec
06:48:31:WU01:FS01:0x17:CPU: 0x00000000000000000000000000000000
06:48:31:WU01:FS01:0x17:Machine: 1
06:48:31:WU01:FS01:0x17:Reading tar file state.xml
06:48:32:WU01:FS01:0x17:Reading tar file system.xml
06:48:32:WU01:FS01:0x17:Reading tar file integrator.xml
06:48:32:WU01:FS01:0x17:Reading tar file core.xml
06:48:32:WU01:FS01:0x17:Digital signatures verified
06:48:32:WU01:FS01:0x17:Folding@home GPU core17
06:48:32:WU01:FS01:0x17:Version 0.0.52
06:54:23:WU01:FS01:0x17:ERROR:exception: Force RMSE error of 451.266 with threshold of 5
06:54:23:WU01:FS01:0x17:Saving result file logfile_01.txt
06:54:23:WU01:FS01:0x17:Saving result file log.txt
06:54:23:WU01:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
06:54:23:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
06:54:23:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:13001 run:208 clone:1 gen:71 core:0x17 unit:0x00000072538b3db753288aa5de2c63ec
06:54:24:WU01:FS01:Uploading 2.24KiB to 140.163.4.231
06:54:24:WU01:FS01:Connecting to 140.163.4.231:8080
06:54:24:WU02:FS01:Connecting to 171.67.108.201:80
06:54:24:WU01:FS01:Upload complete
06:54:24:WU01:FS01:Server responded WORK_ACK (400)
06:54:24:WU01:FS01:Cleaning up
06:54:25:WU02:FS01:Assigned to work server 140.163.4.231
06:54:25:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GM107 [GeForce GTX 750] from 140.163.4.231
06:54:25:WU02:FS01:Connecting to 140.163.4.231:8080
06:54:26:WU02:FS01:Downloading 4.84MiB
06:54:29:WU02:FS01:Download complete
06:54:29:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13000 run:1504 clone:0 gen:35 core:0x17 unit:0x00000059538b3db7531144d4eca177ca
06:54:29:WU02:FS01:Starting
06:54:29:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 10212 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
06:54:30:WU02:FS01:Started FahCore on PID 9164
06:54:30:WU02:FS01:Core PID:9768
06:54:30:WU02:FS01:FahCore 0x17 started
06:54:31:WU02:FS01:0x17:*********************** Log Started 2014-10-06T06:54:30Z ***********************
06:54:31:WU02:FS01:0x17:Project: 13000 (Run 1504, Clone 0, Gen 35)
06:54:31:WU02:FS01:0x17:Unit: 0x00000059538b3db7531144d4eca177ca
06:54:31:WU02:FS01:0x17:CPU: 0x00000000000000000000000000000000
06:54:31:WU02:FS01:0x17:Machine: 1
06:54:31:WU02:FS01:0x17:Reading tar file state.xml
06:54:32:WU02:FS01:0x17:Reading tar file system.xml
06:54:33:WU02:FS01:0x17:Reading tar file integrator.xml
06:54:33:WU02:FS01:0x17:Reading tar file core.xml
06:54:33:WU02:FS01:0x17:Digital signatures verified
06:54:33:WU02:FS01:0x17:Folding@home GPU core17
06:54:33:WU02:FS01:0x17:Version 0.0.52
06:57:44:WU00:FS00:0xa4:Completed 25000 out of 2500000 steps  (1%)
07:00:26:WU02:FS01:0x17:ERROR:exception: Force RMSE error of 449.753 with threshold of 5
07:00:26:WU02:FS01:0x17:Saving result file logfile_01.txt
07:00:26:WU02:FS01:0x17:Saving result file log.txt
07:00:26:WU02:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
07:00:27:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
07:00:27:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:13000 run:1504 clone:0 gen:35 core:0x17 unit:0x00000059538b3db7531144d4eca177ca
07:00:27:WU02:FS01:Uploading 2.24KiB to 140.163.4.231
07:00:27:WU02:FS01:Connecting to 140.163.4.231:8080
07:00:27:WU02:FS01:Upload complete
07:00:28:WU02:FS01:Server responded WORK_ACK (400)
07:00:28:WU02:FS01:Cleaning up
07:11:49:WU00:FS00:0xa4:Completed 50000 out of 2500000 steps  (2%)
07:25:36:WU00:FS00:0xa4:Completed 75000 out of 2500000 steps  (3%)
07:39:21:WU00:FS00:0xa4:Completed 100000 out of 2500000 steps  (4%)
07:53:08:WU00:FS00:0xa4:Completed 125000 out of 2500000 steps  (5%)
08:06:56:WU00:FS00:0xa4:Completed 150000 out of 2500000 steps  (6%)
08:20:45:WU00:FS00:0xa4:Completed 175000 out of 2500000 steps  (7%)
08:34:36:WU00:FS00:0xa4:Completed 200000 out of 2500000 steps  (8%)
08:48:34:WU00:FS00:0xa4:Completed 225000 out of 2500000 steps  (9%)
09:02:29:WU00:FS00:0xa4:Completed 250000 out of 2500000 steps  (10%)
09:16:30:WU00:FS00:0xa4:Completed 275000 out of 2500000 steps  (11%)
09:30:28:WU00:FS00:0xa4:Completed 300000 out of 2500000 steps  (12%)

I will remove the advanced flag to see if that makes any difference.

I am running on Windows 8.1 Pro 64 bit fully patched, with the GeForce 344.11 driver. I am prepared to downgrade to, say, the 327.23 driver if that will improve performance and reliability.

The GTX 750 card is running at the factory settings with no overclocking. Is there any way to quickly check that a card is failing (I do not see any other behaviour that would suggest it is)?

Any suggestions?

Thanks

Mod edit: replaced quote tags with code tags

Breach · Post by **Breach** » Mon Oct 06, 2014 9:53 am

On-going problem, please see here:
viewtopic.php?f=18&t=26807&start=15

[Fixed] Please also use code tags when pasting logs.

Mod edit: Please use Code tags when posting logs ... not Quote tags.

gaitskill · Post by **gaitskill** » Mon Oct 06, 2014 1:44 pm

I have a Asus gtx750ti which has had its share of error messages. Something has changed because there is nothing but failures now.

Code: Select all

*********************** Log Started 2014-10-06T03:58:38Z ***********************
03:59:57:FS00:Unpaused
03:59:58:WU00:FS00:Connecting to 171.67.108.201:80
03:59:58:WU00:FS00:Assigned to work server 140.163.4.231
03:59:58:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
03:59:58:WU00:FS00:Connecting to 140.163.4.231:8080
04:00:00:WU00:FS00:Downloading 4.84MiB
04:00:01:WU00:FS00:Download complete
04:00:01:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13001 run:292 clone:1 gen:64 core:0x17 unit:0x00000074538b3db75328a279c57418b4
04:00:01:WU00:FS00:Starting
04:00:01:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 5528 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
04:00:01:WU00:FS00:Started FahCore on PID 5944
04:00:01:WU00:FS00:Core PID:5192
04:00:01:WU00:FS00:FahCore 0x17 started
04:00:02:WU00:FS00:0x17:*********************** Log Started 2014-10-06T04:00:01Z ***********************
04:00:02:WU00:FS00:0x17:Project: 13001 (Run 292, Clone 1, Gen 64)
04:00:02:WU00:FS00:0x17:Unit: 0x00000074538b3db75328a279c57418b4
04:00:02:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
04:00:02:WU00:FS00:0x17:Machine: 0
04:00:02:WU00:FS00:0x17:Reading tar file state.xml
04:00:02:WU00:FS00:0x17:Reading tar file system.xml
04:00:02:WU00:FS00:0x17:Reading tar file integrator.xml
04:00:02:WU00:FS00:0x17:Reading tar file core.xml
04:00:02:WU00:FS00:0x17:Digital signatures verified
04:00:02:WU00:FS00:0x17:Folding@home GPU core17
04:00:02:WU00:FS00:0x17:Version 0.0.52
04:02:59:WU00:FS00:0x17:ERROR:exception: Force RMSE error of 451.258 with threshold of 5
04:02:59:WU00:FS00:0x17:Saving result file logfile_01.txt
04:02:59:WU00:FS00:0x17:Saving result file log.txt
04:02:59:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
04:03:00:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
04:03:00:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:13001 run:292 clone:1 gen:64 core:0x17 unit:0x00000074538b3db75328a279c57418b4
04:03:00:WU00:FS00:Uploading 2.23KiB to 140.163.4.231
04:03:00:WU00:FS00:Connecting to 140.163.4.231:8080
04:03:00:WU00:FS00:Upload complete
04:03:00:WU00:FS00:Server responded WORK_ACK (400)
04:03:00:WU00:FS00:Cleaning up
04:03:00:WU02:FS00:Connecting to 171.67.108.201:80
04:03:00:WU02:FS00:Assigned to work server 140.163.4.231
04:03:00:WU02:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
04:03:00:WU02:FS00:Connecting to 140.163.4.231:8080
04:03:02:WU02:FS00:Downloading 4.84MiB
04:03:03:WU02:FS00:Download complete
04:03:03:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13000 run:1229 clone:8 gen:24 core:0x17 unit:0x0000002a538b3db75310f71c928234e4
04:03:03:WU02:FS00:Starting
04:03:03:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 5528 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
04:03:03:WU02:FS00:Started FahCore on PID 5756
04:03:03:WU02:FS00:Core PID:2352
04:03:03:WU02:FS00:FahCore 0x17 started
04:03:03:WU02:FS00:0x17:*********************** Log Started 2014-10-06T04:03:03Z ***********************
04:03:03:WU02:FS00:0x17:Project: 13000 (Run 1229, Clone 8, Gen 24)
04:03:03:WU02:FS00:0x17:Unit: 0x0000002a538b3db75310f71c928234e4
04:03:03:WU02:FS00:0x17:CPU: 0x00000000000000000000000000000000
04:03:03:WU02:FS00:0x17:Machine: 0
04:03:03:WU02:FS00:0x17:Reading tar file state.xml
04:03:04:WU02:FS00:0x17:Reading tar file system.xml
04:03:05:WU02:FS00:0x17:Reading tar file integrator.xml
04:03:05:WU02:FS00:0x17:Reading tar file core.xml
04:03:05:WU02:FS00:0x17:Digital signatures verified
04:03:05:WU02:FS00:0x17:Folding@home GPU core17
04:03:05:WU02:FS00:0x17:Version 0.0.52
04:06:00:WU02:FS00:0x17:ERROR:exception: Force RMSE error of 454.642 with threshold of 5
04:06:00:WU02:FS00:0x17:Saving result file logfile_01.txt
04:06:00:WU02:FS00:0x17:Saving result file log.txt
04:06:00:WU02:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
04:06:00:WARNING:WU02:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
04:06:00:WU02:FS00:Sending unit results: id:02 state:SEND error:FAULTY project:13000 run:1229 clone:8 gen:24 core:0x17 unit:0x0000002a538b3db75310f71c928234e4
04:06:00:WU02:FS00:Uploading 2.24KiB to 140.163.4.231
04:06:00:WU02:FS00:Connecting to 140.163.4.231:8080
04:06:00:WU02:FS00:Upload complete
04:06:00:WU02:FS00:Server responded WORK_ACK (400)
04:06:00:WU02:FS00:Cleaning up
04:06:00:WU00:FS00:Connecting to 171.67.108.201:80
04:06:00:WU00:FS00:Assigned to work server 140.163.4.231
04:06:00:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
04:06:00:WU00:FS00:Connecting to 140.163.4.231:8080
04:06:01:WU00:FS00:Downloading 4.84MiB
04:06:02:WU00:FS00:Download complete
04:06:03:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13001 run:381 clone:8 gen:5 core:0x17 unit:0x0000000c538b3db75328bbe4b4a431c5
04:06:03:WU00:FS00:Starting
04:06:03:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 5528 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
04:06:03:WU00:FS00:Started FahCore on PID 5656
04:06:03:WU00:FS00:Core PID:4844
04:06:03:WU00:FS00:FahCore 0x17 started
04:06:03:WU00:FS00:0x17:*********************** Log Started 2014-10-06T04:06:03Z ***********************
04:06:03:WU00:FS00:0x17:Project: 13001 (Run 381, Clone 8, Gen 5)
04:06:03:WU00:FS00:0x17:Unit: 0x0000000c538b3db75328bbe4b4a431c5
04:06:03:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
04:06:03:WU00:FS00:0x17:Machine: 0
04:06:03:WU00:FS00:0x17:Reading tar file state.xml
04:06:04:WU00:FS00:0x17:Reading tar file system.xml
04:06:04:WU00:FS00:0x17:Reading tar file integrator.xml
04:06:04:WU00:FS00:0x17:Reading tar file core.xml
04:06:04:WU00:FS00:0x17:Digital signatures verified
04:06:04:WU00:FS00:0x17:Folding@home GPU core17
04:06:04:WU00:FS00:0x17:Version 0.0.52
04:08:57:WU00:FS00:0x17:ERROR:exception: Force RMSE error of 452.639 with threshold of 5
04:08:57:WU00:FS00:0x17:Saving result file logfile_01.txt
04:08:57:WU00:FS00:0x17:Saving result file log.txt
04:08:57:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
04:08:58:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
04:08:58:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:13001 run:381 clone:8 gen:5 core:0x17 unit:0x0000000c538b3db75328bbe4b4a431c5
04:08:58:WU00:FS00:Uploading 2.24KiB to 140.163.4.231
04:08:58:WU00:FS00:Connecting to 140.163.4.231:8080
04:08:58:WU00:FS00:Upload complete
04:08:58:WU00:FS00:Server responded WORK_ACK (400)
04:08:58:WU00:FS00:Cleaning up
04:08:58:WU02:FS00:Connecting to 171.67.108.201:80
04:08:58:WU02:FS00:Assigned to work server 140.163.4.231
04:08:58:WU02:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
04:08:58:WU02:FS00:Connecting to 140.163.4.231:8080
04:08:59:WU02:FS00:Downloading 4.84MiB
04:09:00:WU02:FS00:Download complete
04:09:01:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13000 run:926 clone:0 gen:37 core:0x17 unit:0x00000066538b3db75310a10c2f164a32
04:09:01:WU02:FS00:Starting
04:09:01:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 5528 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
04:09:01:WU02:FS00:Started FahCore on PID 6540
04:09:01:WU02:FS00:Core PID:1596
04:09:01:WU02:FS00:FahCore 0x17 started
04:09:01:WU02:FS00:0x17:*********************** Log Started 2014-10-06T04:09:01Z ***********************
04:09:01:WU02:FS00:0x17:Project: 13000 (Run 926, Clone 0, Gen 37)
04:09:01:WU02:FS00:0x17:Unit: 0x00000066538b3db75310a10c2f164a32
04:09:01:WU02:FS00:0x17:CPU: 0x00000000000000000000000000000000
04:09:01:WU02:FS00:0x17:Machine: 0
04:09:01:WU02:FS00:0x17:Reading tar file state.xml
04:09:02:WU02:FS00:0x17:Reading tar file system.xml
04:09:02:WU02:FS00:0x17:Reading tar file integrator.xml
04:09:02:WU02:FS00:0x17:Reading tar file core.xml
04:09:02:WU02:FS00:0x17:Digital signatures verified
04:09:02:WU02:FS00:0x17:Folding@home GPU core17
04:09:02:WU02:FS00:0x17:Version 0.0.52
04:11:56:WU02:FS00:0x17:ERROR:exception: Force RMSE error of 447.209 with threshold of 5
04:11:56:WU02:FS00:0x17:Saving result file logfile_01.txt
04:11:56:WU02:FS00:0x17:Saving result file log.txt
04:11:56:WU02:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
04:11:56:WARNING:WU02:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
04:11:56:WU02:FS00:Sending unit results: id:02 state:SEND error:FAULTY project:13000 run:926 clone:0 gen:37 core:0x17 unit:0x00000066538b3db75310a10c2f164a32
04:11:56:WU02:FS00:Uploading 2.23KiB to 140.163.4.231
04:11:56:WU02:FS00:Connecting to 140.163.4.231:8080
04:11:57:WU02:FS00:Upload complete
04:11:57:WU02:FS00:Server responded WORK_ACK (400)
04:11:57:WU02:FS00:Cleaning up
04:11:57:WU00:FS00:Connecting to 171.67.108.201:80
04:11:57:WU00:FS00:Assigned to work server 140.163.4.231
04:11:57:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
04:11:57:WU00:FS00:Connecting to 140.163.4.231:8080
04:11:58:WU00:FS00:Downloading 4.84MiB
04:11:59:WU00:FS00:Download complete
04:11:59:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13000 run:665 clone:1 gen:6 core:0x17 unit:0x00000013538b3db7531057562a9f6a1e
04:11:59:WU00:FS00:Starting
04:11:59:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 5528 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
04:11:59:WU00:FS00:Started FahCore on PID 1080
04:11:59:WU00:FS00:Core PID:5196
04:11:59:WU00:FS00:FahCore 0x17 started
04:12:00:WU00:FS00:0x17:*********************** Log Started 2014-10-06T04:11:59Z ***********************
04:12:00:WU00:FS00:0x17:Project: 13000 (Run 665, Clone 1, Gen 6)
04:12:00:WU00:FS00:0x17:Unit: 0x00000013538b3db7531057562a9f6a1e
04:12:00:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
04:12:00:WU00:FS00:0x17:Machine: 0
04:12:00:WU00:FS00:0x17:Reading tar file state.xml
04:12:00:WU00:FS00:0x17:Reading tar file system.xml
04:12:01:WU00:FS00:0x17:Reading tar file integrator.xml
04:12:01:WU00:FS00:0x17:Reading tar file core.xml
04:12:01:WU00:FS00:0x17:Digital signatures verified
04:12:01:WU00:FS00:0x17:Folding@home GPU core17
04:12:01:WU00:FS00:0x17:Version 0.0.52
04:14:57:WU00:FS00:0x17:ERROR:exception: Force RMSE error of 455.016 with threshold of 5
04:14:57:WU00:FS00:0x17:Saving result file logfile_01.txt
04:14:57:WU00:FS00:0x17:Saving result file log.txt
04:14:57:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
04:14:57:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
04:14:57:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:13000 run:665 clone:1 gen:6 core:0x17 unit:0x00000013538b3db7531057562a9f6a1e
04:14:57:WU00:FS00:Uploading 2.23KiB to 140.163.4.231
04:14:57:WU00:FS00:Connecting to 140.163.4.231:8080
04:14:57:WU00:FS00:Upload complete
04:14:57:WU00:FS00:Server responded WORK_ACK (400)
04:14:57:WU00:FS00:Cleaning up
04:14:57:WU02:FS00:Connecting to 171.67.108.201:80
04:14:58:WU02:FS00:Assigned to work server 140.163.4.231
04:14:58:WU02:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
04:14:58:WU02:FS00:Connecting to 140.163.4.231:8080
04:14:59:WU02:FS00:Downloading 4.84MiB
04:15:00:WU02:FS00:Download complete
04:15:00:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13000 run:754 clone:1 gen:6 core:0x17 unit:0x0000001a538b3db753107074ac828b91
04:15:00:WU02:FS00:Starting
04:15:00:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 5528 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
04:15:00:WU02:FS00:Started FahCore on PID 7088
04:15:00:WU02:FS00:Core PID:6548
04:15:00:WU02:FS00:FahCore 0x17 started
04:15:00:WU02:FS00:0x17:*********************** Log Started 2014-10-06T04:15:00Z ***********************
04:15:00:WU02:FS00:0x17:Project: 13000 (Run 754, Clone 1, Gen 6)
04:15:00:WU02:FS00:0x17:Unit: 0x0000001a538b3db753107074ac828b91
04:15:00:WU02:FS00:0x17:CPU: 0x00000000000000000000000000000000
04:15:00:WU02:FS00:0x17:Machine: 0
04:15:00:WU02:FS00:0x17:Reading tar file state.xml
04:15:01:WU02:FS00:0x17:Reading tar file system.xml
04:15:02:WU02:FS00:0x17:Reading tar file integrator.xml
04:15:02:WU02:FS00:0x17:Reading tar file core.xml
04:15:02:WU02:FS00:0x17:Digital signatures verified
04:15:02:WU02:FS00:0x17:Folding@home GPU core17
04:15:02:WU02:FS00:0x17:Version 0.0.52
04:17:56:WU02:FS00:0x17:ERROR:exception: Force RMSE error of 454.44 with threshold of 5
04:17:56:WU02:FS00:0x17:Saving result file logfile_01.txt
04:17:56:WU02:FS00:0x17:Saving result file log.txt
04:17:56:WU02:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
04:17:56:WARNING:WU02:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
04:17:56:WU02:FS00:Sending unit results: id:02 state:SEND error:FAULTY project:13000 run:754 clone:1 gen:6 core:0x17 unit:0x0000001a538b3db753107074ac828b91
04:17:56:WU02:FS00:Uploading 2.24KiB to 140.163.4.231
04:17:56:WU02:FS00:Connecting to 140.163.4.231:8080
04:17:56:WU02:FS00:Upload complete
04:17:56:WU02:FS00:Server responded WORK_ACK (400)
04:17:56:WU02:FS00:Cleaning up
04:17:56:WU00:FS00:Connecting to 171.67.108.201:80
04:17:57:WU00:FS00:Assigned to work server 140.163.4.231
04:17:57:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
04:17:57:WU00:FS00:Connecting to 140.163.4.231:8080
04:17:58:WU00:FS00:Downloading 4.84MiB
04:17:59:WU00:FS00:Download complete
04:17:59:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13000 run:2162 clone:4 gen:9 core:0x17 unit:0x00000011538b3db75311ff590de5f2f5
04:17:59:WU00:FS00:Starting
04:17:59:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 5528 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
04:17:59:WU00:FS00:Started FahCore on PID 1032
04:17:59:WU00:FS00:Core PID:5756
04:17:59:WU00:FS00:FahCore 0x17 started
04:18:00:WU00:FS00:0x17:*********************** Log Started 2014-10-06T04:17:59Z ***********************
04:18:00:WU00:FS00:0x17:Project: 13000 (Run 2162, Clone 4, Gen 9)
04:18:00:WU00:FS00:0x17:Unit: 0x00000011538b3db75311ff590de5f2f5
04:18:00:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
04:18:00:WU00:FS00:0x17:Machine: 0
04:18:00:WU00:FS00:0x17:Reading tar file state.xml
04:18:00:WU00:FS00:0x17:Reading tar file system.xml
04:18:01:WU00:FS00:0x17:Reading tar file integrator.xml
04:18:01:WU00:FS00:0x17:Reading tar file core.xml
04:18:01:WU00:FS00:0x17:Digital signatures verified
04:18:01:WU00:FS00:0x17:Folding@home GPU core17
04:18:01:WU00:FS00:0x17:Version 0.0.52
04:20:41:WU00:FS00:0x17:ERROR:exception: Force RMSE error of 444.829 with threshold of 5
04:20:41:WU00:FS00:0x17:Saving result file logfile_01.txt
04:20:41:WU00:FS00:0x17:Saving result file log.txt
04:20:41:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
04:20:41:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
04:20:41:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:13000 run:2162 clone:4 gen:9 core:0x17 unit:0x00000011538b3db75311ff590de5f2f5
04:20:41:WU00:FS00:Uploading 2.24KiB to 140.163.4.231
04:20:41:WU00:FS00:Connecting to 140.163.4.231:8080
04:20:41:WU00:FS00:Upload complete
04:20:42:WU00:FS00:Server responded WORK_ACK (400)
04:20:42:WU00:FS00:Cleaning up
04:20:42:WU01:FS00:Connecting to 171.67.108.201:80
04:20:42:WU01:FS00:Assigned to work server 140.163.4.231
04:20:42:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
04:20:42:WU01:FS00:Connecting to 140.163.4.231:8080
04:20:43:WU01:FS00:Downloading 4.83MiB
04:20:44:WU01:FS00:Download complete
04:20:44:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13000 run:790 clone:1 gen:6 core:0x17 unit:0x00000013538b3db753107a98aaded768
04:20:44:WU01:FS00:Starting
04:20:44:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 5528 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
04:20:44:WU01:FS00:Started FahCore on PID 6056
04:20:44:WU01:FS00:Core PID:176
04:20:44:WU01:FS00:FahCore 0x17 started
04:20:45:WU01:FS00:0x17:*********************** Log Started 2014-10-06T04:20:44Z ***********************
04:20:45:WU01:FS00:0x17:Project: 13000 (Run 790, Clone 1, Gen 6)
04:20:45:WU01:FS00:0x17:Unit: 0x00000013538b3db753107a98aaded768
04:20:45:WU01:FS00:0x17:CPU: 0x00000000000000000000000000000000
04:20:45:WU01:FS00:0x17:Machine: 0
04:20:45:WU01:FS00:0x17:Reading tar file state.xml
04:20:46:WU01:FS00:0x17:Reading tar file system.xml
04:20:46:WU01:FS00:0x17:Reading tar file integrator.xml
04:20:46:WU01:FS00:0x17:Reading tar file core.xml
04:20:46:WU01:FS00:0x17:Digital signatures verified
04:20:46:WU01:FS00:0x17:Folding@home GPU core17
04:20:46:WU01:FS00:0x17:Version 0.0.52
04:23:39:WU01:FS00:0x17:ERROR:exception: Force RMSE error of 454.142 with threshold of 5
04:23:39:WU01:FS00:0x17:Saving result file logfile_01.txt
04:23:39:WU01:FS00:0x17:Saving result file log.txt
04:23:39:WU01:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
04:23:40:WARNING:WU01:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
04:23:40:WU01:FS00:Sending unit results: id:01 state:SEND error:FAULTY project:13000 run:790 clone:1 gen:6 core:0x17 unit:0x00000013538b3db753107a98aaded768
04:23:40:WU01:FS00:Uploading 2.23KiB to 140.163.4.231
04:23:40:WU01:FS00:Connecting to 140.163.4.231:8080
04:23:40:WU01:FS00:Upload complete
04:23:40:WU01:FS00:Server responded WORK_ACK (400)
04:23:40:WU01:FS00:Cleaning up
04:23:40:WU00:FS00:Connecting to 171.67.108.201:80
04:23:40:WU00:FS00:Assigned to work server 140.163.4.231
04:23:40:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
04:23:40:WU00:FS00:Connecting to 140.163.4.231:8080
04:23:41:WU00:FS00:Downloading 4.83MiB
04:23:43:WU00:FS00:Download complete
04:23:43:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13000 run:914 clone:1 gen:6 core:0x17 unit:0x0000000c538b3db753109dadc3b7c70f
04:23:43:WU00:FS00:Starting
04:23:43:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 5528 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
04:23:43:WU00:FS00:Started FahCore on PID 6992
04:23:43:WU00:FS00:Core PID:5488
04:23:43:WU00:FS00:FahCore 0x17 started
04:23:43:WU00:FS00:0x17:*********************** Log Started 2014-10-06T04:23:43Z ***********************
04:23:43:WU00:FS00:0x17:Project: 13000 (Run 914, Clone 1, Gen 6)
04:23:43:WU00:FS00:0x17:Unit: 0x0000000c538b3db753109dadc3b7c70f
04:23:43:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
04:23:43:WU00:FS00:0x17:Machine: 0
04:23:43:WU00:FS00:0x17:Reading tar file state.xml
04:23:44:WU00:FS00:0x17:Reading tar file system.xml
04:23:45:WU00:FS00:0x17:Reading tar file integrator.xml
04:23:45:WU00:FS00:0x17:Reading tar file core.xml
04:23:45:WU00:FS00:0x17:Digital signatures verified
04:23:45:WU00:FS00:0x17:Folding@home GPU core17
04:23:45:WU00:FS00:0x17:Version 0.0.52
04:26:39:WU00:FS00:0x17:ERROR:exception: Force RMSE error of 452.981 with threshold of 5
04:26:39:WU00:FS00:0x17:Saving result file logfile_01.txt
04:26:39:WU00:FS00:0x17:Saving result file log.txt
04:26:39:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
04:26:39:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
04:26:39:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:13000 run:914 clone:1 gen:6 core:0x17 unit:0x0000000c538b3db753109dadc3b7c70f
04:26:39:WU00:FS00:Uploading 2.24KiB to 140.163.4.231
04:26:39:WU00:FS00:Connecting to 140.163.4.231:8080
04:26:39:WU00:FS00:Upload complete
04:26:39:WU00:FS00:Server responded WORK_ACK (400)
04:26:39:WU00:FS00:Cleaning up
04:26:40:WU01:FS00:Connecting to 171.67.108.201:80
04:26:40:WU01:FS00:Assigned to work server 140.163.4.231
04:26:40:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
04:26:40:WU01:FS00:Connecting to 140.163.4.231:8080
04:26:41:WU01:FS00:Downloading 4.84MiB
04:26:42:WU01:FS00:Download complete
04:26:42:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13000 run:877 clone:1 gen:6 core:0x17 unit:0x00000013538b3db753109338a4a3a6d8
04:26:42:WU01:FS00:Starting
04:26:42:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 5528 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
04:26:42:WU01:FS00:Started FahCore on PID 6892
04:26:42:WU01:FS00:Core PID:6760
04:26:42:WU01:FS00:FahCore 0x17 started
04:26:42:WU01:FS00:0x17:*********************** Log Started 2014-10-06T04:26:42Z ***********************
04:26:42:WU01:FS00:0x17:Project: 13000 (Run 877, Clone 1, Gen 6)
04:26:42:WU01:FS00:0x17:Unit: 0x00000013538b3db753109338a4a3a6d8
04:26:42:WU01:FS00:0x17:CPU: 0x00000000000000000000000000000000
04:26:42:WU01:FS00:0x17:Machine: 0
04:26:42:WU01:FS00:0x17:Reading tar file state.xml
04:26:43:WU01:FS00:0x17:Reading tar file system.xml
04:26:44:WU01:FS00:0x17:Reading tar file integrator.xml
04:26:44:WU01:FS00:0x17:Reading tar file core.xml
04:26:44:WU01:FS00:0x17:Digital signatures verified
04:26:44:WU01:FS00:0x17:Folding@home GPU core17
04:26:44:WU01:FS00:0x17:Version 0.0.52
04:29:37:WU01:FS00:0x17:ERROR:exception: Force RMSE error of 453.054 with threshold of 5
04:29:37:WU01:FS00:0x17:Saving result file logfile_01.txt
04:29:37:WU01:FS00:0x17:Saving result file log.txt
04:29:37:WU01:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
04:29:37:WARNING:WU01:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
04:29:37:WU01:FS00:Sending unit results: id:01 state:SEND error:FAULTY project:13000 run:877 clone:1 gen:6 core:0x17 unit:0x00000013538b3db753109338a4a3a6d8
04:29:37:WU01:FS00:Uploading 2.23KiB to 140.163.4.231
04:29:37:WU01:FS00:Connecting to 140.163.4.231:8080
04:29:37:WU01:FS00:Upload complete
04:29:37:WU01:FS00:Server responded WORK_ACK (400)
04:29:37:WU01:FS00:Cleaning up
******************************* Date: 2014-10-06 *******************************

Win7 64bit, FAH 7.4.4, various Nvidia drivers from 334.94 to 344.11

Post by **bruce** » Tue Oct 07, 2014 5:13 am

gaitskill wrote:I have a Asus gtx750ti which has had its share of error messages. Something has changed because there is nothing but failures now.

Can you list the projects that were successful before separately from the projects which fail now? Are any projects on both lists?

Please confirm which drivers you're using and when they were last updated.
I think it fair to assume you did not change the gtx750ti and overclocking settings didn't change.

Folding Forum

9401 fails on GM107 but not GK106 {Hopefully fixed}

Re: 9401 fails on GM107 but not GK106 {Hopefully fixed}

Re: 9401 fails on GM107 but not GK106 {Hopefully fixed}

Re: 9401 fails on GM107 but not GK106 {Hopefully fixed}

Re: P9406 - Errors at the beginning of new WU's

Re: 9401 fails on GM107 but not GK106 {Hopefully fixed}

Re: 9401 fails on GM107 but not GK106 {Hopefully fixed}

Re: 9401 fails on GM107 but not GK106 {Hopefully fixed}

Re: 9401 fails on GM107 but not GK106 {Hopefully fixed}

Re: 9401 fails on GM107 but not GK106 {Hopefully fixed}

Re: 9401 fails on GM107 but not GK106 {Hopefully fixed}

Re: 9401 fails on GM107 but not GK106 {Hopefully fixed}

Frequent Bad Unit messages for Core 17 projects on a new GTX

Re: Frequent Bad Unit messages for Core 17 projects on a new

Re: 9401 fails on GM107 but not GK106 {Hopefully fixed}

Re: 9401 fails on GM107 but not GK106 {Hopefully fixed}