Uploads keep failing

Kebast · Post by **Kebast** » Wed May 11, 2016 1:20 am

I have two completed projects that keep failing to upload. I had one stuck this afternoon, so rebooted machine to help it on its way. No luck, now a second project is stuck. Here's some log snippets:

Code: Select all

*********************** Log Started 2016-05-10T22:04:48Z ***********************
22:04:48:************************* Folding@home Client *************************
22:04:48:      Website: http://folding.stanford.edu/
22:04:48:    Copyright: (c) 2009-2014 Stanford University
22:04:48:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
22:04:48:         Args: 
22:04:48:       Config: C:/ProgramData/FAHClient/config.xml
22:04:48:******************************** Build ********************************
22:04:48:      Version: 7.4.4
22:04:48:         Date: Mar 4 2014
22:04:48:         Time: 20:26:54
22:04:48:      SVN Rev: 4130
22:04:48:       Branch: fah/trunk/client
22:04:48:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
22:04:48:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
22:04:48:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
22:04:48:     Platform: win32 XP
22:04:48:         Bits: 32
22:04:48:         Mode: Release
22:04:48:******************************* System ********************************
22:04:48:          CPU: AMD FX(tm)-6300 Six-Core Processor
22:04:48:       CPU ID: AuthenticAMD Family 21 Model 2 Stepping 0
22:04:48:         CPUs: 6
22:04:48:       Memory: 7.97GiB
22:04:48:  Free Memory: 6.00GiB
22:04:48:      Threads: WINDOWS_THREADS
22:04:48:   OS Version: 6.2
22:04:48:  Has Battery: false
22:04:48:   On Battery: false
22:04:48:   UTC Offset: -4
22:04:48:          PID: 6936
22:04:48:          CWD: C:/ProgramData/FAHClient
22:04:48:           OS: Windows 10 Home
22:04:48:      OS Arch: AMD64
22:04:48:         GPUs: 1
22:04:48:        GPU 0: NVIDIA:5 GM204 [GeForce GTX 970]
22:04:48:         CUDA: 5.2
22:04:48:  CUDA Driver: 8000
22:04:48:Win32 Service: false
22:04:48:***********************************************************************
22:04:48:<config>
22:04:48:  <!-- HTTP Server -->
22:04:48:  <allow v='127.0.0.1,192.168.66.95-192.168.66.151'/>
22:04:48:
22:04:48:  <!-- Network -->
22:04:48:  <proxy v=':8080'/>
22:04:48:
22:04:48:  <!-- Remote Command Server -->
22:04:48:  <command-allow-no-pass v='127.0.0.1,192.168.66.95-192.168.66.151'/>
22:04:48:
22:04:48:  <!-- Slot Control -->
22:04:48:  <power v='full'/>
22:04:48:
22:04:48:  <!-- User Information -->
22:04:48:  <passkey v='********************************'/>
22:04:48:  <team v='229226'/>
22:04:48:  <user v='Kebast'/>
22:04:48:
22:04:48:  <!-- Work Unit Control -->
22:04:48:  <next-unit-percentage v='100'/>
22:04:48:
22:04:48:  <!-- Folding Slots -->
22:04:48:  <slot id='1' type='GPU'>
22:04:48:    <paused v='true'/>
22:04:48:  </slot>
22:04:48:</config>
22:04:48:Trying to access database...
22:04:48:Successfully acquired database lock
22:04:48:Enabled folding slot 01: PAUSED gpu:0:GM204 [GeForce GTX 970] (by user)
22:04:48:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:7 clone:7 gen:285 core:0x21 unit:0x00000166ab404162553ebcc3ff4c850f
22:04:48:WU01:FS01:Uploading 14.97MiB to 171.64.65.98
22:04:48:WU01:FS01:Connecting to 171.64.65.98:8080
.....
22:19:55:WU01:FS01:Upload 91.02%
22:19:55:WARNING:WU01:FS01:Exception: Failed to send results to work server: Transfer failed
22:19:55:WU01:FS01:Trying to send results to collection server
22:19:55:WU01:FS01:Uploading 14.97MiB to 171.65.103.160
22:19:55:WU01:FS01:Connecting to 171.65.103.160:8080
22:20:01:WU01:FS01:Upload 0.42%
.....
22:28:28:WU01:FS01:Upload 99.79%
22:28:34:WU01:FS01:Upload complete
22:28:34:WU01:FS01:Server responded PLEASE_WAIT (464)
22:28:34:WARNING:WU01:FS01:Failed to send results, will try again later
22:28:34:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:7 clone:7 gen:285 core:0x21 unit:0x00000166ab404162553ebcc3ff4c850f
22:28:34:WU01:FS01:Uploading 14.97MiB to 171.64.65.98
22:28:34:WU01:FS01:Connecting to 171.64.65.98:8080
.....
22:43:30:WU01:FS01:Upload 94.78%
22:43:35:WARNING:WU01:FS01:Exception: Failed to send results to work server: Transfer failed
22:43:35:WU01:FS01:Trying to send results to collection server
22:43:35:WU01:FS01:Uploading 14.97MiB to 171.65.103.160
22:43:35:WU01:FS01:Connecting to 171.65.103.160:8080
22:43:42:WU01:FS01:Upload 1.25%
.....
22:58:36:ERROR:WU01:FS01:Exception: Transfer failed
22:58:36:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:7 clone:7 gen:285 core:0x21 unit:0x00000166ab404162553ebcc3ff4c850f
22:58:36:WU01:FS01:Uploading 14.97MiB to 171.64.65.98
22:58:36:WU01:FS01:Connecting to 171.64.65.98:8080
.....
23:01:30:WU01:FS01:Upload 18.79%
23:01:36:FS01:Unpaused
23:01:36:WU00:FS01:Starting
23:01:36:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 6936 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
23:01:37:WU00:FS01:Started FahCore on PID 7896
23:01:37:WU00:FS01:Core PID:7116
23:01:37:WU00:FS01:FahCore 0x21 started
23:01:38:WU00:FS01:0x21:*********************** Log Started 2016-05-10T23:01:37Z ***********************
23:01:38:WU00:FS01:0x21:Project: 9712 (Run 8, Clone 6, Gen 170)
23:01:38:WU00:FS01:0x21:Unit: 0x000001d9ab40416255b9a7691240b0f8
23:01:38:WU00:FS01:0x21:CPU: 0x00000000000000000000000000000000
23:01:38:WU00:FS01:0x21:Machine: 1
23:01:38:WU00:FS01:0x21:Digital signatures verified
23:01:38:WU00:FS01:0x21:Folding@home GPU Core21 Folding@home Core
23:01:38:WU00:FS01:0x21:Version 0.0.17
23:01:38:WU00:FS01:0x21:  Found a checkpoint file
23:01:39:WU01:FS01:Upload 19.62%
23:01:44:Removing old file 'configs/config-20160430-040707.xml'
23:01:44:Saving configuration to config.xml
23:01:44:<config>
23:01:44:  <!-- HTTP Server -->
23:01:44:  <allow v='127.0.0.1,192.168.66.95-192.168.66.151'/>
23:01:44:
23:01:44:  <!-- Network -->
23:01:44:  <proxy v=':8080'/>
23:01:44:
23:01:44:  <!-- Remote Command Server -->
23:01:44:  <command-allow-no-pass v='127.0.0.1,192.168.66.95-192.168.66.151'/>
23:01:44:
23:01:44:  <!-- Slot Control -->
23:01:44:  <power v='full'/>
23:01:44:
23:01:44:  <!-- User Information -->
23:01:44:  <passkey v='********************************'/>
23:01:44:  <team v='229226'/>
23:01:44:  <user v='Kebast'/>
23:01:44:
23:01:44:  <!-- Work Unit Control -->
23:01:44:  <next-unit-percentage v='100'/>
23:01:44:
23:01:44:  <!-- Folding Slots -->
23:01:44:  <slot id='1' type='GPU'/>
23:01:44:</config>
23:01:47:WU01:FS01:Upload 20.46%
.....
23:13:37:WU01:FS01:Upload 92.28%
23:13:37:WARNING:WU01:FS01:Exception: Failed to send results to work server: Transfer failed
23:13:37:WU01:FS01:Trying to send results to collection server
23:13:37:WU01:FS01:Uploading 14.97MiB to 171.65.103.160
23:13:37:WU01:FS01:Connecting to 171.65.103.160:8080
23:13:45:WU01:FS01:Upload 1.25%
.....23:28:38:WU01:FS01:Upload 93.95%
23:28:38:ERROR:WU01:FS01:Exception: Transfer failed
23:28:38:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:7 clone:7 gen:285 core:0x21 unit:0x00000166ab404162553ebcc3ff4c850f
23:28:38:WU01:FS01:Uploading 14.97MiB to 171.64.65.98
23:28:38:WU01:FS01:Connecting to 171.64.65.98:8080
23:28:45:WU01:FS01:Upload 1.25%
23:28:48:WU00:FS01:0x21:Completed 1049600 out of 1280000 steps (82%)
23:28:53:WU01:FS01:Upload 2.09%
.....
23:43:35:WU01:FS01:Upload 93.95%
23:43:40:WARNING:WU01:FS01:Exception: Failed to send results to work server: Transfer failed
23:43:40:WU01:FS01:Trying to send results to collection server
23:43:40:WU01:FS01:Uploading 14.97MiB to 171.65.103.160
23:43:40:WU01:FS01:Connecting to 171.65.103.160:8080
23:43:47:WU01:FS01:Upload 1.25%
.....
23:58:36:WU01:FS01:Upload 93.95%
23:58:41:ERROR:WU01:FS01:Exception: Transfer failed
23:58:42:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:7 clone:7 gen:285 core:0x21 unit:0x00000166ab404162553ebcc3ff4c850f
23:58:42:WU01:FS01:Uploading 14.97MiB to 171.64.65.98
23:58:42:WU01:FS01:Connecting to 171.64.65.98:8080
23:58:49:WU01:FS01:Upload 1.25%
23:58:58:WU00:FS01:0x21:Completed 1241600 out of 1280000 steps (97%)
23:58:58:WU01:FS01:Upload 2.09%
.....
00:04:55:WU01:FS01:Upload 37.16%
00:04:58:WU00:FS01:0x21:Completed 1280000 out of 1280000 steps (100%)
00:05:00:WU02:FS01:Connecting to 171.67.108.45:80
00:05:01:WU02:FS01:Assigned to work server 171.67.108.144
00:05:01:WU02:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GM204 [GeForce GTX 970] from 171.67.108.144
00:05:01:WU02:FS01:Connecting to 171.67.108.144:8080
00:05:03:WU00:FS01:0x21:Saving result file logfile_01.txt
00:05:03:WU00:FS01:0x21:Saving result file checkpointState.xml
00:05:04:WU01:FS01:Upload 38.00%
00:05:05:WU00:FS01:0x21:Saving result file checkpt.crc
00:05:05:WU00:FS01:0x21:Saving result file log.txt
00:05:05:WU00:FS01:0x21:Saving result file positions.xtc
00:05:06:WU00:FS01:0x21:Folding@home Core Shutdown: FINISHED_UNIT
00:05:07:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
00:05:07:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:9712 run:8 clone:6 gen:170 core:0x21 unit:0x000001d9ab40416255b9a7691240b0f8
00:05:07:WU00:FS01:Uploading 9.58MiB to 171.64.65.98
00:05:07:WU00:FS01:Connecting to 171.64.65.98:8080
00:05:10:WU01:FS01:Upload 38.41%
00:05:16:WU00:FS01:Upload 1.30%
00:05:17:WU02:FS01:Downloading 8.26MiB
.....
00:09:18:WU01:FS01:Upload 48.43%
00:09:18:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13106 run:2 clone:55 gen:62 core:0x21 unit:0x00000023ab436c9056be69277d1de70f
00:09:18:WU02:FS01:Starting
00:09:18:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 6936 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
00:09:18:WU02:FS01:Started FahCore on PID 7060
00:09:18:WU02:FS01:Core PID:5592
00:09:18:WU02:FS01:FahCore 0x21 started
00:09:19:WU02:FS01:0x21:*********************** Log Started 2016-05-11T00:09:18Z ***********************
00:09:19:WU02:FS01:0x21:Project: 13106 (Run 2, Clone 55, Gen 62)
00:09:19:WU02:FS01:0x21:Unit: 0x00000023ab436c9056be69277d1de70f
00:09:19:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
00:09:19:WU02:FS01:0x21:Machine: 1
00:09:19:WU02:FS01:0x21:Reading tar file core.xml
00:09:19:WU02:FS01:0x21:Reading tar file integrator.xml
00:09:19:WU02:FS01:0x21:Reading tar file state.xml
00:09:20:WU02:FS01:0x21:Reading tar file system.xml
00:09:22:WU02:FS01:0x21:Digital signatures verified
00:09:22:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
00:09:22:WU02:FS01:0x21:Version 0.0.17
00:09:25:WU01:FS01:Upload 48.85%
.....
00:13:38:WU01:FS01:Upload 60.54%
00:13:43:WU00:FS01:Upload 35.87%
00:13:43:WARNING:WU01:FS01:Exception: Failed to send results to work server: Transfer failed
00:13:43:WU01:FS01:Trying to send results to collection server
00:13:43:WU01:FS01:Uploading 14.97MiB to 171.65.103.160
00:13:43:WU01:FS01:Connecting to 171.65.103.160:8080
00:13:49:WU00:FS01:Upload 36.52%
00:13:51:WU01:FS01:Upload 0.84%
.....
00:20:07:WU00:FS01:Upload 67.82%
00:20:08:WU01:FS01:Upload 20.88%
00:20:10:WARNING:WU00:FS01:Exception: Failed to send results to work server: Transfer failed
00:20:10:WU00:FS01:Trying to send results to collection server
00:20:10:WU00:FS01:Uploading 9.58MiB to 171.65.103.160
00:20:10:WU00:FS01:Connecting to 171.65.103.160:8080
00:20:14:WU01:FS01:Upload 21.29%
00:20:18:WU00:FS01:Upload 1.30%
.....
00:28:40:WU00:FS01:Upload 43.04%
00:28:41:WU01:FS01:Upload 48.02%
00:28:45:ERROR:WU01:FS01:Exception: Transfer failed
00:28:45:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:7 clone:7 gen:285 core:0x21 unit:0x00000166ab404162553ebcc3ff4c850f
00:28:45:WU01:FS01:Uploading 14.97MiB to 171.64.65.98
00:28:45:WU01:FS01:Connecting to 171.64.65.98:8080
00:28:46:WU00:FS01:Upload 43.69%
00:28:53:WU01:FS01:Upload 0.84%
.....
00:34:18:WU01:FS01:Upload 15.87%
00:35:07:WU01:FS01:Upload 16.28%
00:35:07:WU00:FS01:Upload 67.17%
00:35:13:WU00:FS01:Upload 67.82%
00:35:13:ERROR:WU00:FS01:Exception: Transfer failed
00:35:13:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:9712 run:8 clone:6 gen:170 core:0x21 unit:0x000001d9ab40416255b9a7691240b0f8
00:35:13:WU00:FS01:Uploading 9.58MiB to 171.64.65.98
00:35:13:WU00:FS01:Connecting to 171.64.65.98:8080
00:35:14:WU01:FS01:Upload 16.70%
00:35:17:WU02:FS01:0x21:Completed 114400 out of 520000 steps (22%)
00:35:20:WU01:FS01:Upload 17.12%
00:35:25:WU00:FS01:Upload 1.30%
00:35:31:WU01:FS01:Upload 17.54%
.....
00:43:45:WU01:FS01:Upload 42.59%
00:43:46:WU00:FS01:Upload 39.13%
00:43:48:WARNING:WU01:FS01:Exception: Failed to send results to work server: Transfer failed
00:43:48:WU01:FS01:Trying to send results to collection server
00:43:48:WU01:FS01:Uploading 14.97MiB to 171.65.103.160
00:43:48:WU01:FS01:Connecting to 171.65.103.160:8080
00:43:52:WU00:FS01:Upload 39.78%
00:43:55:WU01:FS01:Upload 0.84%
.....
00:50:15:WU01:FS01:Upload 20.88%
00:50:16:WU00:FS01:Upload 71.08%
00:50:16:WARNING:WU00:FS01:Exception: Failed to send results to work server: Transfer failed
00:50:16:WU00:FS01:Trying to send results to collection server
00:50:16:WU00:FS01:Uploading 9.58MiB to 171.65.103.160
00:50:16:WU00:FS01:Connecting to 171.65.103.160:8080
00:50:21:WU01:FS01:Upload 21.29%
00:50:25:WU00:FS01:Upload 1.30%
.....
00:58:45:WU01:FS01:Upload 48.43%
00:58:51:WU01:FS01:Upload 48.85%
00:58:51:ERROR:WU01:FS01:Exception: Transfer failed
00:58:52:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:7 clone:7 gen:285 core:0x21 unit:0x00000166ab404162553ebcc3ff4c850f
00:58:52:WU01:FS01:Uploading 14.97MiB to 171.64.65.98
00:58:52:WU01:FS01:Connecting to 171.64.65.98:8080
00:58:52:WU00:FS01:Upload 43.04%
00:58:58:WU00:FS01:Upload 43.69%
00:59:01:WU01:FS01:Upload 0.84%
.....
01:05:13:WU01:FS01:Upload 21.29%
01:05:18:WU00:FS01:Upload 75.00%
01:05:19:ERROR:WU00:FS01:Exception: Transfer failed
01:05:19:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:9712 run:8 clone:6 gen:170 core:0x21 unit:0x000001d9ab40416255b9a7691240b0f8
01:05:19:WU00:FS01:Uploading 9.58MiB to 171.64.65.98
01:05:19:WU00:FS01:Connecting to 171.64.65.98:8080
01:05:20:WU01:FS01:Upload 21.71%
01:05:27:WU01:FS01:Upload 22.13%
.....
01:13:50:WU00:FS01:Upload 41.74%
01:13:51:WU01:FS01:Upload 48.02%
01:13:55:WARNING:WU01:FS01:Exception: Failed to send results to work server: Transfer failed
01:13:55:WU01:FS01:Trying to send results to collection server
01:13:55:WU01:FS01:Uploading 14.97MiB to 171.65.103.160
01:13:55:WU01:FS01:Connecting to 171.65.103.160:8080
01:13:56:WU00:FS01:Upload 42.39%
01:14:03:WU00:FS01:Upload 43.04%
01:14:03:WU01:FS01:Upload 0.84%
.....

What to do?

Post by **bruce** » Wed May 11, 2016 2:07 am

Project:9704 run:7 clone:7 gen:285 was successfully assigned to and completed by someone other than Kebast on 2016-05-10 16:05:44. Ordinarily a project is not assigned to another person unless (A) the first assignment expired or (B) the result of the first assignment was an error.

When was that WU initially assigned to you?

Is your GPU overclocked? If so, you may be producing corrupt results which will not be accepted by the server.

Kebast · Post by **Kebast** » Wed May 11, 2016 3:25 am

My GPU is actually underclocked by 100 mhz. Not sure when the WU was assigned. I can post the full log if you want.

Kebast · Post by **Kebast** » Wed May 11, 2016 3:26 am

Sorry, here it is:
2016-05-07T18:58:50Z

Post by **Joe_H** » Wed May 11, 2016 3:56 am

As best as I can tell, the uploads are failing at 15 minutes. That is the usual time limit on WS and CS for connection timing out. What kind of network connection do you have for uploading the WU's?

Post by **bruce** » Wed May 11, 2016 3:04 pm

Is your bandwidth shared with other internet activites which can be temporarily suspended to enable FAHClient to upload faster?

Have you set a value for max-packet-size (other than the default of 10)?

Kebast · Post by **Kebast** » Thu May 12, 2016 1:58 am

I should have a 3Mb DSL connection for upload (25 down, 3 up), but speed test only shows 18.5 / 1.6 currently. I haven't noticed any issue with internet here lately, and nothing much else would be outbound. I don't have any flags set in the slot configuration for this machine. Just the one GPU on default settings.

Post by **bruce** » Thu May 12, 2016 5:14 pm

Code: Select all

22:04:48:WU01:FS01:Uploading 14.97MiB to 171.64.65.98
22:04:48:WU01:FS01:Connecting to 171.64.65.98:8080
.....
22:19:55:WU01:FS01:Upload 91.02%

13.63MiB in 15:07

Maybe your connection is too slow or maybe there's a problem with the server.

I need to contact the owner of project 9704 because technically, they shouldn't be assigning WUs that produce 15MiB to upload with the default packet size of 10 ... either that or they have to change the Work Server's timeout .... , but that's not something you can do anything about.

Later, it looks like you successfully uploaded it to the Collection Server but it was then rejected. I think that might be a FAH system bug which I'll report. Again, you can't do anything about that.

Code: Select all

22:19:55:WU01:FS01:Uploading 14.97MiB to 171.65.103.160
22:19:55:WU01:FS01:Connecting to 171.65.103.160:8080
22:20:01:WU01:FS01:Upload 0.42%
.....
22:28:28:WU01:FS01:Upload 99.79%
22:28:34:WU01:FS01:Upload complete
22:28:34:WU01:FS01:Server responded PLEASE_WAIT (464)
22:28:34:WARNING:WU01:FS01:Failed to send results, will try again later

14.97 MiB in 8:33 to a different server, so it's probably a result of your limited line-speed.

Kebast · Post by **Kebast** » Thu May 12, 2016 7:16 pm

Thanks for the response. The other WU that was hung did successfully upload after I restarted the modem and machine, so the other likely just had issues and was completed elsewhere in the meantime. I'll keep folding on

Kebast · Post by **Kebast** » Sun May 22, 2016 2:42 pm

This happened again.
These two projects are currently stuck:
9704 (6, 1, 304)
9704 (25, 16, 143)

Code: Select all

*********************** Log Started 2016-05-22T14:36:30Z ***********************
14:36:30:************************* Folding@home Client *************************
14:36:30:      Website: http://folding.stanford.edu/
14:36:30:    Copyright: (c) 2009-2014 Stanford University
14:36:30:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:36:30:         Args: 
14:36:30:       Config: C:/ProgramData/FAHClient/config.xml
14:36:30:******************************** Build ********************************
14:36:30:      Version: 7.4.4
14:36:30:         Date: Mar 4 2014
14:36:30:         Time: 20:26:54
14:36:30:      SVN Rev: 4130
14:36:30:       Branch: fah/trunk/client
14:36:30:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
14:36:30:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
14:36:30:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
14:36:30:     Platform: win32 XP
14:36:30:         Bits: 32
14:36:30:         Mode: Release
14:36:30:******************************* System ********************************
14:36:30:          CPU: AMD FX(tm)-6300 Six-Core Processor
14:36:30:       CPU ID: AuthenticAMD Family 21 Model 2 Stepping 0
14:36:30:         CPUs: 6
14:36:30:       Memory: 7.97GiB
14:36:30:  Free Memory: 5.87GiB
14:36:30:      Threads: WINDOWS_THREADS
14:36:30:   OS Version: 6.2
14:36:30:  Has Battery: false
14:36:30:   On Battery: false
14:36:30:   UTC Offset: -4
14:36:30:          PID: 6376
14:36:30:          CWD: C:/ProgramData/FAHClient
14:36:30:           OS: Windows 10 Home
14:36:30:      OS Arch: AMD64
14:36:30:         GPUs: 1
14:36:30:        GPU 0: NVIDIA:5 GM204 [GeForce GTX 970]
14:36:30:         CUDA: 5.2
14:36:30:  CUDA Driver: 8000
14:36:30:Win32 Service: false
14:36:30:***********************************************************************
14:36:30:<config>
14:36:30:  <!-- HTTP Server -->
14:36:30:  <allow v='127.0.0.1,192.168.66.95-192.168.66.151'/>
14:36:30:
14:36:30:  <!-- Network -->
14:36:30:  <proxy v=':8080'/>
14:36:30:
14:36:30:  <!-- Remote Command Server -->
14:36:30:  <command-allow-no-pass v='127.0.0.1,192.168.66.95-192.168.66.151'/>
14:36:30:
14:36:30:  <!-- Slot Control -->
14:36:30:  <power v='full'/>
14:36:30:
14:36:30:  <!-- User Information -->
14:36:30:  <passkey v='********************************'/>
14:36:30:  <team v='229226'/>
14:36:30:  <user v='Kebast'/>
14:36:30:
14:36:30:  <!-- Work Unit Control -->
14:36:30:  <next-unit-percentage v='100'/>
14:36:30:
14:36:30:  <!-- Folding Slots -->
14:36:30:  <slot id='1' type='GPU'>
14:36:30:    <paused v='true'/>
14:36:30:  </slot>
14:36:30:</config>
14:36:30:Trying to access database...
14:36:30:Successfully acquired database lock
14:36:30:Enabled folding slot 01: PAUSED gpu:0:GM204 [GeForce GTX 970] (by user)
14:36:30:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:25 clone:16 gen:143 core:0x21 unit:0x000000d6ab404162553ebf9b6ddf5a8d
14:36:30:WU01:FS01:Uploading 14.98MiB to 171.64.65.98
14:36:30:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:9704 run:6 clone:1 gen:304 core:0x21 unit:0x00000190ab404162553ebc95d2368a89
14:36:30:WU01:FS01:Connecting to 171.64.65.98:8080
14:36:30:WU00:FS01:Uploading 14.98MiB to 171.64.65.98
14:36:30:WU00:FS01:Connecting to 171.64.65.98:8080
14:36:42:WU00:FS01:Upload 6.26%
14:36:50:WU00:FS01:Upload 6.68%
14:36:51:WU01:FS01:Upload 1.25%
14:36:54:FS01:Unpaused
14:36:54:WU02:FS01:Starting
14:36:54:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 6376 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
14:36:55:WU02:FS01:Started FahCore on PID 3096
14:36:55:WU02:FS01:Core PID:4180
14:36:55:WU02:FS01:FahCore 0x21 started
14:36:55:WU02:FS01:0x21:*********************** Log Started 2016-05-22T14:36:55Z ***********************
14:36:55:WU02:FS01:0x21:Project: 11407 (Run 6, Clone 22, Gen 13)
14:36:55:WU02:FS01:0x21:Unit: 0x0000000f8ca304f25686b27c70ff9a59
14:36:55:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
14:36:55:WU02:FS01:0x21:Machine: 1
14:36:55:WU02:FS01:0x21:Digital signatures verified
14:36:55:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
14:36:55:WU02:FS01:0x21:Version 0.0.17
14:36:56:WU02:FS01:0x21:  Found a checkpoint file
14:36:57:WU01:FS01:Upload 1.67%
14:37:04:WU00:FS01:Upload 7.51%
14:37:06:WU02:FS01:0x21:Completed 2625000 out of 5000000 steps (52%)
14:37:06:WU02:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
14:37:07:WU01:FS01:Upload 2.09%
14:37:13:WU01:FS01:Upload 2.50%
14:37:13:WU00:FS01:Upload 7.93%
14:37:20:WU01:FS01:Upload 2.92%
14:37:21:WU00:FS01:Upload 8.34%
14:37:26:WU01:FS01:Upload 3.34%
14:37:28:WU00:FS01:Upload 8.76%
14:37:31:Removing old file 'configs/config-20160513-042049.xml'
14:37:31:Saving configuration to config.xml
14:37:31:<config>
14:37:31:  <!-- HTTP Server -->
14:37:31:  <allow v='127.0.0.1,192.168.66.95-192.168.66.151'/>
14:37:31:
14:37:31:  <!-- Network -->
14:37:31:  <proxy v=':8080'/>
14:37:31:
14:37:31:  <!-- Remote Command Server -->
14:37:31:  <command-allow-no-pass v='127.0.0.1,192.168.66.95-192.168.66.151'/>
14:37:31:
14:37:31:  <!-- Slot Control -->
14:37:31:  <power v='full'/>
14:37:31:
14:37:31:  <!-- User Information -->
14:37:31:  <passkey v='********************************'/>
14:37:31:  <team v='229226'/>
14:37:31:  <user v='Kebast'/>
14:37:31:
14:37:31:  <!-- Work Unit Control -->
14:37:31:  <next-unit-percentage v='100'/>
14:37:31:
14:37:31:  <!-- Folding Slots -->
14:37:31:  <slot id='1' type='GPU'/>
14:37:31:</config>
14:37:32:WU01:FS01:Upload 3.76%
14:37:36:WU00:FS01:Upload 9.60%
14:37:45:WU00:FS01:Upload 10.01%
14:37:47:WU01:FS01:Upload 4.59%
14:37:54:WU00:FS01:Upload 10.43%
14:37:56:WU01:FS01:Upload 5.01%
14:38:05:WU01:FS01:Upload 5.42%
14:38:07:WU00:FS01:Upload 10.85%
14:38:19:WU00:FS01:Upload 11.68%
14:38:26:WU01:FS01:Upload 5.84%
14:38:32:WU01:FS01:Upload 6.26%
14:38:32:WU00:FS01:Upload 12.52%
14:38:39:WU01:FS01:Upload 6.68%
14:38:41:WU00:FS01:Upload 12.93%
14:38:47:WU01:FS01:Upload 7.09%
14:38:49:WU00:FS01:Upload 13.35%
14:38:53:WU02:FS01:0x21:Completed 2650000 out of 5000000 steps (53%)
14:38:53:WU01:FS01:Upload 7.51%
14:38:58:WU00:FS01:Upload 13.77%
14:39:01:WU01:FS01:Upload 7.93%
14:39:04:WU00:FS01:Upload 14.19%
14:39:08:WU01:FS01:Upload 9.18%
14:39:13:WU00:FS01:Upload 15.44%
14:39:14:WU01:FS01:Upload 10.01%
14:39:20:WU01:FS01:Upload 10.43%
14:39:22:WU00:FS01:Upload 16.27%
14:39:28:WU01:FS01:Upload 11.27%
14:39:30:WU00:FS01:Upload 17.11%
14:39:37:WU00:FS01:Upload 17.94%
14:39:38:WU01:FS01:Upload 12.52%
14:39:43:WU00:FS01:Upload 18.77%
14:39:47:WU01:FS01:Upload 13.35%
14:39:52:WU00:FS01:Upload 20.03%
14:39:53:WU01:FS01:Upload 14.19%
14:39:59:WU00:FS01:Upload 21.28%
14:39:59:WU01:FS01:Upload 15.44%
14:40:07:WU00:FS01:Upload 22.11%
14:40:08:WU01:FS01:Upload 16.27%
14:40:15:WU00:FS01:Upload 22.95%
14:40:16:WU01:FS01:Upload 17.11%
14:40:22:WU00:FS01:Upload 23.78%
14:40:23:WU01:FS01:Upload 17.94%

Post by **bruce** » Sun May 22, 2016 4:12 pm

You were a little stingy with the log. At the end of your post, both WU00 and WU01 were still actively uploading and there are no error messages. Please extend the post of your log.

Kebast · Post by **Kebast** » Sun May 22, 2016 5:44 pm

Sorry, this was a new log after I restarted. Here's the previous, I think I've captured enough to cover it:

Code: Select all

09:28:09:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9704 run:25 clone:16 gen:143 core:0x21 unit:0x000000d6ab404162553ebf9b6ddf5a8d
09:28:09:WU01:FS01:Starting
09:28:09:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 4108 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
09:28:09:WU01:FS01:Started FahCore on PID 3880
09:28:10:WU01:FS01:Core PID:3652
09:28:10:WU01:FS01:FahCore 0x21 started
09:28:10:WU01:FS01:0x21:*********************** Log Started 2016-05-21T09:28:10Z ***********************
09:28:10:WU01:FS01:0x21:Project: 9704 (Run 25, Clone 16, Gen 143)
09:28:10:WU01:FS01:0x21:Unit: 0x000000d6ab404162553ebf9b6ddf5a8d
09:28:10:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
09:28:10:WU01:FS01:0x21:Machine: 1
09:28:10:WU01:FS01:0x21:Reading tar file core.xml
09:28:10:WU01:FS01:0x21:Reading tar file system.xml
09:28:10:WU00:FS01:Upload 10.59%
09:28:14:WU01:FS01:0x21:Reading tar file integrator.xml
09:28:14:WU01:FS01:0x21:Reading tar file state.xml
09:28:16:WU01:FS01:0x21:Digital signatures verified
09:28:16:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
09:28:16:WU01:FS01:0x21:Version 0.0.17
09:28:19:WU00:FS01:Upload 11.65%
09:28:28:WU00:FS01:Upload 12.71%
09:28:37:WU00:FS01:Upload 13.77%
09:28:46:WU00:FS01:Upload 14.83%
09:28:55:WU00:FS01:Upload 15.89%
09:29:04:WU00:FS01:Upload 16.95%
09:29:13:WU00:FS01:Upload 18.01%
09:29:22:WU00:FS01:Upload 19.07%
09:29:31:WU00:FS01:Upload 20.13%
09:29:40:WU00:FS01:Upload 21.19%
09:29:49:WU00:FS01:Upload 22.25%
09:29:54:WU01:FS01:0x21:Completed 0 out of 640000 steps (0%)
09:29:54:WU01:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
09:29:58:WU00:FS01:Upload 23.31%
09:30:07:WU00:FS01:Upload 24.37%
09:30:16:WU00:FS01:Upload 25.43%
09:30:24:WU00:FS01:Upload 26.48%
09:30:33:WU00:FS01:Upload 27.54%
09:30:43:WU00:FS01:Upload 28.60%
09:30:52:WU00:FS01:Upload 29.66%
09:31:01:WU00:FS01:Upload 30.72%
09:31:10:WU00:FS01:Upload 31.78%
09:31:19:WU00:FS01:Upload 32.84%
09:31:27:WU00:FS01:Upload 33.90%
09:31:36:WU00:FS01:Upload 34.96%
09:31:44:WU00:FS01:Upload 36.02%
09:31:53:WU00:FS01:Upload 37.08%
09:32:02:WU00:FS01:Upload 38.14%
09:32:10:WU00:FS01:Upload 39.20%
09:32:16:WU01:FS01:0x21:Completed 6400 out of 640000 steps (1%)
09:32:18:WU00:FS01:Upload 40.26%
09:32:27:WU00:FS01:Upload 41.32%
09:32:35:WU00:FS01:Upload 42.38%
09:32:44:WU00:FS01:Upload 43.43%
09:32:52:WU00:FS01:Upload 44.49%
09:33:02:WU00:FS01:Upload 45.55%
09:33:11:WU00:FS01:Upload 46.61%
09:33:20:WU00:FS01:Upload 47.67%
09:33:28:WU00:FS01:Upload 48.73%
09:33:37:WU00:FS01:Upload 49.79%
09:33:46:WU00:FS01:Upload 50.85%
09:33:55:WU00:FS01:Upload 51.91%
09:34:03:WU00:FS01:Upload 52.97%
09:34:13:WU00:FS01:Upload 54.03%
09:34:21:WU00:FS01:Upload 55.09%
09:34:31:WU00:FS01:Upload 56.15%
09:34:36:WU01:FS01:0x21:Completed 12800 out of 640000 steps (2%)
09:34:40:WU00:FS01:Upload 57.21%
09:34:49:WU00:FS01:Upload 58.27%
09:34:58:WU00:FS01:Upload 59.33%
09:35:07:WU00:FS01:Upload 60.38%
09:35:16:WU00:FS01:Upload 61.44%
09:35:24:WU00:FS01:Upload 62.50%
09:35:32:WU00:FS01:Upload 63.56%
09:35:42:WU00:FS01:Upload 64.62%
09:35:51:WU00:FS01:Upload 65.68%
09:36:00:WU00:FS01:Upload 66.74%
09:36:08:WU00:FS01:Upload 67.80%
09:36:16:WU00:FS01:Upload 68.86%
09:36:23:WU00:FS01:Upload 69.92%
09:36:31:WU00:FS01:Upload 70.98%
09:36:39:WU00:FS01:Upload 72.04%
09:36:48:WU00:FS01:Upload 73.10%
09:36:56:WU00:FS01:Upload 74.16%
09:36:58:WU01:FS01:0x21:Completed 19200 out of 640000 steps (3%)
09:37:04:WU00:FS01:Upload 75.22%
09:37:12:WU00:FS01:Upload 76.28%
09:37:19:WU00:FS01:Upload 77.33%
09:37:29:WU00:FS01:Upload 78.39%
09:37:38:WU00:FS01:Upload 79.45%
09:37:45:WU00:FS01:Upload 80.51%
09:37:53:WU00:FS01:Upload 81.57%
09:38:01:WU00:FS01:Upload 82.63%
09:38:09:WU00:FS01:Upload 83.69%
09:38:17:WU00:FS01:Upload 84.75%
09:38:25:WU00:FS01:Upload 85.81%
09:38:33:WU00:FS01:Upload 86.87%
09:38:42:WU00:FS01:Upload 87.93%
09:38:51:WU00:FS01:Upload 88.99%
09:38:58:WU00:FS01:Upload 90.05%
09:39:06:WU00:FS01:Upload 91.11%
09:39:14:WU00:FS01:Upload 92.17%
09:39:19:WU01:FS01:0x21:Completed 25600 out of 640000 steps (4%)
09:39:21:WU00:FS01:Upload 93.23%
09:39:29:WU00:FS01:Upload 94.28%
09:39:37:WU00:FS01:Upload 95.34%
09:39:45:WU00:FS01:Upload 96.40%
09:39:52:WU00:FS01:Upload 97.46%
09:40:00:WU00:FS01:Upload 98.52%
09:40:08:WU00:FS01:Upload 99.58%
09:40:26:WU00:FS01:Upload complete
09:40:26:WU00:FS01:Server responded WORK_ACK (400)
09:40:26:WU00:FS01:Final credit estimate, 69005.00 points
09:40:26:WU00:FS01:Cleaning up
09:41:41:WU01:FS01:0x21:Completed 32000 out of 640000 steps (5%)
09:44:03:WU01:FS01:0x21:Completed 38400 out of 640000 steps (6%)
09:46:25:WU01:FS01:0x21:Completed 44800 out of 640000 steps (7%)
09:48:48:WU01:FS01:0x21:Completed 51200 out of 640000 steps (8%)
09:51:10:WU01:FS01:0x21:Completed 57600 out of 640000 steps (9%)
09:53:32:WU01:FS01:0x21:Completed 64000 out of 640000 steps (10%)
09:55:55:WU01:FS01:0x21:Completed 70400 out of 640000 steps (11%)
09:58:17:WU01:FS01:0x21:Completed 76800 out of 640000 steps (12%)
10:00:48:WU01:FS01:0x21:Completed 83200 out of 640000 steps (13%)
10:03:10:WU01:FS01:0x21:Completed 89600 out of 640000 steps (14%)
10:05:32:WU01:FS01:0x21:Completed 96000 out of 640000 steps (15%)
10:07:54:WU01:FS01:0x21:Completed 102400 out of 640000 steps (16%)
10:10:16:WU01:FS01:0x21:Completed 108800 out of 640000 steps (17%)
10:12:39:WU01:FS01:0x21:Completed 115200 out of 640000 steps (18%)
10:15:00:WU01:FS01:0x21:Completed 121600 out of 640000 steps (19%)
10:17:23:WU01:FS01:0x21:Completed 128000 out of 640000 steps (20%)
10:19:45:WU01:FS01:0x21:Completed 134400 out of 640000 steps (21%)
10:22:07:WU01:FS01:0x21:Completed 140800 out of 640000 steps (22%)
10:24:29:WU01:FS01:0x21:Completed 147200 out of 640000 steps (23%)
10:26:52:WU01:FS01:0x21:Completed 153600 out of 640000 steps (24%)
10:29:14:WU01:FS01:0x21:Completed 160000 out of 640000 steps (25%)
10:31:45:WU01:FS01:0x21:Completed 166400 out of 640000 steps (26%)
10:34:07:WU01:FS01:0x21:Completed 172800 out of 640000 steps (27%)
10:36:29:WU01:FS01:0x21:Completed 179200 out of 640000 steps (28%)
10:38:51:WU01:FS01:0x21:Completed 185600 out of 640000 steps (29%)
10:41:13:WU01:FS01:0x21:Completed 192000 out of 640000 steps (30%)
10:43:36:WU01:FS01:0x21:Completed 198400 out of 640000 steps (31%)
10:45:58:WU01:FS01:0x21:Completed 204800 out of 640000 steps (32%)
10:48:20:WU01:FS01:0x21:Completed 211200 out of 640000 steps (33%)
10:50:42:WU01:FS01:0x21:Completed 217600 out of 640000 steps (34%)
10:53:04:WU01:FS01:0x21:Completed 224000 out of 640000 steps (35%)
10:55:27:WU01:FS01:0x21:Completed 230400 out of 640000 steps (36%)
10:57:49:WU01:FS01:0x21:Completed 236800 out of 640000 steps (37%)
11:00:19:WU01:FS01:0x21:Completed 243200 out of 640000 steps (38%)
11:02:41:WU01:FS01:0x21:Completed 249600 out of 640000 steps (39%)
11:05:03:WU01:FS01:0x21:Completed 256000 out of 640000 steps (40%)
11:07:25:WU01:FS01:0x21:Completed 262400 out of 640000 steps (41%)
11:09:47:WU01:FS01:0x21:Completed 268800 out of 640000 steps (42%)
11:12:10:WU01:FS01:0x21:Completed 275200 out of 640000 steps (43%)
11:14:32:WU01:FS01:0x21:Completed 281600 out of 640000 steps (44%)
11:16:54:WU01:FS01:0x21:Completed 288000 out of 640000 steps (45%)
11:19:16:WU01:FS01:0x21:Completed 294400 out of 640000 steps (46%)
11:21:39:WU01:FS01:0x21:Completed 300800 out of 640000 steps (47%)
11:24:01:WU01:FS01:0x21:Completed 307200 out of 640000 steps (48%)
11:26:23:WU01:FS01:0x21:Completed 313600 out of 640000 steps (49%)
11:28:46:WU01:FS01:0x21:Completed 320000 out of 640000 steps (50%)
11:31:16:WU01:FS01:0x21:Completed 326400 out of 640000 steps (51%)
11:33:39:WU01:FS01:0x21:Completed 332800 out of 640000 steps (52%)
11:36:01:WU01:FS01:0x21:Completed 339200 out of 640000 steps (53%)
11:38:23:WU01:FS01:0x21:Completed 345600 out of 640000 steps (54%)
11:40:46:WU01:FS01:0x21:Completed 352000 out of 640000 steps (55%)
11:43:08:WU01:FS01:0x21:Completed 358400 out of 640000 steps (56%)
11:45:30:WU01:FS01:0x21:Completed 364800 out of 640000 steps (57%)
11:47:53:WU01:FS01:0x21:Completed 371200 out of 640000 steps (58%)
11:50:15:WU01:FS01:0x21:Completed 377600 out of 640000 steps (59%)
11:52:37:WU01:FS01:0x21:Completed 384000 out of 640000 steps (60%)
11:54:59:WU01:FS01:0x21:Completed 390400 out of 640000 steps (61%)
11:57:22:WU01:FS01:0x21:Completed 396800 out of 640000 steps (62%)
11:59:53:WU01:FS01:0x21:Completed 403200 out of 640000 steps (63%)
12:02:15:WU01:FS01:0x21:Completed 409600 out of 640000 steps (64%)
12:04:37:WU01:FS01:0x21:Completed 416000 out of 640000 steps (65%)
12:06:59:WU01:FS01:0x21:Completed 422400 out of 640000 steps (66%)
12:09:22:WU01:FS01:0x21:Completed 428800 out of 640000 steps (67%)
12:11:44:WU01:FS01:0x21:Completed 435200 out of 640000 steps (68%)
12:14:07:WU01:FS01:0x21:Completed 441600 out of 640000 steps (69%)
12:16:29:WU01:FS01:0x21:Completed 448000 out of 640000 steps (70%)
12:18:51:WU01:FS01:0x21:Completed 454400 out of 640000 steps (71%)
12:21:13:WU01:FS01:0x21:Completed 460800 out of 640000 steps (72%)
12:23:36:WU01:FS01:0x21:Completed 467200 out of 640000 steps (73%)
12:25:58:WU01:FS01:0x21:Completed 473600 out of 640000 steps (74%)
12:28:20:WU01:FS01:0x21:Completed 480000 out of 640000 steps (75%)
12:30:51:WU01:FS01:0x21:Completed 486400 out of 640000 steps (76%)
12:33:13:WU01:FS01:0x21:Completed 492800 out of 640000 steps (77%)
12:35:36:WU01:FS01:0x21:Completed 499200 out of 640000 steps (78%)
12:37:58:WU01:FS01:0x21:Completed 505600 out of 640000 steps (79%)
12:40:20:WU01:FS01:0x21:Completed 512000 out of 640000 steps (80%)
12:42:43:WU01:FS01:0x21:Completed 518400 out of 640000 steps (81%)
12:45:05:WU01:FS01:0x21:Completed 524800 out of 640000 steps (82%)
12:47:28:WU01:FS01:0x21:Completed 531200 out of 640000 steps (83%)
12:49:50:WU01:FS01:0x21:Completed 537600 out of 640000 steps (84%)
12:52:13:WU01:FS01:0x21:Completed 544000 out of 640000 steps (85%)
12:54:36:WU01:FS01:0x21:Completed 550400 out of 640000 steps (86%)
12:56:58:WU01:FS01:0x21:Completed 556800 out of 640000 steps (87%)
12:59:29:WU01:FS01:0x21:Completed 563200 out of 640000 steps (88%)
13:01:51:WU01:FS01:0x21:Completed 569600 out of 640000 steps (89%)
13:04:13:WU01:FS01:0x21:Completed 576000 out of 640000 steps (90%)
13:06:36:WU01:FS01:0x21:Completed 582400 out of 640000 steps (91%)
13:08:58:WU01:FS01:0x21:Completed 588800 out of 640000 steps (92%)
13:11:21:WU01:FS01:0x21:Completed 595200 out of 640000 steps (93%)
13:13:43:WU01:FS01:0x21:Completed 601600 out of 640000 steps (94%)
13:16:05:WU01:FS01:0x21:Completed 608000 out of 640000 steps (95%)
13:18:27:WU01:FS01:0x21:Completed 614400 out of 640000 steps (96%)
13:20:49:WU01:FS01:0x21:Completed 620800 out of 640000 steps (97%)
13:23:11:WU01:FS01:0x21:Completed 627200 out of 640000 steps (98%)
******************************* Date: 2016-05-21 *******************************
13:25:33:WU01:FS01:0x21:Completed 633600 out of 640000 steps (99%)
13:27:56:WU01:FS01:0x21:Completed 640000 out of 640000 steps (100%)
13:27:57:WU00:FS01:Connecting to 171.67.108.45:80
13:27:58:WU00:FS01:Assigned to work server 171.67.108.155
13:27:58:WU00:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GM204 [GeForce GTX 970] from 171.67.108.155
13:27:58:WU00:FS01:Connecting to 171.67.108.155:8080
13:27:59:WU00:FS01:Downloading 893.43KiB
13:28:00:WU00:FS01:Download complete
13:28:00:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9661 run:0 clone:5 gen:90 core:0x18 unit:0x00000066ab436c9b56de69ba5fdb9307
13:28:05:WU01:FS01:0x21:Saving result file logfile_01.txt
13:28:06:WU01:FS01:0x21:Saving result file checkpointState.xml
13:28:10:WU01:FS01:0x21:Saving result file checkpt.crc
13:28:10:WU01:FS01:0x21:Saving result file log.txt
13:28:10:WU01:FS01:0x21:Saving result file positions.xtc
13:28:11:WU01:FS01:0x21:Folding@home Core Shutdown: FINISHED_UNIT
13:28:12:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
13:28:12:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:25 clone:16 gen:143 core:0x21 unit:0x000000d6ab404162553ebf9b6ddf5a8d
13:28:12:WU01:FS01:Uploading 14.98MiB to 171.64.65.98
13:28:12:WU00:FS01:Starting
13:28:12:WU01:FS01:Connecting to 171.64.65.98:8080
13:28:12:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 00 -suffix 01 -version 704 -lifeline 4108 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
13:28:12:WU00:FS01:Started FahCore on PID 6424
13:28:12:WU00:FS01:Core PID:3208
13:28:12:WU00:FS01:FahCore 0x18 started
13:28:13:WU00:FS01:0x18:*********************** Log Started 2016-05-21T13:28:12Z ***********************
13:28:13:WU00:FS01:0x18:Project: 9661 (Run 0, Clone 5, Gen 90)
13:28:13:WU00:FS01:0x18:Unit: 0x00000066ab436c9b56de69ba5fdb9307
13:28:13:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
13:28:13:WU00:FS01:0x18:Machine: 1
13:28:13:WU00:FS01:0x18:Reading tar file core.xml
13:28:13:WU00:FS01:0x18:Reading tar file integrator.xml
13:28:13:WU00:FS01:0x18:Reading tar file state.xml
13:28:13:WU00:FS01:0x18:Reading tar file system.xml
13:28:13:WU00:FS01:0x18:Digital signatures verified
13:28:13:WU00:FS01:0x18:Folding@home GPU core18
13:28:13:WU00:FS01:0x18:Version 0.0.4
13:28:19:WU01:FS01:Upload 1.25%
13:28:24:WU00:FS01:0x18:Completed 0 out of 2000000 steps (0%)
13:28:25:WU00:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
13:28:27:WU01:FS01:Upload 2.09%
13:28:35:WU01:FS01:Upload 2.92%
13:28:43:WU01:FS01:Upload 3.76%
13:28:52:WU01:FS01:Upload 4.59%
13:29:00:WU01:FS01:Upload 5.42%
13:29:05:WU00:FS01:0x18:Completed 20000 out of 2000000 steps (1%)
13:29:08:WU01:FS01:Upload 6.26%
13:29:16:WU01:FS01:Upload 7.09%
13:29:24:WU01:FS01:Upload 7.93%
13:29:32:WU01:FS01:Upload 8.76%
13:29:39:WU01:FS01:Upload 9.60%
13:29:42:WU00:FS01:0x18:Completed 40000 out of 2000000 steps (2%)
13:29:47:WU01:FS01:Upload 10.43%
13:29:55:WU01:FS01:Upload 11.27%
13:30:02:WU01:FS01:Upload 12.10%
13:30:10:WU01:FS01:Upload 12.93%
13:30:18:WU01:FS01:Upload 13.77%
13:30:20:WU00:FS01:0x18:Completed 60000 out of 2000000 steps (3%)
13:30:25:WU01:FS01:Upload 14.60%
13:30:34:WU01:FS01:Upload 15.44%
13:30:41:WU01:FS01:Upload 16.27%
13:30:49:WU01:FS01:Upload 17.11%
13:30:57:WU00:FS01:0x18:Completed 80000 out of 2000000 steps (4%)
13:30:57:WU01:FS01:Upload 17.94%
13:31:04:WU01:FS01:Upload 18.78%
13:31:12:WU01:FS01:Upload 19.61%
13:31:20:WU01:FS01:Upload 20.45%
13:31:28:WU01:FS01:Upload 21.28%
13:31:34:WU00:FS01:0x18:Completed 100000 out of 2000000 steps (5%)
13:31:35:WU01:FS01:Upload 22.11%
13:31:43:WU01:FS01:Upload 22.95%
13:31:51:WU01:FS01:Upload 23.78%
13:31:58:WU01:FS01:Upload 24.62%
13:32:06:WU01:FS01:Upload 25.45%
13:32:15:WU01:FS01:Upload 26.29%
13:32:15:WU00:FS01:0x18:Completed 120000 out of 2000000 steps (6%)
13:32:23:WU01:FS01:Upload 27.12%
13:32:31:WU01:FS01:Upload 27.96%
13:32:39:WU01:FS01:Upload 28.79%
13:32:47:WU01:FS01:Upload 29.62%
13:32:52:WU00:FS01:0x18:Completed 140000 out of 2000000 steps (7%)
13:32:55:WU01:FS01:Upload 30.46%
13:33:03:WU01:FS01:Upload 31.29%
13:33:11:WU01:FS01:Upload 32.13%
13:33:20:WU01:FS01:Upload 32.96%
13:33:27:WU01:FS01:Upload 33.80%
13:33:29:WU00:FS01:0x18:Completed 160000 out of 2000000 steps (8%)
13:33:35:WU01:FS01:Upload 34.63%
13:33:43:WU01:FS01:Upload 35.47%
13:33:51:WU01:FS01:Upload 36.30%
13:33:59:WU01:FS01:Upload 37.14%
13:34:06:WU00:FS01:0x18:Completed 180000 out of 2000000 steps (9%)
13:34:07:WU01:FS01:Upload 37.97%
13:34:15:WU01:FS01:Upload 38.80%
13:34:23:WU01:FS01:Upload 39.64%
13:34:32:WU01:FS01:Upload 40.47%
13:34:40:WU01:FS01:Upload 41.31%
13:34:44:WU00:FS01:0x18:Completed 200000 out of 2000000 steps (10%)
13:34:48:WU01:FS01:Upload 42.14%
13:34:56:WU01:FS01:Upload 42.98%
13:35:04:WU01:FS01:Upload 43.81%
13:35:11:WU01:FS01:Upload 44.65%
13:35:19:WU01:FS01:Upload 45.48%
13:35:25:WU00:FS01:0x18:Completed 220000 out of 2000000 steps (11%)
13:35:27:WU01:FS01:Upload 46.31%
13:35:35:WU01:FS01:Upload 47.15%
13:35:42:WU01:FS01:Upload 47.98%
13:35:50:WU01:FS01:Upload 48.82%
13:35:58:WU01:FS01:Upload 49.65%
13:36:02:WU00:FS01:0x18:Completed 240000 out of 2000000 steps (12%)
13:36:06:WU01:FS01:Upload 50.49%
13:36:14:WU01:FS01:Upload 51.32%
13:36:22:WU01:FS01:Upload 52.16%
13:36:30:WU01:FS01:Upload 52.99%
13:36:38:WU01:FS01:Upload 53.83%
13:36:39:WU00:FS01:0x18:Completed 260000 out of 2000000 steps (13%)
13:36:46:WU01:FS01:Upload 54.66%
13:36:54:WU01:FS01:Upload 55.49%
13:37:02:WU01:FS01:Upload 56.33%
13:37:10:WU01:FS01:Upload 57.16%
13:37:17:WU00:FS01:0x18:Completed 280000 out of 2000000 steps (14%)
13:37:18:WU01:FS01:Upload 58.00%
13:37:26:WU01:FS01:Upload 58.83%
13:37:34:WU01:FS01:Upload 59.67%
13:37:41:WU01:FS01:Upload 60.50%
13:37:49:WU01:FS01:Upload 61.34%
13:37:54:WU00:FS01:0x18:Completed 300000 out of 2000000 steps (15%)
13:37:57:WU01:FS01:Upload 62.17%
13:38:05:WU01:FS01:Upload 63.01%
13:38:13:WU01:FS01:Upload 63.84%
13:38:21:WU01:FS01:Upload 64.67%
13:38:29:WU01:FS01:Upload 65.51%
13:38:35:WU00:FS01:0x18:Completed 320000 out of 2000000 steps (16%)
13:38:37:WU01:FS01:Upload 66.34%
13:38:45:WU01:FS01:Upload 67.18%
13:38:53:WU01:FS01:Upload 68.01%
13:39:01:WU01:FS01:Upload 68.85%
13:39:09:WU01:FS01:Upload 69.68%
13:39:12:WU00:FS01:0x18:Completed 340000 out of 2000000 steps (17%)
13:39:17:WU01:FS01:Upload 70.52%
13:39:25:WU01:FS01:Upload 71.35%
13:39:33:WU01:FS01:Upload 72.18%
13:39:41:WU01:FS01:Upload 73.02%
13:39:49:WU01:FS01:Upload 73.85%
13:39:49:WU00:FS01:0x18:Completed 360000 out of 2000000 steps (18%)
13:39:57:WU01:FS01:Upload 74.69%
13:40:05:WU01:FS01:Upload 75.52%
13:40:12:WU01:FS01:Upload 76.36%
13:40:20:WU01:FS01:Upload 77.19%
13:40:26:WU00:FS01:0x18:Completed 380000 out of 2000000 steps (19%)
13:40:28:WU01:FS01:Upload 78.03%
13:40:36:WU01:FS01:Upload 78.86%
13:40:44:WU01:FS01:Upload 79.70%
13:40:52:WU01:FS01:Upload 80.53%
13:41:00:WU01:FS01:Upload 81.36%
13:41:03:WU00:FS01:0x18:Completed 400000 out of 2000000 steps (20%)
13:41:09:WU01:FS01:Upload 82.20%
13:41:16:WU01:FS01:Upload 83.03%
13:41:24:WU01:FS01:Upload 83.87%
13:41:32:WU01:FS01:Upload 84.70%
13:41:40:WU01:FS01:Upload 85.54%
13:41:45:WU00:FS01:0x18:Completed 420000 out of 2000000 steps (21%)
13:41:48:WU01:FS01:Upload 86.37%
13:41:57:WU01:FS01:Upload 87.21%
13:42:04:WU01:FS01:Upload 88.04%
13:42:13:WU01:FS01:Upload 88.87%
13:42:21:WU01:FS01:Upload 89.71%
13:42:22:WU00:FS01:0x18:Completed 440000 out of 2000000 steps (22%)
13:42:29:WU01:FS01:Upload 90.54%
13:42:37:WU01:FS01:Upload 91.38%
13:42:46:WU01:FS01:Upload 92.21%
13:42:54:WU01:FS01:Upload 93.05%
13:42:59:WU00:FS01:0x18:Completed 460000 out of 2000000 steps (23%)
13:43:01:WU01:FS01:Upload 93.88%
13:43:09:WU01:FS01:Upload 94.72%
13:43:13:WARNING:WU01:FS01:Exception: Failed to send results to work server: Transfer failed
13:43:13:WU01:FS01:Trying to send results to collection server
13:43:13:WU01:FS01:Uploading 14.98MiB to 171.65.103.160
13:43:13:WU01:FS01:Connecting to 171.65.103.160:8080
13:43:20:WU01:FS01:Upload 1.25%
13:43:28:WU01:FS01:Upload 2.09%
13:43:35:WU01:FS01:Upload 2.92%
13:43:36:WU00:FS01:0x18:Completed 480000 out of 2000000 steps (24%)
13:43:44:WU01:FS01:Upload 3.76%
13:43:52:WU01:FS01:Upload 4.59%
13:43:59:WU01:FS01:Upload 5.42%
13:44:07:WU01:FS01:Upload 6.26%
13:44:13:WU00:FS01:0x18:Completed 500000 out of 2000000 steps (25%)
13:44:15:WU01:FS01:Upload 7.09%
13:44:23:WU01:FS01:Upload 7.93%
13:44:31:WU01:FS01:Upload 8.76%
13:44:39:WU01:FS01:Upload 9.60%
13:44:47:WU01:FS01:Upload 10.43%
13:44:54:WU00:FS01:0x18:Completed 520000 out of 2000000 steps (26%)
13:44:55:WU01:FS01:Upload 11.27%
13:45:03:WU01:FS01:Upload 12.10%
13:45:11:WU01:FS01:Upload 12.93%
13:45:19:WU01:FS01:Upload 13.77%
13:45:27:WU01:FS01:Upload 14.60%
13:45:31:WU00:FS01:0x18:Completed 540000 out of 2000000 steps (27%)
13:45:35:WU01:FS01:Upload 15.44%
13:45:42:WU01:FS01:Upload 16.27%
13:45:50:WU01:FS01:Upload 17.11%
13:45:58:WU01:FS01:Upload 17.94%
13:46:06:WU01:FS01:Upload 18.78%
13:46:09:WU00:FS01:0x18:Completed 560000 out of 2000000 steps (28%)
13:46:14:WU01:FS01:Upload 19.61%
13:46:22:WU01:FS01:Upload 20.45%
13:46:30:WU01:FS01:Upload 21.28%
13:46:38:WU01:FS01:Upload 22.11%
13:46:46:WU00:FS01:0x18:Completed 580000 out of 2000000 steps (29%)
13:46:46:WU01:FS01:Upload 22.95%
13:46:54:WU01:FS01:Upload 23.78%
13:47:02:WU01:FS01:Upload 24.62%
13:47:10:WU01:FS01:Upload 25.45%
13:47:18:WU01:FS01:Upload 26.29%
13:47:23:WU00:FS01:0x18:Completed 600000 out of 2000000 steps (30%)
13:47:26:WU01:FS01:Upload 27.12%
13:47:33:WU01:FS01:Upload 27.96%
13:47:41:WU01:FS01:Upload 28.79%
13:47:49:WU01:FS01:Upload 29.62%
13:47:56:WU01:FS01:Upload 30.46%
13:48:04:WU01:FS01:Upload 31.29%
13:48:04:WU00:FS01:0x18:Completed 620000 out of 2000000 steps (31%)
13:48:12:WU01:FS01:Upload 32.13%
13:48:19:WU01:FS01:Upload 32.96%
13:48:27:WU01:FS01:Upload 33.80%
13:48:35:WU01:FS01:Upload 34.63%
13:48:41:WU00:FS01:0x18:Completed 640000 out of 2000000 steps (32%)
13:48:43:WU01:FS01:Upload 35.47%
13:48:50:WU01:FS01:Upload 36.30%
13:48:58:WU01:FS01:Upload 37.14%
13:49:05:WU01:FS01:Upload 37.97%
13:49:13:WU01:FS01:Upload 38.80%
13:49:18:WU00:FS01:0x18:Completed 660000 out of 2000000 steps (33%)
13:49:21:WU01:FS01:Upload 39.64%
13:49:29:WU01:FS01:Upload 40.47%
13:49:37:WU01:FS01:Upload 41.31%
13:49:45:WU01:FS01:Upload 42.14%
13:49:54:WU01:FS01:Upload 42.98%
13:49:55:WU00:FS01:0x18:Completed 680000 out of 2000000 steps (34%)
13:50:01:WU01:FS01:Upload 43.81%
13:50:09:WU01:FS01:Upload 44.65%
13:50:17:WU01:FS01:Upload 45.48%
13:50:25:WU01:FS01:Upload 46.31%
13:50:32:WU00:FS01:0x18:Completed 700000 out of 2000000 steps (35%)
13:50:33:WU01:FS01:Upload 47.15%
13:50:41:WU01:FS01:Upload 47.98%
13:50:49:WU01:FS01:Upload 48.82%
13:50:57:WU01:FS01:Upload 49.65%
13:51:05:WU01:FS01:Upload 50.49%
13:51:13:WU01:FS01:Upload 51.32%
13:51:14:WU00:FS01:0x18:Completed 720000 out of 2000000 steps (36%)
13:51:21:WU01:FS01:Upload 52.16%
13:51:29:WU01:FS01:Upload 52.99%
13:51:37:WU01:FS01:Upload 53.83%
13:51:45:WU01:FS01:Upload 54.66%
13:51:51:WU00:FS01:0x18:Completed 740000 out of 2000000 steps (37%)
13:51:53:WU01:FS01:Upload 55.49%
13:52:00:WU01:FS01:Upload 56.33%
13:52:08:WU01:FS01:Upload 57.16%
13:52:16:WU01:FS01:Upload 58.00%
13:52:23:WU01:FS01:Upload 58.83%
13:52:28:WU00:FS01:0x18:Completed 760000 out of 2000000 steps (38%)
13:52:31:WU01:FS01:Upload 59.67%
13:52:39:WU01:FS01:Upload 60.50%
13:52:47:WU01:FS01:Upload 61.34%
13:52:55:WU01:FS01:Upload 62.17%
13:53:02:WU01:FS01:Upload 63.01%
13:53:05:WU00:FS01:0x18:Completed 780000 out of 2000000 steps (39%)
13:53:10:WU01:FS01:Upload 63.84%
13:53:18:WU01:FS01:Upload 64.67%
13:53:26:WU01:FS01:Upload 65.51%
13:53:34:WU01:FS01:Upload 66.34%
13:53:42:WU01:FS01:Upload 67.18%
13:53:42:WU00:FS01:0x18:Completed 800000 out of 2000000 steps (40%)
13:53:50:WU01:FS01:Upload 68.01%
13:53:57:WU01:FS01:Upload 68.85%
13:54:06:WU01:FS01:Upload 69.68%
13:54:13:WU01:FS01:Upload 70.52%
13:54:21:WU01:FS01:Upload 71.35%
13:54:24:WU00:FS01:0x18:Completed 820000 out of 2000000 steps (41%)
13:54:29:WU01:FS01:Upload 72.18%
13:54:37:WU01:FS01:Upload 73.02%
13:54:45:WU01:FS01:Upload 73.85%
13:54:53:WU01:FS01:Upload 74.69%
13:55:00:WU00:FS01:0x18:Completed 840000 out of 2000000 steps (42%)
13:55:01:WU01:FS01:Upload 75.52%
13:55:09:WU01:FS01:Upload 76.36%
13:55:17:WU01:FS01:Upload 77.19%
13:55:25:WU01:FS01:Upload 78.03%
13:55:33:WU01:FS01:Upload 78.86%
13:55:38:WU00:FS01:0x18:Completed 860000 out of 2000000 steps (43%)
13:55:41:WU01:FS01:Upload 79.70%
13:55:49:WU01:FS01:Upload 80.53%
13:55:56:WU01:FS01:Upload 81.36%
13:56:05:WU01:FS01:Upload 82.20%
13:56:13:WU01:FS01:Upload 83.03%
13:56:15:WU00:FS01:0x18:Completed 880000 out of 2000000 steps (44%)
13:56:21:WU01:FS01:Upload 83.87%
13:56:29:WU01:FS01:Upload 84.70%
13:56:37:WU01:FS01:Upload 85.54%
13:56:44:WU01:FS01:Upload 86.37%
13:56:52:WU01:FS01:Upload 87.21%
13:56:52:WU00:FS01:0x18:Completed 900000 out of 2000000 steps (45%)
13:57:00:WU01:FS01:Upload 88.04%
13:57:08:WU01:FS01:Upload 88.87%
13:57:16:WU01:FS01:Upload 89.71%
13:57:25:WU01:FS01:Upload 90.54%
13:57:32:WU01:FS01:Upload 91.38%
13:57:33:WU00:FS01:0x18:Completed 920000 out of 2000000 steps (46%)
13:57:41:WU01:FS01:Upload 92.21%
13:57:48:WU01:FS01:Upload 93.05%
13:57:56:WU01:FS01:Upload 93.88%
13:58:04:WU01:FS01:Upload 94.72%
13:58:10:WU00:FS01:0x18:Completed 940000 out of 2000000 steps (47%)
13:58:12:WU01:FS01:Upload 95.55%
13:58:14:ERROR:WU01:FS01:Exception: Transfer failed
13:58:15:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:25 clone:16 gen:143 core:0x21 unit:0x000000d6ab404162553ebf9b6ddf5a8d
13:58:15:WU01:FS01:Uploading 14.98MiB to 171.64.65.98
13:58:15:WU01:FS01:Connecting to 171.64.65.98:8080
13:58:22:WU01:FS01:Upload 1.25%
13:58:30:WU01:FS01:Upload 2.09%
13:58:37:WU01:FS01:Upload 2.92%
13:58:46:WU01:FS01:Upload 3.76%
13:58:48:WU00:FS01:0x18:Completed 960000 out of 2000000 steps (48%)
13:58:54:WU01:FS01:Upload 4.59%
13:59:02:WU01:FS01:Upload 5.42%
13:59:10:WU01:FS01:Upload 6.26%
13:59:18:WU01:FS01:Upload 7.09%
13:59:25:WU00:FS01:0x18:Completed 980000 out of 2000000 steps (49%)
13:59:26:WU01:FS01:Upload 7.93%
13:59:34:WU01:FS01:Upload 8.76%
13:59:42:WU01:FS01:Upload 9.60%
13:59:50:WU01:FS01:Upload 10.43%
13:59:59:WU01:FS01:Upload 11.27%
14:00:02:WU00:FS01:0x18:Completed 1000000 out of 2000000 steps (50%)
14:00:06:WU01:FS01:Upload 12.10%
14:00:13:WU01:FS01:Upload 12.93%
14:00:22:WU01:FS01:Upload 13.77%
14:00:31:WU01:FS01:Upload 14.60%
14:00:38:WU01:FS01:Upload 15.44%
14:00:43:WU00:FS01:0x18:Completed 1020000 out of 2000000 steps (51%)
14:00:45:WU01:FS01:Upload 16.27%
14:00:54:WU01:FS01:Upload 17.11%
14:01:02:WU01:FS01:Upload 17.94%
14:01:10:WU01:FS01:Upload 18.78%
14:01:18:WU01:FS01:Upload 19.61%
14:01:20:WU00:FS01:0x18:Completed 1040000 out of 2000000 steps (52%)
14:01:25:WU01:FS01:Upload 20.45%
14:01:34:WU01:FS01:Upload 21.28%
14:01:42:WU01:FS01:Upload 22.11%
14:01:50:WU01:FS01:Upload 22.95%
14:01:58:WU00:FS01:0x18:Completed 1060000 out of 2000000 steps (53%)
14:01:58:WU01:FS01:Upload 23.78%
14:02:06:WU01:FS01:Upload 24.62%
14:02:15:WU01:FS01:Upload 25.45%
14:02:22:WU01:FS01:Upload 26.29%
14:02:30:WU01:FS01:Upload 27.12%
14:02:35:WU00:FS01:0x18:Completed 1080000 out of 2000000 steps (54%)
14:02:38:WU01:FS01:Upload 27.96%
14:02:45:WU01:FS01:Upload 28.79%
14:02:54:WU01:FS01:Upload 29.62%
14:03:03:WU01:FS01:Upload 30.46%
14:03:12:WU00:FS01:0x18:Completed 1100000 out of 2000000 steps (55%)
14:03:12:WU01:FS01:Upload 31.29%
14:03:21:WU01:FS01:Upload 32.13%
14:03:29:WU01:FS01:Upload 32.96%
14:03:37:WU01:FS01:Upload 33.80%
14:03:45:WU01:FS01:Upload 34.63%
14:03:53:WU01:FS01:Upload 35.47%
14:03:53:WU00:FS01:0x18:Completed 1120000 out of 2000000 steps (56%)
14:04:01:WU01:FS01:Upload 36.30%
14:04:09:WU01:FS01:Upload 37.14%
14:04:17:WU01:FS01:Upload 37.97%
14:04:25:WU01:FS01:Upload 38.80%
14:04:30:WU00:FS01:0x18:Completed 1140000 out of 2000000 steps (57%)
14:04:33:WU01:FS01:Upload 39.64%
14:04:41:WU01:FS01:Upload 40.47%
14:04:50:WU01:FS01:Upload 41.31%
14:05:00:WU01:FS01:Upload 42.14%
14:05:08:WU00:FS01:0x18:Completed 1160000 out of 2000000 steps (58%)
14:05:08:WU01:FS01:Upload 42.98%
14:05:16:WU01:FS01:Upload 43.81%
14:05:25:WU01:FS01:Upload 44.65%
14:05:33:WU01:FS01:Upload 45.48%
14:05:41:WU01:FS01:Upload 46.31%
14:05:45:WU00:FS01:0x18:Completed 1180000 out of 2000000 steps (59%)
14:05:48:WU01:FS01:Upload 47.15%
14:05:56:WU01:FS01:Upload 47.98%
14:06:04:WU01:FS01:Upload 48.82%
14:06:12:WU01:FS01:Upload 49.65%
14:06:21:WU01:FS01:Upload 50.49%
14:06:22:WU00:FS01:0x18:Completed 1200000 out of 2000000 steps (60%)
14:06:27:WU01:FS01:Upload 51.32%
14:06:35:WU01:FS01:Upload 52.16%
14:06:43:WU01:FS01:Upload 52.99%
14:06:52:WU01:FS01:Upload 53.83%
14:07:01:WU01:FS01:Upload 54.66%
14:07:03:WU00:FS01:0x18:Completed 1220000 out of 2000000 steps (61%)
14:07:08:WU01:FS01:Upload 55.49%
14:07:17:WU01:FS01:Upload 56.33%
14:07:24:WU01:FS01:Upload 57.16%
14:07:32:WU01:FS01:Upload 58.00%
14:07:40:WU00:FS01:0x18:Completed 1240000 out of 2000000 steps (62%)
14:07:40:WU01:FS01:Upload 58.83%
14:07:48:WU01:FS01:Upload 59.67%
14:07:56:WU01:FS01:Upload 60.50%
14:08:04:WU01:FS01:Upload 61.34%
14:08:12:WU01:FS01:Upload 62.17%
14:08:17:WU00:FS01:0x18:Completed 1260000 out of 2000000 steps (63%)
14:08:20:WU01:FS01:Upload 63.01%
14:08:28:WU01:FS01:Upload 63.84%
14:08:36:WU01:FS01:Upload 64.67%
14:08:44:WU01:FS01:Upload 65.51%
14:08:52:WU01:FS01:Upload 66.34%
14:08:55:WU00:FS01:0x18:Completed 1280000 out of 2000000 steps (64%)
14:08:59:WU01:FS01:Upload 67.18%
14:09:06:WU01:FS01:Upload 68.01%
14:09:14:WU01:FS01:Upload 68.85%
14:09:22:WU01:FS01:Upload 69.68%
14:09:29:WU01:FS01:Upload 70.52%
14:09:32:WU00:FS01:0x18:Completed 1300000 out of 2000000 steps (65%)
14:09:37:WU01:FS01:Upload 71.35%
14:09:45:WU01:FS01:Upload 72.18%
14:09:53:WU01:FS01:Upload 73.02%
14:10:01:WU01:FS01:Upload 73.85%
14:10:09:WU01:FS01:Upload 74.69%
14:10:13:WU00:FS01:0x18:Completed 1320000 out of 2000000 steps (66%)
14:10:17:WU01:FS01:Upload 75.52%
14:10:25:WU01:FS01:Upload 76.36%
14:10:34:WU01:FS01:Upload 77.19%
14:10:41:WU01:FS01:Upload 78.03%
14:10:49:WU01:FS01:Upload 78.86%
14:10:50:WU00:FS01:0x18:Completed 1340000 out of 2000000 steps (67%)
14:10:57:WU01:FS01:Upload 79.70%
14:11:05:WU01:FS01:Upload 80.53%
14:11:13:WU01:FS01:Upload 81.36%
14:11:21:WU01:FS01:Upload 82.20%
14:11:27:WU00:FS01:0x18:Completed 1360000 out of 2000000 steps (68%)
14:11:29:WU01:FS01:Upload 83.03%
14:11:37:WU01:FS01:Upload 83.87%
14:11:45:WU01:FS01:Upload 84.70%
14:11:53:WU01:FS01:Upload 85.54%
14:12:00:WU01:FS01:Upload 86.37%
14:12:04:WU00:FS01:0x18:Completed 1380000 out of 2000000 steps (69%)
14:12:09:WU01:FS01:Upload 87.21%
14:12:17:WU01:FS01:Upload 88.04%
14:12:25:WU01:FS01:Upload 88.87%
14:12:33:WU01:FS01:Upload 89.71%
14:12:40:WU01:FS01:Upload 90.54%
14:12:41:WU00:FS01:0x18:Completed 1400000 out of 2000000 steps (70%)
14:12:48:WU01:FS01:Upload 91.38%
14:12:57:WU01:FS01:Upload 92.21%
14:13:04:WU01:FS01:Upload 93.05%
14:13:13:WU01:FS01:Upload 93.88%
14:13:16:WARNING:WU01:FS01:Exception: Failed to send results to work server: Transfer failed
14:13:16:WU01:FS01:Trying to send results to collection server
14:13:16:WU01:FS01:Uploading 14.98MiB to 171.65.103.160
14:13:16:WU01:FS01:Connecting to 171.65.103.160:8080
14:13:23:WU00:FS01:0x18:Completed 1420000 out of 2000000 steps (71%)
14:13:23:WU01:FS01:Upload 1.25%
14:13:32:WU01:FS01:Upload 2.09%
14:13:40:WU01:FS01:Upload 2.92%
14:13:48:WU01:FS01:Upload 3.76%
14:13:56:WU01:FS01:Upload 4.59%
14:14:00:WU00:FS01:0x18:Completed 1440000 out of 2000000 steps (72%)
14:14:03:WU01:FS01:Upload 5.42%
14:14:11:WU01:FS01:Upload 6.26%
14:14:20:WU01:FS01:Upload 7.09%
14:14:28:WU01:FS01:Upload 7.93%
14:14:36:WU01:FS01:Upload 8.76%
14:14:37:WU00:FS01:0x18:Completed 1460000 out of 2000000 steps (73%)
14:14:43:WU01:FS01:Upload 9.60%
14:14:51:WU01:FS01:Upload 10.43%
14:14:59:WU01:FS01:Upload 11.27%
14:15:07:WU01:FS01:Upload 12.10%
14:15:14:WU00:FS01:0x18:Completed 1480000 out of 2000000 steps (74%)
14:15:15:WU01:FS01:Upload 12.93%
14:15:23:WU01:FS01:Upload 13.77%
14:15:30:WU01:FS01:Upload 14.60%
14:15:37:WU01:FS01:Upload 15.44%
14:15:45:WU01:FS01:Upload 16.27%
14:15:51:WU00:FS01:0x18:Completed 1500000 out of 2000000 steps (75%)
14:15:53:WU01:FS01:Upload 17.11%
14:16:01:WU01:FS01:Upload 17.94%
14:16:08:WU01:FS01:Upload 18.78%
14:16:16:WU01:FS01:Upload 19.61%
14:16:24:WU01:FS01:Upload 20.45%
14:16:32:WU01:FS01:Upload 21.28%
14:16:33:WU00:FS01:0x18:Completed 1520000 out of 2000000 steps (76%)
14:16:40:WU01:FS01:Upload 22.11%
14:16:48:WU01:FS01:Upload 22.95%
14:16:56:WU01:FS01:Upload 23.78%
14:17:04:WU01:FS01:Upload 24.62%
14:17:10:WU00:FS01:0x18:Completed 1540000 out of 2000000 steps (77%)
14:17:13:WU01:FS01:Upload 25.45%
14:17:20:WU01:FS01:Upload 26.29%
14:17:28:WU01:FS01:Upload 27.12%
14:17:36:WU01:FS01:Upload 27.96%
14:17:44:WU01:FS01:Upload 28.79%
14:17:47:WU00:FS01:0x18:Completed 1560000 out of 2000000 steps (78%)
14:17:52:WU01:FS01:Upload 29.62%
14:18:00:WU01:FS01:Upload 30.46%
14:18:08:WU01:FS01:Upload 31.29%
14:18:16:WU01:FS01:Upload 32.13%
14:18:24:WU00:FS01:0x18:Completed 1580000 out of 2000000 steps (79%)
14:18:24:WU01:FS01:Upload 32.96%
14:18:32:WU01:FS01:Upload 33.80%
14:18:40:WU01:FS01:Upload 34.63%
14:18:49:WU01:FS01:Upload 35.47%
14:18:56:WU01:FS01:Upload 36.30%
14:19:01:WU00:FS01:0x18:Completed 1600000 out of 2000000 steps (80%)
14:19:05:WU01:FS01:Upload 37.14%
14:19:12:WU01:FS01:Upload 37.97%
14:19:20:WU01:FS01:Upload 38.80%
14:19:28:WU01:FS01:Upload 39.64%
14:19:36:WU01:FS01:Upload 40.47%
14:19:42:WU00:FS01:0x18:Completed 1620000 out of 2000000 steps (81%)
14:19:44:WU01:FS01:Upload 41.31%
14:19:52:WU01:FS01:Upload 42.14%
14:20:00:WU01:FS01:Upload 42.98%
14:20:08:WU01:FS01:Upload 43.81%
14:20:16:WU01:FS01:Upload 44.65%
14:20:20:WU00:FS01:0x18:Completed 1640000 out of 2000000 steps (82%)
14:20:24:WU01:FS01:Upload 45.48%
14:20:32:WU01:FS01:Upload 46.31%
14:20:41:WU01:FS01:Upload 47.15%
14:20:49:WU01:FS01:Upload 47.98%
14:20:57:WU00:FS01:0x18:Completed 1660000 out of 2000000 steps (83%)
14:20:57:WU01:FS01:Upload 48.82%
14:21:05:WU01:FS01:Upload 49.65%
14:21:13:WU01:FS01:Upload 50.49%
14:21:21:WU01:FS01:Upload 51.32%
14:21:29:WU01:FS01:Upload 52.16%
14:21:34:WU00:FS01:0x18:Completed 1680000 out of 2000000 steps (84%)
14:21:37:WU01:FS01:Upload 52.99%
14:21:45:WU01:FS01:Upload 53.83%
14:21:53:WU01:FS01:Upload 54.66%
14:22:00:WU01:FS01:Upload 55.49%
14:22:08:WU01:FS01:Upload 56.33%
14:22:11:WU00:FS01:0x18:Completed 1700000 out of 2000000 steps (85%)
14:22:16:WU01:FS01:Upload 57.16%
14:22:24:WU01:FS01:Upload 58.00%
14:22:32:WU01:FS01:Upload 58.83%
14:22:40:WU01:FS01:Upload 59.67%
14:22:48:WU01:FS01:Upload 60.50%
14:22:52:WU00:FS01:0x18:Completed 1720000 out of 2000000 steps (86%)
14:22:56:WU01:FS01:Upload 61.34%
14:23:04:WU01:FS01:Upload 62.17%
14:23:11:WU01:FS01:Upload 63.01%
14:23:19:WU01:FS01:Upload 63.84%
14:23:27:WU01:FS01:Upload 64.67%
14:23:30:WU00:FS01:0x18:Completed 1740000 out of 2000000 steps (87%)
14:23:35:WU01:FS01:Upload 65.51%
14:23:43:WU01:FS01:Upload 66.34%
14:23:51:WU01:FS01:Upload 67.18%
14:23:58:WU01:FS01:Upload 68.01%
14:24:06:WU01:FS01:Upload 68.85%
14:24:07:WU00:FS01:0x18:Completed 1760000 out of 2000000 steps (88%)
14:24:14:WU01:FS01:Upload 69.68%
14:24:22:WU01:FS01:Upload 70.52%
14:24:31:WU01:FS01:Upload 71.35%
14:24:37:WU01:FS01:Upload 72.18%
14:24:44:WU00:FS01:0x18:Completed 1780000 out of 2000000 steps (89%)
14:24:45:WU01:FS01:Upload 73.02%
14:24:53:WU01:FS01:Upload 73.85%
14:25:01:WU01:FS01:Upload 74.69%
14:25:09:WU01:FS01:Upload 75.52%
14:25:17:WU01:FS01:Upload 76.36%
14:25:21:WU00:FS01:0x18:Completed 1800000 out of 2000000 steps (90%)
14:25:25:WU01:FS01:Upload 77.19%
14:25:33:WU01:FS01:Upload 78.03%
14:25:40:WU01:FS01:Upload 78.86%
14:25:48:WU01:FS01:Upload 79.70%
14:25:56:WU01:FS01:Upload 80.53%
14:26:02:WU00:FS01:0x18:Completed 1820000 out of 2000000 steps (91%)
14:26:04:WU01:FS01:Upload 81.36%
14:26:12:WU01:FS01:Upload 82.20%
14:26:19:WU01:FS01:Upload 83.03%
14:26:27:WU01:FS01:Upload 83.87%
14:26:35:WU01:FS01:Upload 84.70%
14:26:39:WU00:FS01:0x18:Completed 1840000 out of 2000000 steps (92%)
14:26:43:WU01:FS01:Upload 85.54%
14:26:51:WU01:FS01:Upload 86.37%
14:26:59:WU01:FS01:Upload 87.21%
14:27:07:WU01:FS01:Upload 88.04%
14:27:15:WU01:FS01:Upload 88.87%
14:27:17:WU00:FS01:0x18:Completed 1860000 out of 2000000 steps (93%)
14:27:23:WU01:FS01:Upload 89.71%
14:27:31:WU01:FS01:Upload 90.54%
14:27:39:WU01:FS01:Upload 91.38%
14:27:47:WU01:FS01:Upload 92.21%
14:27:54:WU00:FS01:0x18:Completed 1880000 out of 2000000 steps (94%)
14:27:55:WU01:FS01:Upload 93.05%
14:28:03:WU01:FS01:Upload 93.88%
14:28:11:WU01:FS01:Upload 94.72%
14:28:18:WU01:FS01:Upload 95.55%
14:28:18:ERROR:WU01:FS01:Exception: Transfer failed
14:28:18:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:25 clone:16 gen:143 core:0x21 unit:0x000000d6ab404162553ebf9b6ddf5a8d
14:28:18:WU01:FS01:Uploading 14.98MiB to 171.64.65.98
14:28:18:WU01:FS01:Connecting to 171.64.65.98:8080
14:28:25:WU01:FS01:Upload 1.25%
14:28:31:WU00:FS01:0x18:Completed 1900000 out of 2000000 steps (95%)
14:28:33:WU01:FS01:Upload 2.09%
14:28:41:WU01:FS01:Upload 2.92%
14:28:48:WU01:FS01:Upload 3.76%
14:28:57:WU01:FS01:Upload 4.59%
14:29:05:WU01:FS01:Upload 5.42%
14:29:12:WU00:FS01:0x18:Completed 1920000 out of 2000000 steps (96%)
14:29:13:WU01:FS01:Upload 6.26%
14:29:21:WU01:FS01:Upload 7.09%
14:29:28:WU01:FS01:Upload 7.93%
14:29:37:WU01:FS01:Upload 8.76%
14:29:45:WU01:FS01:Upload 9.60%
14:29:49:WU00:FS01:0x18:Completed 1940000 out of 2000000 steps (97%)
14:29:53:WU01:FS01:Upload 10.43%
14:30:01:WU01:FS01:Upload 11.27%
14:30:09:WU01:FS01:Upload 12.10%
14:30:18:WU01:FS01:Upload 12.93%
14:30:26:WU01:FS01:Upload 13.77%
14:30:27:WU00:FS01:0x18:Completed 1960000 out of 2000000 steps (98%)
14:30:34:WU01:FS01:Upload 14.60%
14:30:43:WU01:FS01:Upload 15.44%
14:30:51:WU01:FS01:Upload 16.27%
14:30:59:WU01:FS01:Upload 17.11%
14:31:04:WU00:FS01:0x18:Completed 1980000 out of 2000000 steps (99%)
14:31:07:WU01:FS01:Upload 17.94%
14:31:15:WU01:FS01:Upload 18.78%
14:31:23:WU01:FS01:Upload 19.61%
14:31:31:WU01:FS01:Upload 20.45%
14:31:39:WU01:FS01:Upload 21.28%
14:31:41:WU00:FS01:0x18:Completed 2000000 out of 2000000 steps (100%)
14:31:42:WU02:FS01:Connecting to 171.67.108.45:80
14:31:43:WU02:FS01:Assigned to work server 171.67.108.157
14:31:43:WU02:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GM204 [GeForce GTX 970] from 171.67.108.157
14:31:43:WU02:FS01:Connecting to 171.67.108.157:8080
14:31:45:WU00:FS01:0x18:Saving result file logfile_01.txt
14:31:45:WU00:FS01:0x18:Saving result file checkpointState.xml
14:31:45:WU02:FS01:Downloading 29.47MiB
14:31:45:WU00:FS01:0x18:Saving result file checkpt.crc
14:31:45:WU00:FS01:0x18:Saving result file log.txt
14:31:46:WU00:FS01:0x18:Saving result file positions.xtc
14:31:46:WU00:FS01:0x18:Folding@home Core Shutdown: FINISHED_UNIT
14:31:46:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
14:31:46:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:9661 run:0 clone:5 gen:90 core:0x18 unit:0x00000066ab436c9b56de69ba5fdb9307
14:31:46:WU00:FS01:Uploading 1.74MiB to 171.67.108.155
14:31:46:WU00:FS01:Connecting to 171.67.108.155:8080
14:31:47:WU01:FS01:Upload 22.11%
14:31:51:WU02:FS01:Download 1.48%
14:31:56:WU00:FS01:Upload 21.52%
14:31:57:WU02:FS01:Download 2.76%
14:31:58:WU01:FS01:Upload 22.53%
14:32:03:WU02:FS01:Download 5.94%
14:32:07:WU00:FS01:Upload 28.70%
14:32:08:WU01:FS01:Upload 22.95%
14:32:09:WU02:FS01:Download 8.91%
14:32:15:WU02:FS01:Download 13.57%
14:32:17:WU01:FS01:Upload 23.37%
14:32:18:WU00:FS01:Upload 32.28%
14:32:21:WU02:FS01:Download 18.45%
14:32:27:WU01:FS01:Upload 23.78%
14:32:27:WU00:FS01:Upload 35.87%
14:32:27:WU02:FS01:Download 23.12%
14:32:33:WU02:FS01:Download 28.63%
14:32:36:WU00:FS01:Upload 39.46%
14:32:37:WU01:FS01:Upload 24.20%
14:32:39:WU02:FS01:Download 34.14%
14:32:45:WU02:FS01:Download 41.57%
14:32:47:WU00:FS01:Upload 43.05%
14:32:48:WU01:FS01:Upload 24.62%
14:32:51:WU02:FS01:Download 51.32%
14:32:58:WU00:FS01:Upload 46.63%
14:32:58:WU02:FS01:Download 61.08%
14:32:59:WU01:FS01:Upload 25.04%
14:33:04:WU02:FS01:Download 69.14%
14:33:10:WU02:FS01:Download 78.89%
14:33:13:WU01:FS01:Upload 25.45%
14:33:14:WU00:FS01:Upload 50.22%
14:33:16:WU02:FS01:Download 87.59%
14:33:22:WU02:FS01:Download 96.50%
14:33:24:WU00:FS01:Upload 53.81%
14:33:24:WU02:FS01:Download complete
14:33:24:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9441 run:32 clone:6 gen:133 core:0x21 unit:0x000000a1ab436c9d56af1b2aaecf960e
14:33:24:WU02:FS01:Starting
14:33:24:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 4108 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
14:33:24:WU02:FS01:Started FahCore on PID 6568
14:33:24:WU02:FS01:Core PID:1212
14:33:24:WU02:FS01:FahCore 0x21 started
14:33:25:WU01:FS01:Upload 25.87%
14:33:25:WU02:FS01:0x21:*********************** Log Started 2016-05-21T14:33:24Z ***********************
14:33:25:WU02:FS01:0x21:Project: 9441 (Run 32, Clone 6, Gen 133)
14:33:25:WU02:FS01:0x21:Unit: 0x000000a1ab436c9d56af1b2aaecf960e
14:33:25:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
14:33:25:WU02:FS01:0x21:Machine: 1
14:33:25:WU02:FS01:0x21:Reading tar file core.xml
14:33:25:WU02:FS01:0x21:Reading tar file integrator.xml
14:33:25:WU02:FS01:0x21:Reading tar file state.xml
14:33:25:WU02:FS01:0x21:Reading tar file system.xml
14:33:25:WU02:FS01:0x21:Digital signatures verified
14:33:25:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
14:33:25:WU02:FS01:0x21:Version 0.0.17
14:33:32:WU00:FS01:Upload 57.39%
14:33:33:WU01:FS01:Upload 26.29%
14:33:37:WU02:FS01:0x21:Completed 0 out of 2500000 steps (0%)
14:33:37:WU02:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
14:33:41:WU01:FS01:Upload 26.70%
14:33:42:WU00:FS01:Upload 60.98%
14:33:49:WU00:FS01:Upload 64.57%
14:33:50:WU01:FS01:Upload 27.12%
14:33:57:WU01:FS01:Upload 27.54%
14:33:58:WU00:FS01:Upload 68.15%
14:34:07:WU00:FS01:Upload 71.74%
14:34:07:WU01:FS01:Upload 27.96%
14:34:14:WU00:FS01:Upload 75.33%
14:34:15:WU01:FS01:Upload 28.37%
14:34:23:WU00:FS01:Upload 78.92%
14:34:23:WU01:FS01:Upload 28.79%
14:34:30:WU01:FS01:Upload 29.21%
14:34:31:WU00:FS01:Upload 82.50%
14:34:37:WU00:FS01:Upload 86.09%
14:34:40:WU01:FS01:Upload 29.62%
14:34:44:WU00:FS01:Upload 89.68%
14:34:52:WU00:FS01:Upload 93.26%
14:34:52:WU01:FS01:Upload 30.04%
14:34:59:WU00:FS01:Upload 96.85%
14:35:00:WU01:FS01:Upload 30.46%
14:35:07:WU00:FS01:Upload 100.00%
14:35:08:WU01:FS01:Upload 30.88%
14:35:17:WU01:FS01:Upload 31.29%
14:35:23:WU00:FS01:Upload complete
14:35:23:WU00:FS01:Server responded WORK_ACK (400)
14:35:23:WU00:FS01:Final credit estimate, 8904.00 points
14:35:23:WU00:FS01:Cleaning up
14:35:24:WU01:FS01:Upload 31.71%
14:35:32:WU01:FS01:Upload 32.55%
14:35:40:WU01:FS01:Upload 33.38%
14:35:48:WU01:FS01:Upload 34.21%
14:35:57:WU01:FS01:Upload 35.05%
14:35:59:WU02:FS01:0x21:Completed 25000 out of 2500000 steps (1%)
14:36:05:WU01:FS01:Upload 35.88%
14:36:13:WU01:FS01:Upload 36.72%
14:36:21:WU01:FS01:Upload 37.55%
14:36:30:WU01:FS01:Upload 38.39%
14:36:37:WU01:FS01:Upload 39.22%
14:36:45:WU01:FS01:Upload 40.06%
14:36:54:WU01:FS01:Upload 40.89%
14:37:01:WU01:FS01:Upload 41.73%
14:37:09:WU01:FS01:Upload 42.56%
14:37:17:WU01:FS01:Upload 43.39%
14:37:26:WU01:FS01:Upload 44.23%
14:37:34:WU01:FS01:Upload 45.06%
14:37:42:WU01:FS01:Upload 45.90%
14:37:50:WU01:FS01:Upload 46.73%
14:37:59:WU01:FS01:Upload 47.57%
14:38:07:WU01:FS01:Upload 48.40%
14:38:14:WU01:FS01:Upload 49.24%
14:38:22:WU01:FS01:Upload 50.07%
14:38:22:WU02:FS01:0x21:Completed 50000 out of 2500000 steps (2%)
14:38:30:WU01:FS01:Upload 50.90%
14:38:38:WU01:FS01:Upload 51.74%
14:38:46:WU01:FS01:Upload 52.57%
14:38:54:WU01:FS01:Upload 53.41%
14:39:02:WU01:FS01:Upload 54.24%
14:39:10:WU01:FS01:Upload 55.08%
14:39:18:WU01:FS01:Upload 55.91%
14:39:26:WU01:FS01:Upload 56.75%
14:39:34:WU01:FS01:Upload 57.58%
14:39:42:WU01:FS01:Upload 58.42%
14:39:50:WU01:FS01:Upload 59.25%
14:39:58:WU01:FS01:Upload 60.08%
14:40:07:WU01:FS01:Upload 60.92%
14:40:15:WU01:FS01:Upload 61.75%
14:40:23:WU01:FS01:Upload 62.59%
14:40:32:WU01:FS01:Upload 63.42%
14:40:39:WU01:FS01:Upload 64.26%
14:40:47:WU01:FS01:Upload 65.09%
14:40:50:WU02:FS01:0x21:Completed 75000 out of 2500000 steps (3%)
14:40:55:WU01:FS01:Upload 65.93%
14:41:03:WU01:FS01:Upload 66.76%
14:41:11:WU01:FS01:Upload 67.59%
14:41:19:WU01:FS01:Upload 68.43%
14:41:28:WU01:FS01:Upload 69.26%
14:41:35:WU01:FS01:Upload 70.10%
14:41:43:WU01:FS01:Upload 70.93%
14:41:50:WU01:FS01:Upload 71.77%
14:41:58:WU01:FS01:Upload 72.60%
14:42:07:WU01:FS01:Upload 73.44%
14:42:15:WU01:FS01:Upload 74.27%
14:42:23:WU01:FS01:Upload 75.11%
14:42:30:WU01:FS01:Upload 75.94%
14:42:38:WU01:FS01:Upload 76.77%
14:42:47:WU01:FS01:Upload 77.61%
14:42:55:WU01:FS01:Upload 78.44%
14:43:02:WU01:FS01:Upload 79.28%
14:43:10:WU01:FS01:Upload 80.11%
14:43:14:WU02:FS01:0x21:Completed 100000 out of 2500000 steps (4%)
14:43:18:WU01:FS01:Upload 80.95%
14:43:20:WARNING:WU01:FS01:Exception: Failed to send results to work server: Transfer failed
14:43:20:WU01:FS01:Trying to send results to collection server
14:43:20:WU01:FS01:Uploading 14.98MiB to 171.65.103.160
14:43:20:WU01:FS01:Connecting to 171.65.103.160:8080
14:43:27:WU01:FS01:Upload 1.25%
14:43:35:WU01:FS01:Upload 2.09%
14:43:43:WU01:FS01:Upload 2.92%
14:43:51:WU01:FS01:Upload 3.76%
14:43:59:WU01:FS01:Upload 4.59%
14:44:07:WU01:FS01:Upload 5.42%
14:44:15:WU01:FS01:Upload 6.26%
14:44:23:WU01:FS01:Upload 7.09%
14:44:31:WU01:FS01:Upload 7.93%
14:44:39:WU01:FS01:Upload 8.76%
14:44:47:WU01:FS01:Upload 9.60%
14:44:54:WU01:FS01:Upload 10.43%
14:45:02:WU01:FS01:Upload 11.27%
14:45:10:WU01:FS01:Upload 12.10%
14:45:19:WU01:FS01:Upload 12.93%
14:45:27:WU01:FS01:Upload 13.77%
14:45:35:WU01:FS01:Upload 14.60%
14:45:42:WU02:FS01:0x21:Completed 125000 out of 2500000 steps (5%)
14:45:43:WU01:FS01:Upload 15.44%
14:45:51:WU01:FS01:Upload 16.27%
14:45:59:WU01:FS01:Upload 17.11%
14:46:07:WU01:FS01:Upload 17.94%
14:46:15:WU01:FS01:Upload 18.78%
14:46:23:WU01:FS01:Upload 19.61%
14:46:31:WU01:FS01:Upload 20.45%
14:46:39:WU01:FS01:Upload 21.28%
14:46:47:WU01:FS01:Upload 22.11%
14:46:55:WU01:FS01:Upload 22.95%
14:47:03:WU01:FS01:Upload 23.78%
14:47:11:WU01:FS01:Upload 24.62%
14:47:19:WU01:FS01:Upload 25.45%
14:47:27:WU01:FS01:Upload 26.29%
14:47:35:WU01:FS01:Upload 27.12%
14:47:43:WU01:FS01:Upload 27.96%
14:47:51:WU01:FS01:Upload 28.79%
14:47:59:WU01:FS01:Upload 29.62%
14:48:07:WU01:FS01:Upload 30.46%
14:48:07:WU02:FS01:0x21:Completed 150000 out of 2500000 steps (6%)
14:48:15:WU01:FS01:Upload 31.29%
14:48:23:WU01:FS01:Upload 32.13%
14:48:30:WU01:FS01:Upload 32.96%
14:48:39:WU01:FS01:Upload 33.80%
14:48:47:WU01:FS01:Upload 34.63%
14:48:54:WU01:FS01:Upload 35.47%
14:49:03:WU01:FS01:Upload 36.30%
14:49:10:WU01:FS01:Upload 37.14%
14:49:19:WU01:FS01:Upload 37.97%
14:49:27:WU01:FS01:Upload 38.80%
14:49:35:WU01:FS01:Upload 39.64%
14:49:43:WU01:FS01:Upload 40.47%
14:49:51:WU01:FS01:Upload 41.31%
14:49:59:WU01:FS01:Upload 42.14%
14:50:07:WU01:FS01:Upload 42.98%
14:50:15:WU01:FS01:Upload 43.81%
14:50:23:WU01:FS01:Upload 44.65%
14:50:31:WU01:FS01:Upload 45.48%
14:50:36:WU02:FS01:0x21:Completed 175000 out of 2500000 steps (7%)
14:50:39:WU01:FS01:Upload 46.31%
14:50:48:WU01:FS01:Upload 47.15%
14:50:56:WU01:FS01:Upload 47.98%
14:51:04:WU01:FS01:Upload 48.82%
14:51:12:WU01:FS01:Upload 49.65%
14:51:20:WU01:FS01:Upload 50.49%
14:51:28:WU01:FS01:Upload 51.32%
14:51:36:WU01:FS01:Upload 52.16%
14:51:44:WU01:FS01:Upload 52.99%
14:51:52:WU01:FS01:Upload 53.83%
14:51:59:WU01:FS01:Upload 54.66%
14:52:08:WU01:FS01:Upload 55.49%
14:52:15:WU01:FS01:Upload 56.33%
14:52:23:WU01:FS01:Upload 57.16%
14:52:31:WU01:FS01:Upload 58.00%
14:52:39:WU01:FS01:Upload 58.83%
14:52:46:WU01:FS01:Upload 59.67%
14:52:54:WU01:FS01:Upload 60.50%
14:53:01:WU02:FS01:0x21:Completed 200000 out of 2500000 steps (8%)
14:53:02:WU01:FS01:Upload 61.34%
14:53:10:WU01:FS01:Upload 62.17%
14:53:18:WU01:FS01:Upload 63.01%
14:53:26:WU01:FS01:Upload 63.84%
14:53:34:WU01:FS01:Upload 64.67%
14:53:42:WU01:FS01:Upload 65.51%
14:53:50:WU01:FS01:Upload 66.34%
14:53:58:WU01:FS01:Upload 67.18%
14:54:06:WU01:FS01:Upload 68.01%
14:54:14:WU01:FS01:Upload 68.85%
14:54:21:WU01:FS01:Upload 69.68%
14:54:30:WU01:FS01:Upload 70.52%
14:54:38:WU01:FS01:Upload 71.35%
14:54:46:WU01:FS01:Upload 72.18%
14:54:54:WU01:FS01:Upload 73.02%
14:55:02:WU01:FS01:Upload 73.85%
14:55:10:WU01:FS01:Upload 74.69%
14:55:18:WU01:FS01:Upload 75.52%
14:55:26:WU01:FS01:Upload 76.36%
14:55:29:WU02:FS01:0x21:Completed 225000 out of 2500000 steps (9%)
14:55:34:WU01:FS01:Upload 77.19%
14:55:42:WU01:FS01:Upload 78.03%
14:55:50:WU01:FS01:Upload 78.86%
14:55:58:WU01:FS01:Upload 79.70%
14:56:05:WU01:FS01:Upload 80.53%
14:56:13:WU01:FS01:Upload 81.36%
14:56:20:WU01:FS01:Upload 82.20%
14:56:28:WU01:FS01:Upload 83.03%
14:56:36:WU01:FS01:Upload 83.87%
14:56:45:WU01:FS01:Upload 84.70%
14:56:52:WU01:FS01:Upload 85.54%
14:57:00:WU01:FS01:Upload 86.37%
14:57:08:WU01:FS01:Upload 87.21%
14:57:17:WU01:FS01:Upload 88.04%
14:57:24:WU01:FS01:Upload 88.87%
14:57:32:WU01:FS01:Upload 89.71%
14:57:41:WU01:FS01:Upload 90.54%
14:57:49:WU01:FS01:Upload 91.38%
14:57:54:WU02:FS01:0x21:Completed 250000 out of 2500000 steps (10%)
14:57:57:WU01:FS01:Upload 92.21%
14:58:04:WU01:FS01:Upload 93.05%
14:58:12:WU01:FS01:Upload 93.88%
14:58:20:WU01:FS01:Upload 94.72%
14:58:21:ERROR:WU01:FS01:Exception: Transfer failed
14:58:21:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:9704 run:25 clone:16 gen:143 core:0x21 unit:0x000000d6ab404162553ebf9b6ddf5a8d
14:58:21:WU01:FS01:Uploading 14.98MiB to 171.64.65.98
14:58:21:WU01:FS01:Connecting to 171.64.65.98:8080
14:58:29:WU01:FS01:Upload 1.25%
14:58:37:WU01:FS01:Upload 2.09%
14:58:44:WU01:FS01:Upload 2.92%
14:58:53:WU01:FS01:Upload 3.76%
14:59:01:WU01:FS01:Upload 4.59%
14:59:09:WU01:FS01:Upload 5.42%
14:59:17:WU01:FS01:Upload 6.26%
14:59:25:WU01:FS01:Upload 7.09%
14:59:32:WU01:FS01:Upload 7.93%
14:59:41:WU01:FS01:Upload 8.76%
14:59:49:WU01:FS01:Upload 9.60%
14:59:57:WU01:FS01:Upload 10.43%
15:00:06:WU01:FS01:Upload 11.27%
15:00:15:WU01:FS01:Upload 12.10%
15:00:22:WU02:FS01:0x21:Completed 275000 out of 2500000 steps (11%)
15:00:23:WU01:FS01:Upload 12.93%
15:00:30:WU01:FS01:Upload 13.77%
15:00:39:WU01:FS01:Upload 14.60%
15:00:47:WU01:FS01:Upload 15.44%
15:00:55:WU01:FS01:Upload 16.27%
15:01:03:WU01:FS01:Upload 17.11%
15:01:11:WU01:FS01:Upload 17.94%
15:01:19:WU01:FS01:Upload 18.78%
15:01:27:WU01:FS01:Upload 19.61%
15:01:34:WU01:FS01:Upload 20.45%
15:01:42:WU01:FS01:Upload 21.28%
15:01:49:WU01:FS01:Upload 22.11%
15:01:58:WU01:FS01:Upload 22.95%
15:02:07:WU01:FS01:Upload 23.78%
15:02:15:WU01:FS01:Upload 24.62%
15:02:24:WU01:FS01:Upload 25.45%
15:02:33:WU01:FS01:Upload 26.29%
15:02:40:WU01:FS01:Upload 27.12%
15:02:48:WU02:FS01:0x21:Completed 300000 out of 2500000 steps (12%)
15:02:48:WU01:FS01:Upload 27.96%
15:02:56:WU01:FS01:Upload 28.79%
15:03:03:WU01:FS01:Upload 29.62%
15:03:12:WU01:FS01:Upload 30.46%
15:03:21:WU01:FS01:Upload 31.29%
15:03:29:WU01:FS01:Upload 32.13%
15:03:38:WU01:FS01:Upload 32.96%
15:03:46:WU01:FS01:Upload 33.80%
15:03:54:WU01:FS01:Upload 34.63%
15:04:02:WU01:FS01:Upload 35.47%
15:04:10:WU01:FS01:Upload 36.30%
15:04:18:WU01:FS01:Upload 37.14%
15:04:26:WU01:FS01:Upload 37.97%
15:04:34:WU01:FS01:Upload 38.80%
15:04:43:WU01:FS01:Upload 39.64%
15:04:50:WU01:FS01:Upload 40.47%
15:04:59:WU01:FS01:Upload 41.31%
15:05:07:WU01:FS01:Upload 42.14%
15:05:16:WU02:FS01:0x21:Completed 325000 out of 2500000 steps (13%)
15:05:16:WU01:FS01:Upload 42.98%
15:05:25:WU01:FS01:Upload 43.81%
15:05:33:WU01:FS01:Upload 44.65%
15:05:42:WU01:FS01:Upload 45.48%
15:05:50:WU01:FS01:Upload 46.31%
15:05:58:WU01:FS01:Upload 47.15%
15:06:07:WU01:FS01:Upload 47.98%
15:06:15:WU01:FS01:Upload 48.82%
15:06:23:WU01:FS01:Upload 49.65%
15:06:31:WU01:FS01:Upload 50.49%
15:06:39:WU01:FS01:Upload 51.32%
15:06:47:WU01:FS01:Upload 52.16%
15:06:55:WU01:FS01:Upload 52.99%
15:07:03:WU01:FS01:Upload 53.83%
15:07:11:WU01:FS01:Upload 54.66%
15:07:19:WU01:FS01:Upload 55.49%
15:07:27:WU01:FS01:Upload 56.33%
15:07:35:WU01:FS01:Upload 57.16%
15:07:41:WU02:FS01:0x21:Completed 350000 out of 2500000 steps (14%)
15:07:43:WU01:FS01:Upload 58.00%
15:07:51:WU01:FS01:Upload 58.83%
15:07:59:WU01:FS01:Upload 59.67%
15:08:07:WU01:FS01:Upload 60.50%
15:08:15:WU01:FS01:Upload 61.34%
15:08:22:WU01:FS01:Upload 62.17%
15:08:30:WU01:FS01:Upload 63.01%
15:08:39:WU01:FS01:Upload 63.84%
15:08:47:WU01:FS01:Upload 64.67%
15:08:55:WU01:FS01:Upload 65.51%
15:09:03:WU01:FS01:Upload 66.34%
15:09:11:WU01:FS01:Upload 67.18%
15:09:19:WU01:FS01:Upload 68.01%
15:09:27:WU01:FS01:Upload 68.85%
15:09:35:WU01:FS01:Upload 69.68%
15:09:42:WU01:FS01:Upload 70.52%
15:09:51:WU01:FS01:Upload 71.35%
15:09:58:WU01:FS01:Upload 72.18%
15:10:06:WU01:FS01:Upload 73.02%
15:10:09:WU02:FS01:0x21:Completed 375000 out of 2500000 steps (15%)
15:10:14:WU01:FS01:Upload 73.85%
15:10:23:WU01:FS01:Upload 74.69%
15:10:31:WU01:FS01:Upload 75.52%
15:10:39:WU01:FS01:Upload 76.36%
15:10:47:WU01:FS01:Upload 77.19%
15:10:55:WU01:FS01:Upload 78.03%
15:11:03:WU01:FS01:Upload 78.86%
15:11:12:WU01:FS01:Upload 79.70%
15:11:20:WU01:FS01:Upload 80.53%
15:11:28:WU01:FS01:Upload 81.36%
15:11:35:WU01:FS01:Upload 82.20%
15:11:44:WU01:FS01:Upload 83.03%
15:11:52:WU01:FS01:Upload 83.87%
15:11:59:WU01:FS01:Upload 84.70%
15:12:07:WU01:FS01:Upload 85.54%
15:12:15:WU01:FS01:Upload 86.37%
15:12:24:WU01:FS01:Upload 87.21%
15:12:31:WU01:FS01:Upload 88.04%
15:12:34:WU02:FS01:0x21:Completed 400000 out of 2500000 steps (16%)
15:12:39:WU01:FS01:Upload 88.87%
15:12:47:WU01:FS01:Upload 89.71%
15:12:56:WU01:FS01:Upload 90.54%
15:13:03:WU01:FS01:Upload 91.38%
15:13:12:WU01:FS01:Upload 92.21%
15:13:19:WU01:FS01:Upload 93.05%
15:13:22:WARNING:WU01:FS01:Exception: Failed to send results to work server: Transfer failed
15:13:22:WU01:FS01:Trying to send results to collection server
15:13:22:WU01:FS01:Uploading 14.98MiB to 171.65.103.160
15:13:22:WU01:FS01:Connecting to 171.65.103.160:8080
15:13:30:WU01:FS01:Upload 1.25%
15:13:38:WU01:FS01:Upload 2.09%
15:13:46:WU01:FS01:Upload 2.92%
15:13:54:WU01:FS01:Upload 3.76%
15:14:03:WU01:FS01:Upload 4.59%
15:14:11:WU01:FS01:Upload 5.42%
15:14:19:WU01:FS01:Upload 6.26%

Post by **toTOW** » Sun May 22, 2016 6:19 pm

This is the 15 minutes transfer timeout ...

Kebast · Post by **Kebast** » Sun May 22, 2016 7:04 pm

Can this be increased?

Post by **Joe_H** » Sun May 22, 2016 7:43 pm

Is there anything you can do on your end to speed up the upload? It is going at less than 17 kbps, transferring over a dial up modem would be faster. That is not even a fraction of the speed you wrote as getting from your DSL connection. I don't know if an increase in the timeout on the WS has already been requested, but even that might not be enough with two uploads at once if something happened to interrupt another upload.

Folding Forum

Uploads keep failing

Uploads keep failing

Re: Uploads keep failing

Re: Uploads keep failing

Re: Uploads keep failing

Re: Uploads keep failing

Re: Uploads keep failing

Re: Uploads keep failing

Re: Uploads keep failing

Re: Uploads keep failing

Re: Uploads keep failing

Re: Uploads keep failing

Re: Uploads keep failing

Re: Uploads keep failing

Re: Uploads keep failing

Re: Uploads keep failing