Cant upload the WU in the time allowed.

[Nick200]

Full log below - smaller than I thought as I had rebooted - and will re-boot again to clear the final WU:

Code: Select all

*********************** Log Started 2016-04-11T05:56:06Z ***********************
05:56:06:************************* Folding@home Client *************************
05:56:06:      Website: http://folding.stanford.edu/
05:56:06:    Copyright: (c) 2009-2014 Stanford University
05:56:06:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
05:56:06:         Args: --open-web-control
05:56:06:       Config: C:/Users/nickm/AppData/Roaming/FAHClient/config.xml
05:56:06:******************************** Build ********************************
05:56:06:      Version: 7.4.4
05:56:06:         Date: Mar 4 2014
05:56:06:         Time: 20:26:54
05:56:06:      SVN Rev: 4130
05:56:06:       Branch: fah/trunk/client
05:56:06:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
05:56:06:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
05:56:06:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
05:56:06:     Platform: win32 XP
05:56:06:         Bits: 32
05:56:06:         Mode: Release
05:56:06:******************************* System ********************************
05:56:06:          CPU: Intel(R) Core(TM) i7-4790 CPU @ 3.60GHz
05:56:06:       CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
05:56:06:         CPUs: 8
05:56:06:       Memory: 15.85GiB
05:56:06:  Free Memory: 11.35GiB
05:56:06:      Threads: WINDOWS_THREADS
05:56:06:   OS Version: 6.2
05:56:06:  Has Battery: false
05:56:06:   On Battery: false
05:56:06:   UTC Offset: 12
05:56:06:          PID: 7548
05:56:06:          CWD: C:/Users/nickm/AppData/Roaming/FAHClient
05:56:06:           OS: Windows 10 Pro Insider Preview
05:56:06:      OS Arch: AMD64
05:56:06:         GPUs: 2
05:56:06:        GPU 0: NVIDIA:5 GM204 [GeForce GTX 980]
05:56:06:        GPU 1: NVIDIA:5 GM204 [GeForce GTX 980]
05:56:06:         CUDA: 5.2
05:56:06:  CUDA Driver: 8000
05:56:06:Win32 Service: false
05:56:06:***********************************************************************
05:56:06:<config>
05:56:06:  <!-- Slot Control -->
05:56:06:  <power v='FULL'/>
05:56:06:
05:56:06:  <!-- User Information -->
05:56:06:  <passkey v='********************************'/>
05:56:06:  <team v='142900'/>
05:56:06:  <user v='Montague-Cripps'/>
05:56:06:
05:56:06:  <!-- Folding Slots -->
05:56:06:  <slot id='0' type='CPU'/>
05:56:06:  <slot id='1' type='GPU'/>
05:56:06:  <slot id='2' type='GPU'/>
05:56:06:</config>
05:56:06:Trying to access database...
05:56:06:Successfully acquired database lock
05:56:06:Enabled folding slot 00: READY cpu:6
05:56:06:Enabled folding slot 01: READY gpu:0:GM204 [GeForce GTX 980]
05:56:06:Enabled folding slot 02: READY gpu:1:GM204 [GeForce GTX 980]
05:56:06:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:11629 run:1 clone:281 gen:3 core:0xa4 unit:0x000000044c71bbb0569e80976922264a
05:56:06:WU02:FS00:Uploading 27.84MiB to 128.252.203.2
05:56:06:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:10486 run:0 clone:51 gen:233 core:0x18 unit:0x00000132538b3dbb54aeca574f87d2f0
05:56:06:WU02:FS00:Connecting to 128.252.203.2:8080
05:56:06:WU01:FS01:Uploading 13.10MiB to 140.163.4.235
05:56:06:WU00:FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:10494 run:8 clone:13 gen:109 core:0x21 unit:0x0000008b8ca304f555de93fa7927a275
05:56:06:WU01:FS01:Connecting to 140.163.4.235:8080
05:56:06:WU00:FS02:Uploading 35.89MiB to 140.163.4.245
05:56:06:WU06:FS02:Sending unit results: id:06 state:SEND error:NO_ERROR project:11407 run:0 clone:22 gen:93 core:0x21 unit:0x0000007e8ca304f25686b24381d37906
05:56:06:WU00:FS02:Connecting to 140.163.4.245:8080
05:56:06:WU06:FS02:Uploading 9.04MiB to 140.163.4.242
05:56:06:WU07:FS01:Starting
05:56:06:WU06:FS02:Connecting to 140.163.4.242:8080
05:56:06:WU07:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/nickm/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 07 -suffix 01 -version 704 -lifeline 7548 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
05:56:06:WU07:FS01:Started FahCore on PID 9636
05:56:06:WU07:FS01:Core PID:6528
05:56:06:WU07:FS01:FahCore 0x21 started
05:56:06:WU03:FS02:Starting
05:56:06:WU03:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/nickm/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 03 -suffix 01 -version 704 -lifeline 7548 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
05:56:06:WU03:FS02:Started FahCore on PID 1848
05:56:06:WU03:FS02:Core PID:5060
05:56:06:WU03:FS02:FahCore 0x18 started
05:56:06:WU04:FS00:Starting
05:56:06:WU04:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/nickm/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 04 -suffix 01 -version 704 -lifeline 7548 -checkpoint 15 -np 6
05:56:06:WU04:FS00:Started FahCore on PID 9900
05:56:06:WU04:FS00:Core PID:8028
05:56:06:WU04:FS00:FahCore 0xa4 started
05:56:07:WU04:FS00:0xa4:
05:56:07:WU04:FS00:0xa4:*------------------------------*
05:56:07:WU04:FS00:0xa4:Folding@Home Gromacs GB Core
05:56:07:WU04:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
05:56:07:WU04:FS00:0xa4:
05:56:07:WU04:FS00:0xa4:Preparing to commence simulation
05:56:07:WU04:FS00:0xa4:- Looking at optimizations...
05:56:07:WU07:FS01:0x21:*********************** Log Started 2016-04-11T05:56:07Z ***********************
05:56:07:WU07:FS01:0x21:Project: 11406 (Run 5, Clone 37, Gen 54)
05:56:07:WU07:FS01:0x21:Unit: 0x000000478ca304f25686b1eb96e7e003
05:56:07:WU07:FS01:0x21:CPU: 0x00000000000000000000000000000000
05:56:07:WU07:FS01:0x21:Machine: 1
05:56:07:WU07:FS01:0x21:Digital signatures verified
05:56:07:WU07:FS01:0x21:Folding@home GPU Core21 Folding@home Core
05:56:07:WU07:FS01:0x21:Version 0.0.17
05:56:08:WU03:FS02:0x18:*********************** Log Started 2016-04-11T05:56:07Z ***********************
05:56:08:WU03:FS02:0x18:Project: 9136 (Run 23, Clone 0, Gen 456)
05:56:08:WU03:FS02:0x18:Unit: 0x000002120a3b1e615564ef1d3fe3768c
05:56:08:WU03:FS02:0x18:CPU: 0x00000000000000000000000000000000
05:56:08:WU03:FS02:0x18:Machine: 2
05:56:08:WU03:FS02:0x18:Digital signatures verified
05:56:08:WU03:FS02:0x18:Folding@home GPU core18
05:56:08:WU03:FS02:0x18:Version 0.0.4
05:56:08:WU03:FS02:0x18:  Found a checkpoint file
05:56:08:WU04:FS00:0xa4:- Created dyn
05:56:08:WU04:FS00:0xa4:- Files status OK
05:56:09:WU04:FS00:0xa4:- Expanded 1657961 -> 3106984 (decompressed 187.3 percent)
05:56:09:WU04:FS00:0xa4:Called DecompressByteArray: compressed_data_size=1657961 data_size=3106984, decompressed_data_size=3106984 diff=0
05:56:09:WU04:FS00:0xa4:- Digital signature verified
05:56:09:WU04:FS00:0xa4:
05:56:09:WU04:FS00:0xa4:Project: 11650 (Run 56, Clone 0, Gen 7)
05:56:09:WU04:FS00:0xa4:
05:56:09:WU04:FS00:0xa4:Assembly optimizations on if available.
05:56:09:WU04:FS00:0xa4:Entering M.D.
05:56:09:WU07:FS01:0x21:  Found a checkpoint file
05:56:12:WU02:FS00:Upload 2.02%
05:56:12:WU01:FS01:Upload 4.77%
05:56:12:WU00:FS02:Upload 1.04%
05:56:13:WU06:FS02:Upload 2.77%
05:56:15:WU04:FS00:0xa4:Mapping NT from 6 to 6 
05:56:15:WU04:FS00:0xa4:Completed 0 out of 1250000 steps  (0%)
05:56:18:WU00:FS02:Upload 2.26%
05:56:18:WU02:FS00:Upload 3.37%
05:56:18:WU01:FS01:Upload 8.11%
05:56:19:WU07:FS01:0x21:Completed 3250000 out of 5000000 steps (65%)
05:56:19:WU07:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
05:56:24:WU00:FS02:Upload 3.48%
05:56:24:WU02:FS00:Upload 5.16%
05:56:25:WU01:FS01:Upload 11.45%
05:56:30:WU00:FS02:Upload 4.70%
05:56:30:WU02:FS00:Upload 7.41%
05:56:31:WU01:FS01:Upload 14.31%
05:56:36:WU00:FS02:Upload 5.57%
05:56:36:WU02:FS00:Upload 9.65%
05:56:36:WU03:FS02:0x18:Completed 200000 out of 2500000 steps (8%)
05:56:36:WU03:FS02:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
05:56:37:WU06:FS02:Upload 4.15%
05:56:37:WU01:FS01:Upload 17.65%
05:56:37:WARNING:WU06:FS02:Exception: Failed to send results to work server: Transfer failed
05:56:37:WU06:FS02:Trying to send results to collection server
05:56:37:WU06:FS02:Uploading 9.04MiB to 128.252.203.2
05:56:37:WU06:FS02:Connecting to 128.252.203.2:8080
05:56:42:WU00:FS02:Upload 6.79%
05:56:42:WU02:FS00:Upload 11.45%
05:56:43:WU01:FS01:Upload 20.04%
05:56:44:WU06:FS02:Upload 4.15%
05:56:48:WU00:FS02:Upload 8.36%
05:56:48:WU02:FS00:Upload 12.35%
05:56:49:WU01:FS01:Upload 23.38%
05:56:52:WU06:FS02:Upload 8.30%
05:56:54:WU02:FS00:Upload 13.02%
05:56:54:WU00:FS02:Upload 9.40%
05:56:55:WU01:FS01:Upload 27.19%
05:56:58:WU06:FS02:Upload 11.75%
05:57:00:WU00:FS02:Upload 10.27%
05:57:01:WU02:FS00:Upload 14.59%
05:57:01:WU01:FS01:Upload 30.53%
05:57:04:WU06:FS02:Upload 15.90%
05:57:06:WU00:FS02:Upload 11.32%
05:57:07:WU01:FS01:Upload 33.39%
05:57:09:WU02:FS00:Upload 15.72%
05:57:10:WU06:FS02:Upload 20.05%
05:57:12:WU00:FS02:Upload 12.19%
05:57:13:WU01:FS01:Upload 36.26%
05:57:15:WU02:FS00:Upload 17.29%
05:57:16:WU06:FS02:Upload 22.81%
05:57:18:WU00:FS02:Upload 12.71%
05:57:19:WU01:FS01:Upload 40.07%
05:57:21:WU02:FS00:Upload 18.86%
05:57:23:WU06:FS02:Upload 25.58%
05:57:24:WU00:FS02:Upload 13.76%
05:57:25:WU01:FS01:Upload 42.94%
05:57:28:WU02:FS00:Upload 20.43%
05:57:30:WU06:FS02:Upload 27.65%
05:57:30:WU00:FS02:Upload 14.80%
05:57:31:WU01:FS01:Upload 45.80%
05:57:34:WU02:FS00:Upload 22.00%
05:57:36:WU06:FS02:Upload 28.34%
05:57:36:WU00:FS02:Upload 16.02%
05:57:37:WU01:FS01:Upload 48.66%
05:57:41:WU02:FS00:Upload 23.80%
05:57:42:WU06:FS02:Upload 31.80%
05:57:42:WU00:FS02:Upload 17.24%
05:57:43:WU01:FS01:Upload 51.05%
05:57:47:WU02:FS00:Upload 25.37%
05:57:48:WU06:FS02:Upload 33.18%
05:57:48:WU00:FS02:Upload 18.46%
05:57:49:WU01:FS01:Upload 53.43%
05:57:53:WU02:FS00:Upload 26.72%
05:57:54:WU00:FS02:Upload 19.68%
05:57:55:WU01:FS01:Upload 55.82%
05:57:55:WU06:FS02:Upload 35.95%
05:57:59:WU02:FS00:Upload 27.84%
05:58:00:WU00:FS02:Upload 20.90%
05:58:01:WU01:FS01:Upload 58.68%
05:58:02:WU06:FS02:Upload 38.71%
05:58:05:WU02:FS00:Upload 29.64%
05:58:06:WU00:FS02:Upload 21.94%
05:58:07:WU01:FS01:Upload 61.54%
05:58:09:WU06:FS02:Upload 42.17%
05:58:11:WU02:FS00:Upload 30.76%
05:58:12:WU00:FS02:Upload 23.16%
05:58:13:WU01:FS01:Upload 63.45%
05:58:15:WU06:FS02:Upload 47.01%
05:58:17:WU02:FS00:Upload 31.66%
05:58:18:WU00:FS02:Upload 24.03%
05:58:20:WU01:FS01:Upload 66.31%
05:58:21:WU06:FS02:Upload 52.54%
05:58:23:WU02:FS00:Upload 32.78%
05:58:24:WU00:FS02:Upload 25.25%
05:58:26:WU01:FS01:Upload 69.17%
05:58:27:WU06:FS02:Upload 56.69%
05:58:29:WU02:FS00:Upload 34.35%
05:58:30:WU00:FS02:Upload 25.77%
05:58:31:WU03:FS02:0x18:Completed 225000 out of 2500000 steps (9%)
05:58:33:WU01:FS01:Upload 71.08%
05:58:33:WU06:FS02:Upload 61.53%
05:58:35:WU02:FS00:Upload 35.92%
05:58:37:WU00:FS02:Upload 26.82%
05:58:39:WU01:FS01:Upload 73.94%
05:58:40:WU06:FS02:Upload 66.37%
05:58:41:WU02:FS00:Upload 37.05%
05:58:44:WU00:FS02:Upload 27.69%
05:58:45:WU01:FS01:Upload 76.81%
05:58:46:WU06:FS02:Upload 71.20%
05:58:47:WU02:FS00:Upload 38.84%
05:58:50:WU00:FS02:Upload 28.39%
05:58:51:WU01:FS01:Upload 79.19%
05:58:52:WU06:FS02:Upload 75.35%
05:58:53:WU02:FS00:Upload 40.19%
05:58:57:WU00:FS02:Upload 29.43%
05:58:57:WU01:FS01:Upload 81.58%
05:58:58:WU06:FS02:Upload 79.50%
05:58:59:WU02:FS00:Upload 41.76%
05:59:03:WU01:FS01:Upload 85.39%
05:59:04:WU06:FS02:Upload 82.96%
05:59:04:WU00:FS02:Upload 30.30%
05:59:05:WU02:FS00:Upload 42.66%
05:59:09:WU01:FS01:Upload 88.73%
05:59:10:WU00:FS02:Upload 31.00%
05:59:10:WU06:FS02:Upload 87.10%
05:59:11:WU02:FS00:Upload 44.01%
05:59:15:WU01:FS01:Upload 91.12%
05:59:16:WU06:FS02:Upload 89.87%
05:59:17:WU02:FS00:Upload 45.36%
05:59:18:WU00:FS02:Upload 32.04%
05:59:22:WU06:FS02:Upload 94.71%
05:59:23:WU02:FS00:Upload 46.70%
05:59:23:WU01:FS01:Upload 93.98%
05:59:24:WU00:FS02:Upload 32.91%
05:59:28:WU06:FS02:Upload 99.55%
05:59:29:WU01:FS01:Upload 96.37%
05:59:30:WU02:FS00:Upload 48.05%
05:59:30:WU06:FS02:Upload complete
05:59:31:WU06:FS02:Server responded WORK_ACK (400)
05:59:31:WU06:FS02:Final credit estimate, 68640.00 points
05:59:31:WU06:FS02:Cleaning up
05:59:31:WU00:FS02:Upload 33.79%
05:59:35:WU01:FS01:Upload 100.00%
05:59:35:WU01:FS01:Upload complete
05:59:36:WU01:FS01:Server responded GOT_ALREADY (434)
05:59:36:WARNING:WU01:FS01:Server did not like results, dumping
05:59:36:WU01:FS01:Cleaning up
05:59:36:WU02:FS00:Upload 49.40%
05:59:37:WU00:FS02:Upload 35.18%
05:59:42:WU02:FS00:Upload 52.54%
05:59:43:WU00:FS02:Upload 36.57%
05:59:48:WU02:FS00:Upload 55.46%
05:59:49:WU00:FS02:Upload 38.49%
05:59:54:WU02:FS00:Upload 57.03%
05:59:55:WU00:FS02:Upload 40.23%
06:00:00:WU02:FS00:Upload 59.05%
06:00:01:WU00:FS02:Upload 42.14%
06:00:06:WU02:FS00:Upload 61.97%
06:00:07:WU00:FS02:Upload 44.06%
06:00:12:WU02:FS00:Upload 65.11%
06:00:13:WU00:FS02:Upload 45.63%
06:00:14:WU03:FS02:0x18:Completed 250000 out of 2500000 steps (10%)
06:00:18:WU02:FS00:Upload 67.81%
06:00:19:WU00:FS02:Upload 47.19%
06:00:24:WU02:FS00:Upload 70.73%
06:00:25:WU00:FS02:Upload 48.94%
06:00:30:WU02:FS00:Upload 73.87%
06:00:31:WU00:FS02:Upload 50.33%
06:00:31:WU07:FS01:0x21:Completed 3300000 out of 5000000 steps (66%)
06:00:36:WU02:FS00:Upload 77.24%
06:00:37:WU00:FS02:Upload 51.90%
06:00:42:WU02:FS00:Upload 80.16%
06:00:43:WU00:FS02:Upload 53.46%
06:00:48:WU02:FS00:Upload 83.08%
06:00:49:WU00:FS02:Upload 55.21%
06:00:54:WU02:FS00:Upload 84.87%
06:00:56:WU00:FS02:Upload 57.30%
06:01:00:WU02:FS00:Upload 88.69%
06:01:02:WU00:FS02:Upload 58.17%
06:01:06:WU02:FS00:Upload 92.51%
06:01:08:WU00:FS02:Upload 59.39%
06:01:12:WU02:FS00:Upload 94.30%
06:01:14:WU00:FS02:Upload 61.30%
06:01:18:WU02:FS00:Upload 96.10%
06:01:20:WU00:FS02:Upload 63.39%
06:01:34:WU00:FS02:Upload 64.78%
06:01:41:WU00:FS02:Upload 64.96%
06:01:57:WU03:FS02:0x18:Completed 275000 out of 2500000 steps (11%)
06:02:08:WU02:FS00:Upload 98.34%
06:02:27:WU02:FS00:Upload 98.57%
06:02:34:WU00:FS02:Upload 65.31%
06:02:44:WU00:FS02:Upload 65.48%
06:02:50:WU02:FS00:Upload 98.79%
06:02:58:WU00:FS02:Upload 65.66%
06:03:08:WU00:FS02:Upload 65.83%
06:03:09:WU02:FS00:Upload 99.02%
06:03:20:WU00:FS02:Upload 66.00%
06:03:34:WU02:FS00:Upload 99.24%
06:03:39:WU03:FS02:0x18:Completed 300000 out of 2500000 steps (12%)
06:03:43:WU00:FS02:Upload 66.18%
06:03:45:WU02:FS00:Upload 99.47%
06:04:03:WU00:FS02:Upload 66.35%
06:04:04:WU02:FS00:Upload 99.69%
06:04:16:WU00:FS02:Upload 66.53%
06:04:25:WU02:FS00:Upload 99.92%
06:04:27:WU00:FS02:Upload 66.70%
06:04:39:WU00:FS02:Upload 67.05%
06:04:46:WU00:FS02:Upload 67.22%
06:04:52:WU02:FS00:Upload complete
06:04:52:WU02:FS00:Server responded GOT_ALREADY (434)
06:04:52:WARNING:WU02:FS00:Server did not like results, dumping
06:04:52:WU02:FS00:Cleaning up
06:04:52:WU00:FS02:Upload 67.40%
06:04:55:WU07:FS01:0x21:Completed 3350000 out of 5000000 steps (67%)
06:04:59:WU00:FS02:Upload 67.57%
06:05:08:WU00:FS02:Upload 67.74%
06:05:18:WU00:FS02:Upload 68.09%
06:05:25:WU00:FS02:Upload 68.27%
06:05:29:WU04:FS00:0xa4:Completed 12500 out of 1250000 steps  (1%)
06:05:36:WU00:FS02:Upload 68.62%
06:05:42:WU00:FS02:Upload 68.79%
06:05:43:WU03:FS02:0x18:Completed 325000 out of 2500000 steps (13%)
06:05:56:WU00:FS02:Upload 69.14%
06:06:10:WU00:FS02:Upload 69.31%
06:06:19:WU00:FS02:Upload 69.49%
06:06:33:WU00:FS02:Upload 69.66%
06:06:43:WU00:FS02:Upload 70.01%
06:06:55:WU00:FS02:Upload 70.18%
06:07:02:WU00:FS02:Upload 70.36%
06:07:09:WU00:FS02:Upload 70.53%
06:07:19:WU00:FS02:Upload 70.71%
06:07:26:WU03:FS02:0x18:Completed 350000 out of 2500000 steps (14%)
06:07:27:WU00:FS02:Upload 70.88%
06:07:47:WU00:FS02:Upload 71.05%
06:07:57:WU00:FS02:Upload 71.23%
06:08:04:WU00:FS02:Upload 71.40%
06:08:13:WU00:FS02:Upload 71.58%
06:08:24:WU00:FS02:Upload 71.75%
06:08:36:WU00:FS02:Upload 72.10%
06:08:46:WU00:FS02:Upload 72.27%
06:08:54:WU00:FS02:Upload 72.45%
06:09:02:WU00:FS02:Upload 72.62%
06:09:09:WU03:FS02:0x18:Completed 375000 out of 2500000 steps (15%)
06:09:13:WU07:FS01:0x21:Completed 3400000 out of 5000000 steps (68%)
06:09:16:WU00:FS02:Upload 72.80%
06:09:28:WU00:FS02:Upload 72.97%
06:09:38:WU00:FS02:Upload 73.14%
06:10:09:WU00:FS02:Upload 73.32%
06:10:34:WU00:FS02:Upload 73.49%
06:10:34:WARNING:WU00:FS02:Exception: Failed to send results to work server: Transfer failed
06:10:34:WU00:FS02:Trying to send results to collection server
06:10:34:WU00:FS02:Uploading 35.89MiB to 128.252.203.2
06:10:34:WU00:FS02:Connecting to 128.252.203.2:8080
06:10:40:WU00:FS02:Upload 0.35%
06:10:51:WU00:FS02:Upload 0.52%
06:10:52:WU03:FS02:0x18:Completed 400000 out of 2500000 steps (16%)
06:11:38:WU00:FS02:Upload 0.70%
06:11:45:WU00:FS02:Upload 0.87%
06:11:58:WU00:FS02:Upload 1.22%
06:12:18:WU00:FS02:Upload 1.39%
06:12:28:WU00:FS02:Upload 1.57%
06:12:34:WU00:FS02:Upload 1.74%
06:12:44:WU00:FS02:Upload 1.92%
06:12:52:WU03:FS02:0x18:Completed 425000 out of 2500000 steps (17%)
06:12:56:WU00:FS02:Upload 2.09%
06:13:03:WU00:FS02:Upload 2.26%
06:13:23:WU00:FS02:Upload 2.44%
06:13:26:WU07:FS01:0x21:Completed 3450000 out of 5000000 steps (69%)
06:14:32:WU00:FS02:Upload 2.61%
06:14:36:WU03:FS02:0x18:Completed 450000 out of 2500000 steps (18%)
06:14:40:WU00:FS02:Upload 2.79%
06:14:50:WU00:FS02:Upload 2.96%
06:14:56:WU00:FS02:Upload 3.13%
06:15:08:WU00:FS02:Upload 3.31%
06:15:18:WU00:FS02:Upload 3.48%
06:15:30:WU00:FS02:Upload 3.83%
06:15:33:WU04:FS00:0xa4:Completed 25000 out of 1250000 steps  (2%)
06:15:36:WU00:FS02:Upload 4.01%
06:15:47:WU00:FS02:Upload 4.18%
06:16:18:WU03:FS02:0x18:Completed 475000 out of 2500000 steps (19%)
06:16:58:WU00:FS02:Upload 4.35%
06:17:05:WU00:FS02:Upload 4.53%
06:17:14:FS00:Paused
06:17:14:FS01:Paused
06:17:14:FS02:Paused
06:17:14:FS00:Shutting core down
06:17:14:FS01:Shutting core down
06:17:14:FS02:Shutting core down
06:17:14:WU07:FS01:0x21:WARNING:Console control signal 1 on PID 6528
06:17:14:WU03:FS02:0x18:WARNING:Console control signal 1 on PID 5060
06:17:14:WU07:FS01:0x21:Exiting, please wait. . .
06:17:14:WU03:FS02:0x18:Exiting, please wait. . .
06:17:14:WU07:FS01:0x21:Folding@home Core Shutdown: INTERRUPTED
06:17:14:WU03:FS02:0x18:Folding@home Core Shutdown: INTERRUPTED
06:17:16:WU07:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
06:17:16:WU03:FS02:FahCore returned: INTERRUPTED (102 = 0x66)
06:17:20:WU00:FS02:Upload 4.88%
06:17:21:WU04:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
06:17:26:WU00:FS02:Upload 5.05%
06:17:27:Removing old file 'configs/config-20160407-193958.xml'
06:17:27:Saving configuration to config.xml
06:17:27:<config>
06:17:27:  <!-- Slot Control -->
06:17:27:  <power v='FULL'/>
06:17:27:
06:17:27:  <!-- User Information -->
06:17:27:  <passkey v='********************************'/>
06:17:27:  <team v='142900'/>
06:17:27:  <user v='Montague-Cripps'/>
06:17:27:
06:17:27:  <!-- Folding Slots -->
06:17:27:  <slot id='0' type='CPU'>
06:17:27:    <paused v='true'/>
06:17:27:  </slot>
06:17:27:  <slot id='1' type='GPU'>
06:17:27:    <paused v='true'/>
06:17:27:  </slot>
06:17:27:  <slot id='2' type='GPU'>
06:17:27:    <paused v='true'/>
06:17:27:  </slot>
06:17:27:</config>

[Nick200]

OK, reboot worked as per the log file attached:

Code: Select all

*********************** Log Started 2016-04-11T06:35:41Z ***********************
06:35:41:************************* Folding@home Client *************************
06:35:41:      Website: http://folding.stanford.edu/
06:35:41:    Copyright: (c) 2009-2014 Stanford University
06:35:41:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
06:35:41:         Args: --open-web-control
06:35:41:       Config: C:/Users/nickm/AppData/Roaming/FAHClient/config.xml
06:35:41:******************************** Build ********************************
06:35:41:      Version: 7.4.4
06:35:41:         Date: Mar 4 2014
06:35:41:         Time: 20:26:54
06:35:41:      SVN Rev: 4130
06:35:41:       Branch: fah/trunk/client
06:35:41:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
06:35:41:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
06:35:41:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
06:35:41:     Platform: win32 XP
06:35:41:         Bits: 32
06:35:41:         Mode: Release
06:35:41:******************************* System ********************************
06:35:41:          CPU: Intel(R) Core(TM) i7-4790 CPU @ 3.60GHz
06:35:41:       CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
06:35:41:         CPUs: 8
06:35:41:       Memory: 15.85GiB
06:35:41:  Free Memory: 11.60GiB
06:35:41:      Threads: WINDOWS_THREADS
06:35:41:   OS Version: 6.2
06:35:41:  Has Battery: false
06:35:41:   On Battery: false
06:35:41:   UTC Offset: 11
06:35:41:          PID: 8228
06:35:41:          CWD: C:/Users/nickm/AppData/Roaming/FAHClient
06:35:41:           OS: Windows 10 Pro Insider Preview
06:35:41:      OS Arch: AMD64
06:35:41:         GPUs: 2
06:35:41:        GPU 0: NVIDIA:5 GM204 [GeForce GTX 980]
06:35:41:        GPU 1: NVIDIA:5 GM204 [GeForce GTX 980]
06:35:41:         CUDA: 5.2
06:35:41:  CUDA Driver: 8000
06:35:41:Win32 Service: false
06:35:41:***********************************************************************
06:35:41:<config>
06:35:41:  <!-- Slot Control -->
06:35:41:  <power v='FULL'/>
06:35:41:
06:35:41:  <!-- User Information -->
06:35:41:  <passkey v='********************************'/>
06:35:41:  <team v='142900'/>
06:35:41:  <user v='Montague-Cripps'/>
06:35:41:
06:35:41:  <!-- Folding Slots -->
06:35:41:  <slot id='0' type='CPU'/>
06:35:41:  <slot id='1' type='GPU'/>
06:35:41:  <slot id='2' type='GPU'/>
06:35:41:</config>
06:35:41:Trying to access database...
06:35:41:Successfully acquired database lock
06:35:41:Enabled folding slot 00: READY cpu:6
06:35:41:Enabled folding slot 01: READY gpu:0:GM204 [GeForce GTX 980]
06:35:41:Enabled folding slot 02: READY gpu:1:GM204 [GeForce GTX 980]
06:35:41:WU00:FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:10494 run:8 clone:13 gen:109 core:0x21 unit:0x0000008b8ca304f555de93fa7927a275
06:35:41:WU00:FS02:Uploading 35.89MiB to 140.163.4.245
06:35:41:WU07:FS01:Starting
06:35:41:WU00:FS02:Connecting to 140.163.4.245:8080
06:35:41:WU07:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/nickm/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 07 -suffix 01 -version 704 -lifeline 8228 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
06:35:42:WU07:FS01:Started FahCore on PID 7228
06:35:42:WU07:FS01:Core PID:8972
06:35:42:WU07:FS01:FahCore 0x21 started
06:35:42:WU03:FS02:Starting
06:35:42:WU03:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/nickm/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 03 -suffix 01 -version 704 -lifeline 8228 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
06:35:42:WU03:FS02:Started FahCore on PID 6640
06:35:42:WU03:FS02:Core PID:7576
06:35:42:WU03:FS02:FahCore 0x18 started
06:35:42:WU07:FS01:0x21:*********************** Log Started 2016-04-11T06:35:42Z ***********************
06:35:42:WU07:FS01:0x21:Project: 11406 (Run 5, Clone 37, Gen 54)
06:35:42:WU07:FS01:0x21:Unit: 0x000000478ca304f25686b1eb96e7e003
06:35:42:WU07:FS01:0x21:CPU: 0x00000000000000000000000000000000
06:35:42:WU07:FS01:0x21:Machine: 1
06:35:42:WU07:FS01:0x21:Digital signatures verified
06:35:42:WU07:FS01:0x21:Folding@home GPU Core21 Folding@home Core
06:35:42:WU07:FS01:0x21:Version 0.0.17
06:35:42:WU04:FS00:Starting
06:35:42:WU04:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/nickm/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 04 -suffix 01 -version 704 -lifeline 8228 -checkpoint 15 -np 6
06:35:42:WU04:FS00:Started FahCore on PID 8764
06:35:42:WU04:FS00:Core PID:8804
06:35:42:WU04:FS00:FahCore 0xa4 started
06:35:43:WU04:FS00:0xa4:
06:35:43:WU03:FS02:0x18:*********************** Log Started 2016-04-11T06:35:42Z ***********************
06:35:43:WU04:FS00:0xa4:*------------------------------*
06:35:43:WU03:FS02:0x18:Project: 9136 (Run 23, Clone 0, Gen 456)
06:35:43:WU04:FS00:0xa4:Folding@Home Gromacs GB Core
06:35:43:WU03:FS02:0x18:Unit: 0x000002120a3b1e615564ef1d3fe3768c
06:35:43:WU04:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
06:35:43:WU03:FS02:0x18:CPU: 0x00000000000000000000000000000000
06:35:43:WU04:FS00:0xa4:
06:35:43:WU03:FS02:0x18:Machine: 2
06:35:43:WU04:FS00:0xa4:Preparing to commence simulation
06:35:43:WU03:FS02:0x18:Digital signatures verified
06:35:43:WU04:FS00:0xa4:- Looking at optimizations...
06:35:43:WU07:FS01:0x21:  Found a checkpoint file
06:35:43:WU03:FS02:0x18:Folding@home GPU core18
06:35:43:WU04:FS00:0xa4:- Files status OK
06:35:43:WU03:FS02:0x18:Version 0.0.4
06:35:43:WU04:FS00:0xa4:- Expanded 1657961 -> 3106984 (decompressed 187.3 percent)
06:35:43:WU03:FS02:0x18:  Found a checkpoint file
06:35:43:WU04:FS00:0xa4:Called DecompressByteArray: compressed_data_size=1657961 data_size=3106984, decompressed_data_size=3106984 diff=0
06:35:43:WU04:FS00:0xa4:- Digital signature verified
06:35:43:WU04:FS00:0xa4:
06:35:43:WU04:FS00:0xa4:Project: 11650 (Run 56, Clone 0, Gen 7)
06:35:43:WU04:FS00:0xa4:
06:35:43:WU04:FS00:0xa4:Assembly optimizations on if available.
06:35:43:WU04:FS00:0xa4:Entering M.D.
06:35:47:WU00:FS02:Upload 3.48%
06:35:49:WU04:FS00:0xa4:Using Gromacs checkpoints
06:35:49:WU04:FS00:0xa4:Mapping NT from 6 to 6 
06:35:49:WU04:FS00:0xa4:Resuming from checkpoint
06:35:49:WU04:FS00:0xa4:Verified 04/wudata_01.log
06:35:49:WU04:FS00:0xa4:Verified 04/wudata_01.trr
06:35:49:WU04:FS00:0xa4:Verified 04/wudata_01.xtc
06:35:49:WU04:FS00:0xa4:Verified 04/wudata_01.edr
06:35:49:WU04:FS00:0xa4:Completed 19660 out of 1250000 steps  (1%)
06:35:53:WU07:FS01:0x21:Completed 3375000 out of 5000000 steps (67%)
06:35:53:WU07:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
06:35:53:WU00:FS02:Upload 6.79%
06:35:59:WU00:FS02:Upload 10.97%
06:36:05:WU00:FS02:Upload 13.58%
06:36:11:WU00:FS02:Upload 17.42%
06:36:13:WU03:FS02:0x18:Completed 400000 out of 2500000 steps (16%)
06:36:13:WU03:FS02:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
06:36:17:WU00:FS02:Upload 21.59%
06:36:23:WU00:FS02:Upload 25.43%
06:36:29:WU00:FS02:Upload 28.91%
06:36:35:WU00:FS02:Upload 33.09%
06:36:41:WU00:FS02:Upload 34.31%
06:36:47:WU00:FS02:Upload 37.44%
06:36:53:WU00:FS02:Upload 41.27%
06:36:59:WU00:FS02:Upload 45.63%
06:37:05:WU00:FS02:Upload 47.19%
06:37:11:WU00:FS02:Upload 50.50%
06:37:17:WU00:FS02:Upload 54.68%
06:37:23:WU00:FS02:Upload 58.86%
06:37:29:WU00:FS02:Upload 62.87%
06:37:35:WU00:FS02:Upload 66.35%
06:37:41:WU00:FS02:Upload 69.49%
06:37:47:WU00:FS02:Upload 73.67%
06:37:53:WU00:FS02:Upload 77.67%
06:37:59:WU00:FS02:Upload 80.28%
06:38:05:WU00:FS02:Upload 83.77%
06:38:05:WU03:FS02:0x18:Completed 425000 out of 2500000 steps (17%)
06:38:07:WU07:FS01:0x21:Completed 3400000 out of 5000000 steps (68%)
06:38:11:WU00:FS02:Upload 86.73%
06:38:17:WU00:FS02:Upload 90.38%
06:38:23:WU00:FS02:Upload 94.39%
06:38:29:WU00:FS02:Upload 98.40%
06:39:16:WU00:FS02:Upload complete
06:39:16:WU00:FS02:Server responded WORK_ACK (400)
06:39:16:WU00:FS02:Final credit estimate, 71209.00 points
06:39:16:WU00:FS02:Cleaning up

Odd thing is that, prior to the reboot, the last WU was uploading by 0.2% increments but, after the reboot, it ploughed through the upload at 4% increments.

Any ideas at to what on earth might explain this bit of FAH weirdness?

[Joe_H]

Usually that message means the WU has already been received from your system, and the resent WU is rejected because of that. The normal reason for that happening is the acknowledgement packet being dropped or blocked somewhere between the WS and your system. The WU would have been credited the previous time it was sent, so you are not losing points. But the client did not get the signal that the WU could be cleaned out as received and then retried.

Rarely in the past this has been due to a WS problem. The only way we can check on that is by having the relevant WU description to check against the database.

[Nick200]

Hi Joe_H, thanks

Does the log give that info as I don't have any other means?

I think it happened at least twice for my last lot of uploads. It is not a problem I have encountered before, apart from after a system restore that started working on WUs previously completed and submitted. Now, what I do under those circumstances, which do not apply here, is to pause and delete the WUs and start afresh.

That said, I do not want my GPUs wasting time by working on jobs they have already completed - is there anyway of preventing that? Is that really something contributors should be expected to be vigilant for?

Thanks

[davidcoton]

Does that message mean my machine has been working on the same WU pointlessly or that someone else pipped me to the post? Either way it has deprived me of points. What gives?

It means that the previous upload actually completed, but the ACK from the server was not received so the WU was not deleted from your PC. You got the points the first time round, be happy! There are no downsides except for that error message (and a WU hanging around unnecessarily on your PC).

AIUI, in no case will you lose out if someone else has the same WU -- the points and timeouts for your work are unaffected. It is unusual (but not unknown) for a WU to be re-assigned before it times out.

[Rel25917]

A follow-up questions,as I have noticed in today's batch of uploads following reboot several instances of:

Code: Select all

06:04:52:WU02:FS00:Server responded GOT_ALREADY (434)
06:04:52:WARNING:WU02:FS00:Server did not like results, dumping
06:04:52:WU02:FS00:Cleaning up

Does that message mean my machine has been working on the same WU pointlessly or that someone else pipped me to the post? Either way it has deprived me of points. What gives?

I can send the full log, but it will probably need editing down as it's likely to be over 60K. Let me know if that will help

This is usually an indication that you already uploaded the unit but the confirmation didn't make it back to you so your computer tried it again. If you post the work unit info from these units a mod can look them up to make sure you got credit.

[bruce]

Does the log give that info as I don't have any other means?

I think it happened at least twice for my last lot of uploads. It is not a problem I have encountered before, apart from after a system restore that started working on WUs previously completed and submitted. Now, what I do under those circumstances, which do not apply here, is to pause and delete the WUs and start afresh.

The log is the right source for any information you can get, although you may need to look at an older log if your system was restarted.

If you do restore a backup which contains a partially completed WU, it's possible for you to reprocess it. Things that can potentially alter FAH's working files should be avoided -- especially since that'll probably disrupt the historic significance of your logs.

The scenario you're suggesting is as follows:
1) Make a backup with a "first WU" in progress.
2) Continue processing and upload that WU while being assigned the "next WU."
3) Crash you system.
4) Restore your system to the state backed up in 1).
NOTE: We're talking about a full backup, including FAH's hidden files, not just the system files belonging to the OS.

In that event, the "first WU" will be completed a second time but will be recognized as a duplicate.
The "next WU" will be lost

[bruce]

I am on build 14316 - and will feed this issue back to Microsoft through the Insider Hub. To what extent Is Microsoft a FAH supporter/sponsor?

No, FAH's major supporters have been Google, Dell, Apple, and Sony. (Microsoft's priorities are elsewhere.)
[See https://folding.stanford.edu/home/about-us/#ntoc17]

From the looks of things, the most likely source of the problem is your ISP. The fact that you notice a difference between weekends and weekdays is a pretty good sign that one of the closest links to your computer is overloaded on weekends.

I'd start monitoring effective line-speeds and effective error rates and see if you can give useful information to your ISP's tech support people, though they're really in a better position to monitor those things.