P14268 work unit not uploading

Moderators: Site Moderators, FAHC Science Team

P14268 work unit not uploading

Postby jonault » Tue Feb 11, 2020 7:51 pm

I have a work unit from P14268 that has been trying to upload since last Friday without success, even though other work units are successfully uploading to the same server.

Take a look at this snippet from yesterday's log file:

Code: Select all
*********************** Log Started 2020-02-10T19:39:19Z ***********************
19:39:19:************************* Folding@home Client *************************
19:39:19:        Website: https://foldingathome.org/
19:39:19:      Copyright: (c) 2009-2018 foldingathome.org
19:39:19:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
19:39:19:           Args: --open-web-control
19:39:19:         Config: C:\Users\Jon\AppData\FAHClient\config.xml
19:39:19:******************************** Build ********************************
19:39:19:        Version: 7.5.1
19:39:19:           Date: May 11 2018
19:39:19:           Time: 13:06:32
19:39:19:     Repository: Git
19:39:19:       Revision: 4705bf53c635f88b8fe85af7675557e15d491ff0
19:39:19:         Branch: master
19:39:19:       Compiler: Visual C++ 2008
19:39:19:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
19:39:19:       Platform: win32 10
19:39:19:           Bits: 32
19:39:19:           Mode: Release
19:39:19:******************************* System ********************************
19:39:19:            CPU: Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz
19:39:19:         CPU ID: GenuineIntel Family 6 Model 158 Stepping 12
19:39:19:           CPUs: 8
19:39:19:         Memory: 15.92GiB
19:39:19:    Free Memory: 13.58GiB
19:39:19:        Threads: WINDOWS_THREADS
19:39:19:     OS Version: 6.2
19:39:19:    Has Battery: true
19:39:19:     On Battery: false
19:39:19:     UTC Offset: -6
19:39:19:            PID: 12112
19:39:19:            CWD: C:\Users\Jon\AppData\FAHClient
19:39:19:             OS: Windows 10 Enterprise
19:39:19:        OS Arch: AMD64
19:39:19:           GPUs: 2
19:39:19:          GPU 0: Bus:1 Slot:0 Func:0 NVIDIA:8 TU102 [GeForce RTX 2080 Ti] M
19:39:19:                 13448
19:39:19:          GPU 1: Bus:2 Slot:0 Func:0 NVIDIA:5 GM204 [GeForce GTX 970]
19:39:19:  CUDA Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:7.5 Driver:10.2
19:39:19:  CUDA Device 1: Platform:0 Device:1 Bus:2 Slot:0 Compute:5.2 Driver:10.2
19:39:19:OpenCL Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:1.2 Driver:442.19
19:39:19:OpenCL Device 1: Platform:0 Device:1 Bus:2 Slot:0 Compute:1.2 Driver:442.19
19:39:19:  Win32 Service: false
19:39:19:***********************************************************************
19:39:19:<config>
19:39:19:  <!-- Network -->
19:39:19:  <proxy v=':8080'/>
19:39:19:
19:39:19:  <!-- Slot Control -->
19:39:19:  <power v='full'/>
19:39:19:
19:39:19:  <!-- User Information -->
19:39:19:  <passkey v='********************************'/>
19:39:19:  <team v='1971'/>
19:39:19:  <user v='Jon_Ault'/>
19:39:19:
19:39:19:  <!-- Folding Slots -->
19:39:19:  <slot id='1' type='GPU'>
19:39:19:    <client-type v='advanced'/>
19:39:19:    <paused v='true'/>
19:39:19:  </slot>
19:39:19:  <slot id='2' type='GPU'>
19:39:19:    <client-type v='advanced'/>
19:39:19:    <paused v='true'/>
19:39:19:  </slot>
19:39:19:</config>
19:39:19:Trying to access database...
19:39:19:Successfully acquired database lock
19:39:19:Enabled folding slot 01: PAUSED gpu:0:TU102 [GeForce RTX 2080 Ti] M 13448 (by user)
19:39:19:Enabled folding slot 02: PAUSED gpu:1:GM204 [GeForce GTX 970] (by user)
19:39:19:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:14268 run:0 clone:57 gen:170 core:0x21 unit:0x000000bf80fccb0a5daa000a07a223ce
19:39:19:WU01:FS02:Uploading 156.00MiB to 128.252.203.10
19:39:19:WU01:FS02:Connecting to 128.252.203.10:8080
19:39:20:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
19:39:20:WU01:FS02:Trying to send results to collection server
19:39:20:WU01:FS02:Uploading 156.00MiB to 155.247.166.219
19:39:20:WU01:FS02:Connecting to 155.247.166.219:8080
19:39:21:ERROR:WU01:FS02:Exception: Transfer failed
19:39:21:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:14268 run:0 clone:57 gen:170 core:0x21 unit:0x000000bf80fccb0a5daa000a07a223ce
19:39:21:WU01:FS02:Uploading 156.00MiB to 128.252.203.10
19:39:21:WU01:FS02:Connecting to 128.252.203.10:8080
19:39:21:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
19:39:21:WU01:FS02:Trying to send results to collection server
19:39:21:WU01:FS02:Uploading 156.00MiB to 155.247.166.219
19:39:21:WU01:FS02:Connecting to 155.247.166.219:8080
19:39:21:ERROR:WU01:FS02:Exception: Transfer failed
19:39:21:8:127.0.0.1:New Web connection
19:40:21:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:14268 run:0 clone:57 gen:170 core:0x21 unit:0x000000bf80fccb0a5daa000a07a223ce
19:40:21:WU01:FS02:Uploading 156.00MiB to 128.252.203.10
19:40:21:WU01:FS02:Connecting to 128.252.203.10:8080
19:40:21:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
19:40:21:WU01:FS02:Trying to send results to collection server
19:40:21:WU01:FS02:Uploading 156.00MiB to 155.247.166.219
19:40:21:WU01:FS02:Connecting to 155.247.166.219:8080
19:40:21:ERROR:WU01:FS02:Exception: Transfer failed
19:41:58:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:14268 run:0 clone:57 gen:170 core:0x21 unit:0x000000bf80fccb0a5daa000a07a223ce
19:41:58:WU01:FS02:Uploading 156.00MiB to 128.252.203.10
19:41:58:WU01:FS02:Connecting to 128.252.203.10:8080
19:41:58:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
19:41:58:WU01:FS02:Trying to send results to collection server
19:41:58:WU01:FS02:Uploading 156.00MiB to 155.247.166.219
19:41:58:WU01:FS02:Connecting to 155.247.166.219:8080
19:41:58:ERROR:WU01:FS02:Exception: Transfer failed
19:41:59:FS01:Unpaused
19:41:59:FS02:Unpaused
19:41:59:WU00:FS02:Starting
19:41:59:WU00:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Jon\AppData\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/nvidia/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 705 -lifeline 12112 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 1 -cuda-device 1 -gpu 1
19:42:00:WU00:FS02:Started FahCore on PID 17524
19:42:00:WU00:FS02:Core PID:17548
19:42:00:WU00:FS02:FahCore 0x21 started
19:42:00:WU02:FS01:Starting
19:42:00:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Jon\AppData\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/nvidia/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 705 -lifeline 12112 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
19:42:00:WU02:FS01:Started FahCore on PID 17568
19:42:00:WU02:FS01:Core PID:17592
19:42:00:WU02:FS01:FahCore 0x21 started
19:42:00:WU00:FS02:0x21:*********************** Log Started 2020-02-10T19:42:00Z ***********************
19:42:00:WU00:FS02:0x21:Project: 14323 (Run 1, Clone 7, Gen 6)
19:42:00:WU00:FS02:0x21:Unit: 0x000000080002894c5e2f1520861ab4c4
19:42:00:WU00:FS02:0x21:CPU: 0x00000000000000000000000000000000
19:42:00:WU00:FS02:0x21:Machine: 2
19:42:00:WU00:FS02:0x21:Digital signatures verified
19:42:00:WU00:FS02:0x21:Folding@home GPU Core21 Folding@home Core
19:42:00:WU00:FS02:0x21:Version 0.0.20
19:42:00:WU00:FS02:0x21:  Found a checkpoint file
19:42:00:WU02:FS01:0x21:*********************** Log Started 2020-02-10T19:42:00Z ***********************
19:42:00:WU02:FS01:0x21:Project: 14294 (Run 0, Clone 18, Gen 73)
19:42:00:WU02:FS01:0x21:Unit: 0x0000005080fccb0a5e0e6ce093fc1c64
19:42:00:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
19:42:00:WU02:FS01:0x21:Machine: 1
19:42:00:WU02:FS01:0x21:Digital signatures verified
19:42:00:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
19:42:00:WU02:FS01:0x21:Version 0.0.20
19:42:00:WU02:FS01:0x21:  Found a checkpoint file
19:42:01:WU00:FS02:0x21:Completed 13500000 out of 25000000 steps (54%)
19:42:01:WU00:FS02:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
19:42:06:WU02:FS01:0x21:Completed 380000 out of 1000000 steps (38%)
19:42:06:WU02:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
19:42:22:Removing old file 'configs/config-20200207-164624.xml'
19:42:22:Saving configuration to config.xml
19:42:22:<config>
19:42:22:  <!-- Network -->
19:42:22:  <proxy v=':8080'/>
19:42:22:
19:42:22:  <!-- Slot Control -->
19:42:22:  <power v='full'/>
19:42:22:
19:42:22:  <!-- User Information -->
19:42:22:  <passkey v='********************************'/>
19:42:22:  <team v='1971'/>
19:42:22:  <user v='Jon_Ault'/>
19:42:22:
19:42:22:  <!-- Folding Slots -->
19:42:22:  <slot id='1' type='GPU'>
19:42:22:    <client-type v='advanced'/>
19:42:22:  </slot>
19:42:22:  <slot id='2' type='GPU'>
19:42:22:    <client-type v='advanced'/>
19:42:22:  </slot>
19:42:22:</config>
19:42:24:WU02:FS01:0x21:Completed 390000 out of 1000000 steps (39%)
19:42:41:WU02:FS01:0x21:Completed 400000 out of 1000000 steps (40%)
19:42:58:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:14268 run:0 clone:57 gen:170 core:0x21 unit:0x000000bf80fccb0a5daa000a07a223ce
19:42:58:WU01:FS02:Uploading 156.00MiB to 128.252.203.10
19:42:58:WU01:FS02:Connecting to 128.252.203.10:8080
19:42:58:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
19:42:58:WU01:FS02:Trying to send results to collection server
19:42:58:WU01:FS02:Uploading 156.00MiB to 155.247.166.219
19:42:58:WU01:FS02:Connecting to 155.247.166.219:8080
19:42:59:ERROR:WU01:FS02:Exception: Transfer failed
19:43:01:WU02:FS01:0x21:Completed 410000 out of 1000000 steps (41%)
19:43:18:WU02:FS01:0x21:Completed 420000 out of 1000000 steps (42%)
19:43:38:WU02:FS01:0x21:Completed 430000 out of 1000000 steps (43%)
19:43:56:WU02:FS01:0x21:Completed 440000 out of 1000000 steps (44%)
19:44:16:WU02:FS01:0x21:Completed 450000 out of 1000000 steps (45%)
19:44:33:WU02:FS01:0x21:Completed 460000 out of 1000000 steps (46%)
19:44:35:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:14268 run:0 clone:57 gen:170 core:0x21 unit:0x000000bf80fccb0a5daa000a07a223ce
19:44:35:WU01:FS02:Uploading 156.00MiB to 128.252.203.10
19:44:35:WU01:FS02:Connecting to 128.252.203.10:8080
19:44:36:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
19:44:36:WU01:FS02:Trying to send results to collection server
19:44:36:WU01:FS02:Uploading 156.00MiB to 155.247.166.219
19:44:36:WU01:FS02:Connecting to 155.247.166.219:8080
19:44:36:ERROR:WU01:FS02:Exception: Transfer failed
19:44:53:WU02:FS01:0x21:Completed 470000 out of 1000000 steps (47%)
19:45:11:WU02:FS01:0x21:Completed 480000 out of 1000000 steps (48%)
19:45:31:WU02:FS01:0x21:Completed 490000 out of 1000000 steps (49%)
19:45:49:WU02:FS01:0x21:Completed 500000 out of 1000000 steps (50%)
19:46:09:WU02:FS01:0x21:Completed 510000 out of 1000000 steps (51%)
19:46:28:WU02:FS01:0x21:Completed 520000 out of 1000000 steps (52%)
19:46:49:WU02:FS01:0x21:Completed 530000 out of 1000000 steps (53%)
19:47:09:WU02:FS01:0x21:Completed 540000 out of 1000000 steps (54%)
19:47:13:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:14268 run:0 clone:57 gen:170 core:0x21 unit:0x000000bf80fccb0a5daa000a07a223ce
19:47:13:WU01:FS02:Uploading 156.00MiB to 128.252.203.10
19:47:13:WU01:FS02:Connecting to 128.252.203.10:8080
19:47:13:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
19:47:13:WU01:FS02:Trying to send results to collection server
19:47:13:WU01:FS02:Uploading 156.00MiB to 155.247.166.219
19:47:13:WU01:FS02:Connecting to 155.247.166.219:8080
19:47:13:ERROR:WU01:FS02:Exception: Transfer failed
19:47:31:WU02:FS01:0x21:Completed 550000 out of 1000000 steps (55%)
19:47:51:WU02:FS01:0x21:Completed 560000 out of 1000000 steps (56%)
19:48:13:WU02:FS01:0x21:Completed 570000 out of 1000000 steps (57%)
19:48:25:WU00:FS02:0x21:Completed 13750000 out of 25000000 steps (55%)
19:48:33:WU02:FS01:0x21:Completed 580000 out of 1000000 steps (58%)
19:48:53:WU02:FS01:0x21:Completed 590000 out of 1000000 steps (59%)
19:49:12:WU02:FS01:0x21:Completed 600000 out of 1000000 steps (60%)
19:49:32:WU02:FS01:0x21:Completed 610000 out of 1000000 steps (61%)
19:49:51:WU02:FS01:0x21:Completed 620000 out of 1000000 steps (62%)
19:50:12:WU02:FS01:0x21:Completed 630000 out of 1000000 steps (63%)
19:50:30:WU02:FS01:0x21:Completed 640000 out of 1000000 steps (64%)
19:50:51:WU02:FS01:0x21:Completed 650000 out of 1000000 steps (65%)
19:51:10:WU02:FS01:0x21:Completed 660000 out of 1000000 steps (66%)
19:51:27:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:14268 run:0 clone:57 gen:170 core:0x21 unit:0x000000bf80fccb0a5daa000a07a223ce
19:51:27:WU01:FS02:Uploading 156.00MiB to 128.252.203.10
19:51:27:WU01:FS02:Connecting to 128.252.203.10:8080
19:51:27:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
19:51:27:WU01:FS02:Trying to send results to collection server
19:51:27:WU01:FS02:Uploading 156.00MiB to 155.247.166.219
19:51:27:WU01:FS02:Connecting to 155.247.166.219:8080
19:51:27:ERROR:WU01:FS02:Exception: Transfer failed
19:51:30:WU02:FS01:0x21:Completed 670000 out of 1000000 steps (67%)
19:51:50:WU02:FS01:0x21:Completed 680000 out of 1000000 steps (68%)
19:52:10:WU02:FS01:0x21:Completed 690000 out of 1000000 steps (69%)
19:52:29:WU02:FS01:0x21:Completed 700000 out of 1000000 steps (70%)
19:52:50:WU02:FS01:0x21:Completed 710000 out of 1000000 steps (71%)
19:53:09:WU02:FS01:0x21:Completed 720000 out of 1000000 steps (72%)
19:53:29:WU02:FS01:0x21:Completed 730000 out of 1000000 steps (73%)
19:53:48:WU02:FS01:0x21:Completed 740000 out of 1000000 steps (74%)
19:54:09:WU02:FS01:0x21:Completed 750000 out of 1000000 steps (75%)
19:54:28:WU02:FS01:0x21:Completed 760000 out of 1000000 steps (76%)
19:54:49:WU02:FS01:0x21:Completed 770000 out of 1000000 steps (77%)
19:54:50:WU00:FS02:0x21:Completed 14000000 out of 25000000 steps (56%)
19:55:08:WU02:FS01:0x21:Completed 780000 out of 1000000 steps (78%)
19:55:29:WU02:FS01:0x21:Completed 790000 out of 1000000 steps (79%)
19:55:48:WU02:FS01:0x21:Completed 800000 out of 1000000 steps (80%)
19:56:09:WU02:FS01:0x21:Completed 810000 out of 1000000 steps (81%)
19:56:28:WU02:FS01:0x21:Completed 820000 out of 1000000 steps (82%)
19:56:48:WU02:FS01:0x21:Completed 830000 out of 1000000 steps (83%)
19:57:08:WU02:FS01:0x21:Completed 840000 out of 1000000 steps (84%)
19:57:29:WU02:FS01:0x21:Completed 850000 out of 1000000 steps (85%)
19:57:47:WU02:FS01:0x21:Completed 860000 out of 1000000 steps (86%)
19:58:08:WU02:FS01:0x21:Completed 870000 out of 1000000 steps (87%)
19:58:18:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:14268 run:0 clone:57 gen:170 core:0x21 unit:0x000000bf80fccb0a5daa000a07a223ce
19:58:18:WU01:FS02:Uploading 156.00MiB to 128.252.203.10
19:58:18:WU01:FS02:Connecting to 128.252.203.10:8080
19:58:18:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
19:58:18:WU01:FS02:Trying to send results to collection server
19:58:18:WU01:FS02:Uploading 156.00MiB to 155.247.166.219
19:58:18:WU01:FS02:Connecting to 155.247.166.219:8080
19:58:19:ERROR:WU01:FS02:Exception: Transfer failed
19:58:27:WU02:FS01:0x21:Completed 880000 out of 1000000 steps (88%)
19:58:47:WU02:FS01:0x21:Completed 890000 out of 1000000 steps (89%)
19:59:05:WU02:FS01:0x21:Completed 900000 out of 1000000 steps (90%)
19:59:26:WU02:FS01:0x21:Completed 910000 out of 1000000 steps (91%)
19:59:44:WU02:FS01:0x21:Completed 920000 out of 1000000 steps (92%)
20:00:05:WU02:FS01:0x21:Completed 930000 out of 1000000 steps (93%)
20:00:23:WU02:FS01:0x21:Completed 940000 out of 1000000 steps (94%)
20:00:43:WU02:FS01:0x21:Completed 950000 out of 1000000 steps (95%)
20:01:02:WU02:FS01:0x21:Completed 960000 out of 1000000 steps (96%)
20:01:15:WU00:FS02:0x21:Completed 14250000 out of 25000000 steps (57%)
20:01:22:WU02:FS01:0x21:Completed 970000 out of 1000000 steps (97%)
20:01:40:WU02:FS01:0x21:Completed 980000 out of 1000000 steps (98%)
20:02:01:WU02:FS01:0x21:Completed 990000 out of 1000000 steps (99%)
20:02:01:WU03:FS01:Connecting to 65.254.110.245:8080
20:02:01:WU03:FS01:Assigned to work server 155.247.166.220
20:02:01:WU03:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:TU102 [GeForce RTX 2080 Ti] M 13448 from 155.247.166.220
20:02:01:WU03:FS01:Connecting to 155.247.166.220:8080
20:02:01:WU03:FS01:Downloading 7.40MiB
20:02:05:WU03:FS01:Download complete
20:02:05:WU03:FS01:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:14323 run:9 clone:17 gen:7 core:0x21 unit:0x000000080002894c5e2f15227dd1efee
20:02:19:WU02:FS01:0x21:Completed 1000000 out of 1000000 steps (100%)
20:02:21:WU02:FS01:0x21:Saving result file logfile_01.txt
20:02:21:WU02:FS01:0x21:Saving result file checkpointState.xml
20:02:21:WU02:FS01:0x21:Saving result file checkpt.crc
20:02:21:WU02:FS01:0x21:Saving result file log.txt
20:02:22:WU02:FS01:0x21:Saving result file positions.xtc
20:02:22:WU02:FS01:0x21:Folding@home Core Shutdown: FINISHED_UNIT
20:02:22:WU02:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
20:02:22:WU02:FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:14294 run:0 clone:18 gen:73 core:0x21 unit:0x0000005080fccb0a5e0e6ce093fc1c64
20:02:22:WU02:FS01:Uploading 33.32MiB to 128.252.203.10
20:02:22:WU02:FS01:Connecting to 128.252.203.10:8080
20:02:22:WU03:FS01:Starting
20:02:22:WU03:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Jon\AppData\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/nvidia/Core_21.fah/FahCore_21.exe -dir 03 -suffix 01 -version 705 -lifeline 12112 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
20:02:22:WU03:FS01:Started FahCore on PID 6200
20:02:22:WU03:FS01:Core PID:7332
20:02:22:WU03:FS01:FahCore 0x21 started
20:02:23:WU03:FS01:0x21:*********************** Log Started 2020-02-10T20:02:22Z ***********************
20:02:23:WU03:FS01:0x21:Project: 14323 (Run 9, Clone 17, Gen 7)
20:02:23:WU03:FS01:0x21:Unit: 0x000000080002894c5e2f15227dd1efee
20:02:23:WU03:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:02:23:WU03:FS01:0x21:Machine: 1
20:02:23:WU03:FS01:0x21:Reading tar file core.xml
20:02:23:WU03:FS01:0x21:Reading tar file integrator.xml
20:02:23:WU03:FS01:0x21:Reading tar file state.xml
20:02:23:WU03:FS01:0x21:Reading tar file system.xml
20:02:23:WU03:FS01:0x21:Digital signatures verified
20:02:23:WU03:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:02:23:WU03:FS01:0x21:Version 0.0.20
20:02:24:WU03:FS01:0x21:Completed 0 out of 25000000 steps (0%)
20:02:24:WU03:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
20:02:28:WU02:FS01:Upload 23.26%
20:02:34:WU02:FS01:Upload 48.78%
20:02:40:WU02:FS01:Upload 73.16%
20:02:46:WU02:FS01:Upload 97.74%
20:02:47:WU02:FS01:Upload complete
20:02:47:WU02:FS01:Server responded WORK_ACK (400)
20:02:47:WU02:FS01:Final credit estimate, 45704.00 points
20:02:47:WU02:FS01:Cleaning up
20:04:35:WU03:FS01:0x21:Completed 250000 out of 25000000 steps (1%)
20:06:45:WU03:FS01:0x21:Completed 500000 out of 25000000 steps (2%)
20:07:40:WU00:FS02:0x21:Completed 14500000 out of 25000000 steps (58%)
20:08:55:WU03:FS01:0x21:Completed 750000 out of 25000000 steps (3%)
20:09:24:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:14268 run:0 clone:57 gen:170 core:0x21 unit:0x000000bf80fccb0a5daa000a07a223ce
20:09:24:WU01:FS02:Uploading 156.00MiB to 128.252.203.10
20:09:24:WU01:FS02:Connecting to 128.252.203.10:8080
20:09:24:WARNING:WU01:FS02:Exception: Failed to send results to work server: Transfer failed
20:09:24:WU01:FS02:Trying to send results to collection server
20:09:24:WU01:FS02:Uploading 156.00MiB to 155.247.166.219
20:09:24:WU01:FS02:Connecting to 155.247.166.219:8080
20:09:24:ERROR:WU01:FS02:Exception: Transfer failed


At 19:58:18 it tries to upload the stuck work unit to the work server at 128.252.203.10 & fails, and tries & fails again at 20:09:24, but in between those two failed attempts a different work unit (at 20:02:22) uploads successfully to the same server.

Restarting the PC hasn't helped.
Image
jonault
 
Posts: 176
Joined: Fri Dec 14, 2007 10:53 pm

Re: P14268 work unit not uploading

Postby Joe_H » Tue Feb 11, 2020 8:52 pm

When was this WU downloaded according to your client? This Project 14268 is not listed as currently active on the Project Summary page. Checking here and elsewhere the postings on this project I see date back to October and November.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Joe_H
Site Admin
 
Posts: 6429
Joined: Tue Apr 21, 2009 5:41 pm
Location: W. MA

Re: P14268 work unit not uploading

Postby jonault » Tue Feb 11, 2020 9:04 pm

It was assigned 2020-02-07 02:46:10Z.

The portion of the log where it was downloaded:

Code: Select all
02:46:09:WU01:FS02:Connecting to 65.254.110.245:8080
02:46:09:WU01:FS02:Assigned to work server 128.252.203.10
02:46:09:WU01:FS02:Requesting new work unit for slot 02: RUNNING gpu:1:GM204 [GeForce GTX 970] from 128.252.203.10
02:46:09:WU01:FS02:Connecting to 128.252.203.10:8080
02:46:09:WU01:FS02:Downloading 77.39MiB
02:46:15:WU01:FS02:Download 39.33%
02:46:21:WU01:FS02:Download 93.68%
02:46:21:WU01:FS02:Download complete
02:46:21:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:14268 run:0 clone:57 gen:170 core:0x21 unit:0x000000bf80fccb0a5daa000a07a223ce
02:50:55:WU01:FS02:Starting
02:50:55:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Jon\AppData\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/nvidia/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 705 -lifeline 11468 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 1 -cuda-device 1 -gpu 1
02:50:55:WU01:FS02:Started FahCore on PID 7344
02:50:55:WU01:FS02:Core PID:11808
02:50:55:WU01:FS02:FahCore 0x21 started
02:50:55:WU01:FS02:0x21:*********************** Log Started 2020-02-07T02:50:55Z ***********************
02:50:55:WU01:FS02:0x21:Project: 14268 (Run 0, Clone 57, Gen 170)
02:50:55:WU01:FS02:0x21:Unit: 0x000000bf80fccb0a5daa000a07a223ce
02:50:55:WU01:FS02:0x21:CPU: 0x00000000000000000000000000000000
02:50:55:WU01:FS02:0x21:Machine: 2
02:50:55:WU01:FS02:0x21:Reading tar file core.xml
02:50:55:WU01:FS02:0x21:Reading tar file integrator.xml
02:50:55:WU01:FS02:0x21:Reading tar file state.xml
02:50:56:WU01:FS02:0x21:Reading tar file system.xml
02:50:56:WU01:FS02:0x21:Digital signatures verified
02:50:56:WU01:FS02:0x21:Folding@home GPU Core21 Folding@home Core
02:50:56:WU01:FS02:0x21:Version 0.0.20
02:51:11:WU01:FS02:0x21:Completed 0 out of 1000000 steps (0%)
02:51:11:WU01:FS02:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900

02:54:12:WU01:FS02:0x21:Completed 10000 out of 1000000 steps (1%)
jonault
 
Posts: 176
Joined: Fri Dec 14, 2007 10:53 pm

Re: P14268 work unit not uploading

Postby HaloJones » Tue Feb 11, 2020 11:29 pm

Got a similar problem uploading a 11739 which after 11 minutes has done 8% to 140.163.4.241

after a while it did what it should and dumped it to the collection server
1x Titan X, 5x 1070, 1x 970, 1 x Ryzen 3600

Image
HaloJones
 
Posts: 811
Joined: Thu Jul 24, 2008 11:16 am

Re: P14268 work unit not uploading

Postby Joe_H » Wed Feb 12, 2020 12:42 am

@jonault The researcher has been contacted. Project 14268 had been suspended from assignment, but the server was supposed to be accepting returns. They are looking into the problem.
Joe_H
Site Admin
 
Posts: 6429
Joined: Tue Apr 21, 2009 5:41 pm
Location: W. MA

Re: P14268 work unit not uploading

Postby MacGyver » Sat Feb 15, 2020 10:07 pm

HaloJones wrote:Got a similar problem uploading a 11739 which after 11 minutes has done 8% to 140.163.4.241

after a while it did what it should and dumped it to the collection server



Hi there, I got a lot of hiccups these last days, too. Bad server is 140.163.4.241 also. Here's a bit of log from the latest failed upload (which finished after a reboot and all in all I'd say more than half an hour of tried and failed upload):

Code: Select all
20:53:20:WU02:FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:11737 run:0 clone:327 gen:208 core:0x22 unit:0x000000e98ca304f15df3d374301164fc
20:53:20:WU02:FS01:Uploading 6.51MiB to 140.163.4.241
20:53:20:WU02:FS01:Connecting to 140.163.4.241:8080
20:59:15:WU02:FS01:Upload 58.57%
20:59:15:WARNING:WU02:FS01:Exception: Failed to send results to work server: Transfer failed
20:59:15:WU02:FS01:Trying to send results to collection server
20:59:15:WU02:FS01:Uploading 6.51MiB to 128.252.203.4
20:59:15:WU02:FS01:Connecting to 128.252.203.4:8080
20:59:21:WU02:FS01:Upload 68.17%
20:59:23:WU02:FS01:Upload complete
20:59:23:WU02:FS01:Server responded WORK_ACK (400)
20:59:23:WU02:FS01:Final credit estimate, 80516.00 points
20:59:23:WU02:FS01:Cleaning up
MacGyver
 
Posts: 17
Joined: Sat Jan 04, 2020 11:50 am


Return to Issues with a specific WU

Who is online

Users browsing this forum: No registered users and 2 guests

cron