WU 16420 1478 0 35 - what happened to my one?

[peterjammo]

That one never turned up in the stats, now 1 month plus on.

Had another similar this am. WU completed successfully at approx 1.30am. Multiple fails uploading to WS, then uploaded to CS. Approx 11hrs later reassigned by the WS, soobviously not transferred from CS>WS. Mine yet to show on the stats. Both WS and CS showing UP during that time on the server stats.

This is from my slowest folder and it's on it's own username only doing just over 1wu per day, so more noticable. Maybe I'm just unlucky and it's a very small sample size, but a 1:35 fail rate of this type seems high to me.

Logs available if anyone is interested.

[PantherX]

Can you please post the log file so we can see what WU you're talking about and what happened to it? Also, let us know if the donor name in the client matches your forum name or not

[peterjammo]

Here's the log

Code: Select all

12:51:47:WU01:FS00:0xa7:*********************** Log Started 2020-05-26T12:51:47Z ***********************
12:51:47:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
12:51:47:WU01:FS00:0xa7:       Type: 0xa7
12:51:47:WU01:FS00:0xa7:       Core: Gromacs
12:51:47:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 11556 -checkpoint 15 -np
12:51:47:WU01:FS00:0xa7:             2
12:51:47:WU01:FS00:0xa7:************************************ CBang *************************************
12:51:47:WU01:FS00:0xa7:       Date: Nov 5 2019
12:51:47:WU01:FS00:0xa7:       Time: 05:57:01
12:51:47:WU01:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
12:51:47:WU01:FS00:0xa7:     Branch: master
12:51:47:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
12:51:47:WU01:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
12:51:47:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:51:47:WU01:FS00:0xa7:       Bits: 64
12:51:47:WU01:FS00:0xa7:       Mode: Release
12:51:47:WU01:FS00:0xa7:************************************ System ************************************
12:51:47:WU01:FS00:0xa7:        CPU: Intel(R) Core(TM)2 Duo CPU T5750 @ 2.00GHz
12:51:47:WU01:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 15 Stepping 13
12:51:47:WU01:FS00:0xa7:       CPUs: 2
12:51:47:WU01:FS00:0xa7:     Memory: 3.84GiB
12:51:47:WU01:FS00:0xa7:Free Memory: 254.96MiB
12:51:47:WU01:FS00:0xa7:    Threads: POSIX_THREADS
12:51:47:WU01:FS00:0xa7: OS Version: 4.15
12:51:47:WU01:FS00:0xa7:Has Battery: false
12:51:47:WU01:FS00:0xa7: On Battery: false
12:51:47:WU01:FS00:0xa7: UTC Offset: 1
12:51:47:WU01:FS00:0xa7:        PID: 11560
12:51:47:WU01:FS00:0xa7:        CWD: /var/lib/fahclient/work
12:51:47:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
12:51:47:WU01:FS00:0xa7:    Version: 0.0.18
12:51:47:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
12:51:47:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
12:51:47:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
12:51:47:WU01:FS00:0xa7:       Date: Nov 5 2019
12:51:47:WU01:FS00:0xa7:       Time: 06:13:26
12:51:47:WU01:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
12:51:47:WU01:FS00:0xa7:     Branch: master
12:51:47:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
12:51:47:WU01:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
12:51:47:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
12:51:47:WU01:FS00:0xa7:       Bits: 64
12:51:47:WU01:FS00:0xa7:       Mode: Release
12:51:47:WU01:FS00:0xa7:************************************ Build *************************************
12:51:47:WU01:FS00:0xa7:       SIMD: sse2
12:51:47:WU01:FS00:0xa7:********************************************************************************
12:51:47:WU01:FS00:0xa7:Project: 16406 (Run 973, Clone 1, Gen 98)
12:51:47:WU01:FS00:0xa7:Unit: 0x00000075a8f5c67d5e801f7421e78f3d
12:51:47:WU01:FS00:0xa7:Reading tar file core.xml
12:51:47:WU01:FS00:0xa7:Reading tar file frame98.tpr
12:51:47:WU01:FS00:0xa7:Digital signatures verified
12:51:47:WU01:FS00:0xa7:Calling: mdrun -s frame98.tpr -o frame98.trr -x frame98.xtc -cpt 15 -nt 2
12:51:47:WU01:FS00:0xa7:Steps: first=49000000 total=500000
12:51:49:WU01:FS00:0xa7:Completed 1 out of 500000 steps (0%)
12:51:52:WU00:FS00:Upload 11.05%
12:51:58:WU00:FS00:Upload 46.42%
12:52:05:WU00:FS00:Upload 84.01%
12:52:14:WU00:FS00:Upload 88.43%
12:52:16:WU00:FS00:Upload complete
12:52:16:WU00:FS00:Server responded WORK_ACK (400)
12:52:16:WU00:FS00:Final credit estimate, 1529.00 points
12:52:16:WU00:FS00:Cleaning up
12:59:01:WU01:FS00:0xa7:Completed 5000 out of 500000 steps (1%)
13:06:11:WU01:FS00:0xa7:Completed 10000 out of 500000 steps (2%)
13:13:31:WU01:FS00:0xa7:Completed 15000 out of 500000 steps (3%)
13:20:46:WU01:FS00:0xa7:Completed 20000 out of 500000 steps (4%)
13:27:56:WU01:FS00:0xa7:Completed 25000 out of 500000 steps (5%)
13:35:06:WU01:FS00:0xa7:Completed 30000 out of 500000 steps (6%)
13:42:15:WU01:FS00:0xa7:Completed 35000 out of 500000 steps (7%)
13:49:26:WU01:FS00:0xa7:Completed 40000 out of 500000 steps (8%)
13:56:43:WU01:FS00:0xa7:Completed 45000 out of 500000 steps (9%)
14:03:58:WU01:FS00:0xa7:Completed 50000 out of 500000 steps (10%)
14:11:16:WU01:FS00:0xa7:Completed 55000 out of 500000 steps (11%)
14:18:32:WU01:FS00:0xa7:Completed 60000 out of 500000 steps (12%)
14:25:43:WU01:FS00:0xa7:Completed 65000 out of 500000 steps (13%)
14:32:51:WU01:FS00:0xa7:Completed 70000 out of 500000 steps (14%)
14:40:05:WU01:FS00:0xa7:Completed 75000 out of 500000 steps (15%)
14:47:11:WU01:FS00:0xa7:Completed 80000 out of 500000 steps (16%)
14:54:26:WU01:FS00:0xa7:Completed 85000 out of 500000 steps (17%)
15:01:40:WU01:FS00:0xa7:Completed 90000 out of 500000 steps (18%)
15:08:54:WU01:FS00:0xa7:Completed 95000 out of 500000 steps (19%)
15:16:18:WU01:FS00:0xa7:Completed 100000 out of 500000 steps (20%)
15:23:31:WU01:FS00:0xa7:Completed 105000 out of 500000 steps (21%)
15:30:42:WU01:FS00:0xa7:Completed 110000 out of 500000 steps (22%)
******************************* Date: 2020-05-26 *******************************
15:37:51:WU01:FS00:0xa7:Completed 115000 out of 500000 steps (23%)
15:45:01:WU01:FS00:0xa7:Completed 120000 out of 500000 steps (24%)
15:52:13:WU01:FS00:0xa7:Completed 125000 out of 500000 steps (25%)
15:59:27:WU01:FS00:0xa7:Completed 130000 out of 500000 steps (26%)
16:06:37:WU01:FS00:0xa7:Completed 135000 out of 500000 steps (27%)
16:13:53:WU01:FS00:0xa7:Completed 140000 out of 500000 steps (28%)
16:21:08:WU01:FS00:0xa7:Completed 145000 out of 500000 steps (29%)
16:28:22:WU01:FS00:0xa7:Completed 150000 out of 500000 steps (30%)
16:35:39:WU01:FS00:0xa7:Completed 155000 out of 500000 steps (31%)
16:42:56:WU01:FS00:0xa7:Completed 160000 out of 500000 steps (32%)
16:50:10:WU01:FS00:0xa7:Completed 165000 out of 500000 steps (33%)
16:57:26:WU01:FS00:0xa7:Completed 170000 out of 500000 steps (34%)
17:04:38:WU01:FS00:0xa7:Completed 175000 out of 500000 steps (35%)
17:11:46:WU01:FS00:0xa7:Completed 180000 out of 500000 steps (36%)
17:19:08:WU01:FS00:0xa7:Completed 185000 out of 500000 steps (37%)
17:26:17:WU01:FS00:0xa7:Completed 190000 out of 500000 steps (38%)
17:33:27:WU01:FS00:0xa7:Completed 195000 out of 500000 steps (39%)
17:40:42:WU01:FS00:0xa7:Completed 200000 out of 500000 steps (40%)
17:48:01:WU01:FS00:0xa7:Completed 205000 out of 500000 steps (41%)
17:55:14:WU01:FS00:0xa7:Completed 210000 out of 500000 steps (42%)
18:02:25:WU01:FS00:0xa7:Completed 215000 out of 500000 steps (43%)
18:09:34:WU01:FS00:0xa7:Completed 220000 out of 500000 steps (44%)
18:16:46:WU01:FS00:0xa7:Completed 225000 out of 500000 steps (45%)
18:24:03:WU01:FS00:0xa7:Completed 230000 out of 500000 steps (46%)
18:31:14:WU01:FS00:0xa7:Completed 235000 out of 500000 steps (47%)
18:38:25:WU01:FS00:0xa7:Completed 240000 out of 500000 steps (48%)
18:45:35:WU01:FS00:0xa7:Completed 245000 out of 500000 steps (49%)
18:52:51:WU01:FS00:0xa7:Completed 250000 out of 500000 steps (50%)
19:00:02:WU01:FS00:0xa7:Completed 255000 out of 500000 steps (51%)
19:07:13:WU01:FS00:0xa7:Completed 260000 out of 500000 steps (52%)
19:14:34:WU01:FS00:0xa7:Completed 265000 out of 500000 steps (53%)
19:21:46:WU01:FS00:0xa7:Completed 270000 out of 500000 steps (54%)
19:28:55:WU01:FS00:0xa7:Completed 275000 out of 500000 steps (55%)
19:36:05:WU01:FS00:0xa7:Completed 280000 out of 500000 steps (56%)
19:43:17:WU01:FS00:0xa7:Completed 285000 out of 500000 steps (57%)
19:50:30:WU01:FS00:0xa7:Completed 290000 out of 500000 steps (58%)
19:57:44:WU01:FS00:0xa7:Completed 295000 out of 500000 steps (59%)
20:04:56:WU01:FS00:0xa7:Completed 300000 out of 500000 steps (60%)
20:12:09:WU01:FS00:0xa7:Completed 305000 out of 500000 steps (61%)
20:19:21:WU01:FS00:0xa7:Completed 310000 out of 500000 steps (62%)
20:26:36:WU01:FS00:0xa7:Completed 315000 out of 500000 steps (63%)
20:33:50:WU01:FS00:0xa7:Completed 320000 out of 500000 steps (64%)
20:41:03:WU01:FS00:0xa7:Completed 325000 out of 500000 steps (65%)
20:48:19:WU01:FS00:0xa7:Completed 330000 out of 500000 steps (66%)
20:55:36:WU01:FS00:0xa7:Completed 335000 out of 500000 steps (67%)
21:02:49:WU01:FS00:0xa7:Completed 340000 out of 500000 steps (68%)
21:09:59:WU01:FS00:0xa7:Completed 345000 out of 500000 steps (69%)
21:17:19:WU01:FS00:0xa7:Completed 350000 out of 500000 steps (70%)
21:24:34:WU01:FS00:0xa7:Completed 355000 out of 500000 steps (71%)
21:31:46:WU01:FS00:0xa7:Completed 360000 out of 500000 steps (72%)
******************************* Date: 2020-05-26 *******************************
21:38:59:WU01:FS00:0xa7:Completed 365000 out of 500000 steps (73%)
21:46:11:WU01:FS00:0xa7:Completed 370000 out of 500000 steps (74%)
21:53:23:WU01:FS00:0xa7:Completed 375000 out of 500000 steps (75%)
22:00:37:WU01:FS00:0xa7:Completed 380000 out of 500000 steps (76%)
22:07:49:WU01:FS00:0xa7:Completed 385000 out of 500000 steps (77%)
22:15:01:WU01:FS00:0xa7:Completed 390000 out of 500000 steps (78%)
22:22:13:WU01:FS00:0xa7:Completed 395000 out of 500000 steps (79%)
22:29:25:WU01:FS00:0xa7:Completed 400000 out of 500000 steps (80%)
22:36:41:WU01:FS00:0xa7:Completed 405000 out of 500000 steps (81%)
22:43:55:WU01:FS00:0xa7:Completed 410000 out of 500000 steps (82%)
22:51:06:WU01:FS00:0xa7:Completed 415000 out of 500000 steps (83%)
22:58:18:WU01:FS00:0xa7:Completed 420000 out of 500000 steps (84%)
23:05:32:WU01:FS00:0xa7:Completed 425000 out of 500000 steps (85%)
23:12:47:WU01:FS00:0xa7:Completed 430000 out of 500000 steps (86%)
23:19:57:WU01:FS00:0xa7:Completed 435000 out of 500000 steps (87%)
23:27:05:WU01:FS00:0xa7:Completed 440000 out of 500000 steps (88%)
23:34:20:WU01:FS00:0xa7:Completed 445000 out of 500000 steps (89%)
23:41:32:WU01:FS00:0xa7:Completed 450000 out of 500000 steps (90%)
23:48:43:WU01:FS00:0xa7:Completed 455000 out of 500000 steps (91%)
23:55:53:WU01:FS00:0xa7:Completed 460000 out of 500000 steps (92%)
00:03:07:WU01:FS00:0xa7:Completed 465000 out of 500000 steps (93%)
00:10:22:WU01:FS00:0xa7:Completed 470000 out of 500000 steps (94%)
00:17:30:WU01:FS00:0xa7:Completed 475000 out of 500000 steps (95%)
00:24:43:WU01:FS00:0xa7:Completed 480000 out of 500000 steps (96%)
00:31:56:WU01:FS00:0xa7:Completed 485000 out of 500000 steps (97%)
00:39:11:WU01:FS00:0xa7:Completed 490000 out of 500000 steps (98%)
00:46:19:WU01:FS00:0xa7:Completed 495000 out of 500000 steps (99%)
00:46:21:WU00:FS00:Connecting to 1.1.1.8:80
00:46:21:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.8:80': 10001: Server responded: HTTP_FOUND
00:46:21:WU00:FS00:Connecting to 1.1.1.22:80
00:46:22:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.22:80': 10001: Server responded: HTTP_FOUND
00:46:22:WU00:FS00:Connecting to 1.1.1.51:80
00:46:22:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.51:80': 10001: Server responded: HTTP_FOUND
00:46:22:WU00:FS00:Connecting to 1.1.1.54:80
00:46:22:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.54:80': 10001: Server responded: HTTP_FOUND
00:46:22:ERROR:WU00:FS00:Exception: Could not get an assignment
00:46:23:WU00:FS00:Connecting to 1.1.1.8:80
00:46:23:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.8:80': 10001: Server responded: HTTP_FOUND
00:46:23:WU00:FS00:Connecting to 1.1.1.22:80
00:46:23:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.22:80': 10001: Server responded: HTTP_FOUND
00:46:23:WU00:FS00:Connecting to 1.1.1.51:80
00:46:24:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.51:80': 10001: Server responded: HTTP_FOUND
00:46:24:WU00:FS00:Connecting to 1.1.1.54:80
00:46:24:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.54:80': 10001: Server responded: HTTP_FOUND
00:46:24:ERROR:WU00:FS00:Exception: Could not get an assignment
00:47:23:WU00:FS00:Connecting to 1.1.1.8:80
00:47:23:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.8:80': 10001: Server responded: HTTP_FOUND
00:47:23:WU00:FS00:Connecting to 1.1.1.22:80
00:47:23:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.22:80': 10001: Server responded: HTTP_FOUND
00:47:23:WU00:FS00:Connecting to 1.1.1.51:80
00:47:23:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.51:80': 10001: Server responded: HTTP_FOUND
00:47:23:WU00:FS00:Connecting to 1.1.1.54:80
00:47:23:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.54:80': 10001: Server responded: HTTP_FOUND
00:47:23:ERROR:WU00:FS00:Exception: Could not get an assignment
00:49:00:WU00:FS00:Connecting to 1.1.1.8:80
00:49:00:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.8:80': 10001: Server responded: HTTP_FOUND
00:49:00:WU00:FS00:Connecting to 1.1.1.22:80
00:49:00:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.22:80': 10001: Server responded: HTTP_FOUND
00:49:00:WU00:FS00:Connecting to 1.1.1.51:80
00:49:00:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.51:80': 10001: Server responded: HTTP_FOUND
00:49:00:WU00:FS00:Connecting to 1.1.1.54:80
00:49:00:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.54:80': 10001: Server responded: HTTP_FOUND
00:49:00:ERROR:WU00:FS00:Exception: Could not get an assignment
00:51:37:WU00:FS00:Connecting to 1.1.1.8:80
00:51:37:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.8:80': 10001: Server responded: HTTP_FOUND
00:51:37:WU00:FS00:Connecting to 1.1.1.22:80
00:51:37:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.22:80': 10001: Server responded: HTTP_FOUND
00:51:37:WU00:FS00:Connecting to 1.1.1.51:80
00:51:37:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.51:80': 10001: Server responded: HTTP_FOUND
00:51:37:WU00:FS00:Connecting to 1.1.1.54:80
00:51:37:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.54:80': 10001: Server responded: HTTP_FOUND
00:51:37:ERROR:WU00:FS00:Exception: Could not get an assignment
00:53:29:WU01:FS00:0xa7:Completed 500000 out of 500000 steps (100%)
00:53:30:WU01:FS00:0xa7:Saving result file ../logfile_01.txt
00:53:30:WU01:FS00:0xa7:Saving result file frame98.trr
00:53:30:WU01:FS00:0xa7:Saving result file frame98.xtc
00:53:30:WU01:FS00:0xa7:Saving result file md.log
00:53:30:WU01:FS00:0xa7:Saving result file science.log
00:53:30:WU01:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
00:53:31:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
00:53:31:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:16406 run:973 clone:1 gen:98 core:0xa7 unit:0x00000075a8f5c67d5e801f7421e78f3d
00:53:31:WU01:FS00:Uploading 1.42MiB to 168.245.198.125
00:53:31:WU01:FS00:Connecting to 168.245.198.125:8080
00:55:41:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
00:55:41:WU01:FS00:Connecting to 168.245.198.125:80
00:55:41:WU01:FS00:Upload 4.41%
00:55:41:WARNING:WU01:FS00:Exception: Failed to send results to work server: Transfer failed
00:55:41:WU01:FS00:Trying to send results to collection server
00:55:41:WU01:FS00:Uploading 1.42MiB to 146.94.192.82
00:55:41:WU01:FS00:Connecting to 146.94.192.82:8080
00:55:52:WU00:FS00:Connecting to 1.1.1.8:80
00:55:52:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.8:80': 10001: Server responded: HTTP_FOUND
00:55:52:WU00:FS00:Connecting to 1.1.1.22:80
00:55:52:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.22:80': 10001: Server responded: HTTP_FOUND
00:55:52:WU00:FS00:Connecting to 1.1.1.51:80
00:55:52:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.51:80': 10001: Server responded: HTTP_FOUND
00:55:52:WU00:FS00:Connecting to 1.1.1.54:80
00:55:52:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.54:80': 10001: Server responded: HTTP_FOUND
00:55:52:ERROR:WU00:FS00:Exception: Could not get an assignment
00:57:52:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
00:57:52:WU01:FS00:Connecting to 146.94.192.82:80
00:57:52:WU01:FS00:Upload 4.41%
00:57:52:ERROR:WU01:FS00:Exception: Transfer failed
00:57:52:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:16406 run:973 clone:1 gen:98 core:0xa7 unit:0x00000075a8f5c67d5e801f7421e78f3d
00:57:52:WU01:FS00:Uploading 1.42MiB to 168.245.198.125
00:57:52:WU01:FS00:Connecting to 168.245.198.125:8080
01:00:03:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
01:00:03:WU01:FS00:Connecting to 168.245.198.125:80
01:00:03:WU01:FS00:Upload 4.41%
01:00:03:WARNING:WU01:FS00:Exception: Failed to send results to work server: Transfer failed
01:00:03:WU01:FS00:Trying to send results to collection server
01:00:03:WU01:FS00:Uploading 1.42MiB to 146.94.192.82
01:00:03:WU01:FS00:Connecting to 146.94.192.82:8080
01:02:14:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
01:02:14:WU01:FS00:Connecting to 146.94.192.82:80
01:02:14:WU01:FS00:Upload 4.41%
01:02:14:ERROR:WU01:FS00:Exception: Transfer failed
01:02:14:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:16406 run:973 clone:1 gen:98 core:0xa7 unit:0x00000075a8f5c67d5e801f7421e78f3d
01:02:15:WU01:FS00:Uploading 1.42MiB to 168.245.198.125
01:02:15:WU01:FS00:Connecting to 168.245.198.125:8080
01:02:43:WU00:FS00:Connecting to 1.1.1.8:80
01:02:43:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.8:80': 10001: Server responded: HTTP_FOUND
01:02:43:WU00:FS00:Connecting to 1.1.1.22:80
01:02:43:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.22:80': 10001: Server responded: HTTP_FOUND
01:02:43:WU00:FS00:Connecting to 1.1.1.51:80
01:02:43:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.51:80': 10001: Server responded: HTTP_FOUND
01:02:43:WU00:FS00:Connecting to 1.1.1.54:80
01:02:43:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.54:80': 10001: Server responded: HTTP_FOUND
01:02:43:ERROR:WU00:FS00:Exception: Could not get an assignment
01:04:25:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
01:04:25:WU01:FS00:Connecting to 168.245.198.125:80
01:04:25:WU01:FS00:Upload 4.41%
01:04:25:WARNING:WU01:FS00:Exception: Failed to send results to work server: Transfer failed
01:04:25:WU01:FS00:Trying to send results to collection server
01:04:26:WU01:FS00:Uploading 1.42MiB to 146.94.192.82
01:04:26:WU01:FS00:Connecting to 146.94.192.82:8080
01:06:36:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
01:06:36:WU01:FS00:Connecting to 146.94.192.82:80
01:06:36:WU01:FS00:Upload 4.41%
01:06:36:ERROR:WU01:FS00:Exception: Transfer failed
01:06:36:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:16406 run:973 clone:1 gen:98 core:0xa7 unit:0x00000075a8f5c67d5e801f7421e78f3d
01:06:37:WU01:FS00:Uploading 1.42MiB to 168.245.198.125
01:06:37:WU01:FS00:Connecting to 168.245.198.125:8080
01:08:47:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
01:08:47:WU01:FS00:Connecting to 168.245.198.125:80
01:08:47:WU01:FS00:Upload 4.41%
01:08:47:WARNING:WU01:FS00:Exception: Failed to send results to work server: Transfer failed
01:08:47:WU01:FS00:Trying to send results to collection server
01:08:47:WU01:FS00:Uploading 1.42MiB to 146.94.192.82
01:08:47:WU01:FS00:Connecting to 146.94.192.82:8080
01:10:58:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
01:10:58:WU01:FS00:Connecting to 146.94.192.82:80
01:10:58:WU01:FS00:Upload 4.41%
01:10:58:ERROR:WU01:FS00:Exception: Transfer failed
01:10:59:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:16406 run:973 clone:1 gen:98 core:0xa7 unit:0x00000075a8f5c67d5e801f7421e78f3d
01:10:59:WU01:FS00:Uploading 1.42MiB to 168.245.198.125
01:10:59:WU01:FS00:Connecting to 168.245.198.125:8080
01:13:09:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
01:13:09:WU01:FS00:Connecting to 168.245.198.125:80
01:13:09:WU01:FS00:Upload 4.41%
01:13:10:WARNING:WU01:FS00:Exception: Failed to send results to work server: Transfer failed
01:13:10:WU01:FS00:Trying to send results to collection server
01:13:10:WU01:FS00:Uploading 1.42MiB to 146.94.192.82
01:13:10:WU01:FS00:Connecting to 146.94.192.82:8080
01:13:48:WU00:FS00:Connecting to 1.1.1.8:80
01:13:48:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.8:80': 10001: Server responded: HTTP_FOUND
01:13:48:WU00:FS00:Connecting to 1.1.1.22:80
01:13:48:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.22:80': 10001: Server responded: HTTP_FOUND
01:13:48:WU00:FS00:Connecting to 1.1.1.51:80
01:13:48:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.51:80': 10001: Server responded: HTTP_FOUND
01:13:48:WU00:FS00:Connecting to 1.1.1.54:80
01:13:48:WARNING:WU00:FS00:Failed to get assignment from '1.1.1.54:80': 10001: Server responded: HTTP_FOUND
01:13:48:ERROR:WU00:FS00:Exception: Could not get an assignment
01:15:21:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
01:15:21:WU01:FS00:Connecting to 146.94.192.82:80
01:15:21:W
U01:FS00:Upload 4.41%
01:15:26:WU01:FS00:Upload complete
01:15:26:WU01:FS00:Server responded WORK_ACK (400)
01:15:26:WU01:FS00:Final credit estimate, 420.00 points
01:15:27:WU01:FS00:Cleaning up

The wu hasn't shown up here yet. https://apps.foldingathome.org/wu#proje ... e=1&gen=98

Loss of points etc don't bother me at all, but if there's a repeating failure pattern leading to loss of productivity which might not have been flagged I felt I should mention it. As always, I could obviously be misreading things.

If you can tell any more about the upload fails and concurrent fails to get next assignment, that would be good too. Thanks.

Client is PeterJammo1.

[PantherX]

It will take a while for that WU to appear since it was uploaded to the Collection Server (146.94.192.82) instead of the Work Server (168.245.198.125). The Work Server needs to pull data from the Collection Server to process that.

Your log shows many attempts to connect to 1.1.1.X which resolves to APNIC and CloudFlare DNS Resolver Project. That's potentially a problem since the client talks to the Servers listed on this page directly (https://apps.foldingathome.org/serverstats). If you're using a proxy or DNS filter, that could potentially cause issues.

Also, can you please post the first 100 lines of the log file which shows the system configuration and the client setup. It looks something like this:

Code: Select all

*********************** Log Started 2020-05-22T02:16:33Z ***********************
02:16:33:Trying to access database...
02:16:33:Successfully acquired database lock
02:16:33:Read GPUs.txt
02:16:34:Enabled folding slot 01: PAUSED gpu:0:GP102 [GeForce GTX 1080 Ti] 11380 (by user)
02:16:34:****************************** FAHClient ******************************
02:16:34:        Version: 7.6.13
02:16:34:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
02:16:34:      Copyright: 2020 foldingathome.org
02:16:34:       Homepage: https://foldingathome.org/
02:16:34:           Date: Apr 27 2020
02:16:34:           Time: 21:21:01
02:16:34:       Revision: 5a652817f46116b6e135503af97f18e094414e3b
02:16:34:         Branch: master
02:16:34:       Compiler: Visual C++ 2008
02:16:34:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
02:16:34:       Platform: win32 10
02:16:34:           Bits: 32
02:16:34:           Mode: Release
02:16:34:         Config: C:\Users\PantherX-H\AppData\Roaming\FAHClient\config.xml
02:16:34:******************************** CBang ********************************
02:16:34:           Date: Apr 24 2020
02:16:34:           Time: 17:07:55
02:16:34:       Revision: ea081a3b3b0f4a37c4d0440b4f1bc184197c7797
02:16:34:         Branch: master
02:16:34:       Compiler: Visual C++ 2008
02:16:34:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
02:16:34:       Platform: win32 10
02:16:34:           Bits: 32
02:16:34:           Mode: Release
02:16:34:******************************* System ********************************
02:16:34:            CPU: Intel(R) Core(TM) i7-6700K CPU @ 4.00GHz
02:16:34:         CPU ID: GenuineIntel Family 6 Model 94 Stepping 3
02:16:34:           CPUs: 8
02:16:34:         Memory: 31.94GiB
02:16:34:    Free Memory: 27.35GiB
02:16:34:        Threads: WINDOWS_THREADS
02:16:34:     OS Version: 6.2
02:16:34:    Has Battery: false
02:16:34:     On Battery: false
02:16:34:     UTC Offset: 12
02:16:34:            PID: 13008
02:16:34:            CWD: C:\Users\PantherX-H\AppData\Roaming\FAHClient
02:16:34:  Win32 Service: false
02:16:34:             OS: Windows 10 Enterprise
02:16:34:        OS Arch: AMD64
02:16:34:           GPUs: 1
02:16:34:          GPU 0: Bus:1 Slot:0 Func:0 NVIDIA:8 GP102 [GeForce GTX 1080 Ti] 11380
02:16:34:  CUDA Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:6.1 Driver:10.2
02:16:34:OpenCL Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:1.2 Driver:442.19
02:16:34:******************************* libFAH ********************************
02:16:34:           Date: Apr 15 2020
02:16:34:           Time: 14:53:14
02:16:34:       Revision: 216968bc7025029c841ed6e36e81a03a316890d3
02:16:34:         Branch: master
02:16:34:       Compiler: Visual C++ 2008
02:16:34:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
02:16:34:       Platform: win32 10
02:16:34:           Bits: 32
02:16:34:           Mode: Release
02:16:34:***********************************************************************
02:16:34:<config>
02:16:34:  <!-- Folding Core -->
02:16:34:  <checkpoint v='30'/>
02:16:34:  <core-priority v='low'/>
02:16:34:
02:16:34:  <!-- Network -->
02:16:34:  <proxy v=':8080'/>
02:16:34:
02:16:34:  <!-- Slot Control -->
02:16:34:  <pause-on-start v='true'/>
02:16:34:  <power v='full'/>
02:16:34:
02:16:34:  <!-- User Information -->
02:16:34:  <passkey v='*****'/>
02:16:34:  <team v='69411'/>
02:16:34:  <user v='PantherX'/>
02:16:34:
02:16:34:  <!-- Work Unit Control -->
02:16:34:  <next-unit-percentage v='100'/>
02:16:34:
02:16:34:  <!-- Folding Slots -->
02:16:34:  <slot id='1' type='GPU'>
02:16:34:    <client-type v='advanced'/>
02:16:34:    <paused v='true'/>
02:16:34:  </slot>
02:16:34:</config>
02:21:14:FS01:Unpaused
02:21:14:WU00:FS01:Starting

[peterjammo]

I can't locate the actual log file now - only the current one apparent in /var/lib/fahclient, so here is the current one, no changes have been made other than a reboot.

Code: Select all

*********************** Log Started 2020-05-28T14:53:15Z ***********************
14:53:15:****************************** FAHClient ******************************
14:53:15:    Version: 7.6.9
14:53:15:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:53:15:  Copyright: 2020 foldingathome.org
14:53:15:   Homepage: https://foldingathome.org/
14:53:15:       Date: Apr 17 2020
14:53:15:       Time: 18:11:26
14:53:15:   Revision: 398c2b17fa535e0cc6c9d10856b2154c32771646
14:53:15:     Branch: master
14:53:15:   Compiler: GNU 8.3.0
14:53:15:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
14:53:15:             -fno-pie
14:53:15:   Platform: linux2 4.19.0-5-amd64
14:53:15:       Bits: 64
14:53:15:       Mode: Release
14:53:15:       Args: --child /etc/fahclient/config.xml --run-as fahclient
14:53:15:             --pid-file=/var/run/fahclient.pid --daemon
14:53:15:     Config: /etc/fahclient/config.xml
14:53:15:******************************** CBang ********************************
14:53:15:       Date: Apr 17 2020
14:53:15:       Time: 18:10:13
14:53:15:   Revision: 2fb0be7809c5e45287a122ca5fbc15b5ae859a3b
14:53:15:     Branch: master
14:53:15:   Compiler: GNU 8.3.0
14:53:15:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
14:53:15:             -fno-pie -fPIC
14:53:15:   Platform: linux2 4.19.0-5-amd64
14:53:15:       Bits: 64
14:53:15:       Mode: Release
14:53:15:******************************* System ********************************
14:53:15:        CPU: Intel(R) Core(TM)2 Duo CPU T5750 @ 2.00GHz
14:53:15:     CPU ID: GenuineIntel Family 6 Model 15 Stepping 13
14:53:15:       CPUs: 2
14:53:15:     Memory: 3.84GiB
14:53:15:Free Memory: 3.37GiB
14:53:15:    Threads: POSIX_THREADS
14:53:15: OS Version: 4.15
14:53:15:Has Battery: false
14:53:15: On Battery: false
14:53:15: UTC Offset: 1
14:53:15:        PID: 1234
14:53:15:        CWD: /var/lib/fahclient
14:53:15:         OS: Linux 4.15.0-96-generic x86_64
14:53:15:    OS Arch: AMD64
14:53:15:       GPUs: 0
14:53:15:       CUDA: Not detected: Failed to open dynamic library 'libcuda.so':
14:53:15:             libcuda.so: cannot open shared object file: No such file or
14:53:15:             directory
14:53:15:     OpenCL: Not detected: Failed to open dynamic library 'libOpenCL.so':
14:53:15:             libOpenCL.so: cannot open shared object file: No such file or
14:53:15:             directory
14:53:15:******************************* libFAH ********************************
14:53:15:       Date: Apr 15 2020
14:53:15:       Time: 21:43:24
14:53:15:   Revision: 216968bc7025029c841ed6e36e81a03a316890d3
14:53:15:     Branch: master
14:53:15:   Compiler: GNU 8.3.0
14:53:15:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
14:53:15:             -fno-pie
14:53:15:   Platform: linux2 4.19.0-5-amd64
14:53:15:       Bits: 64
14:53:15:       Mode: Release
14:53:15:***********************************************************************
14:53:15:<config>
14:53:15:  <!-- Client Control -->
14:53:15:  <fold-anon v='true'/>
14:53:15:
14:53:15:  <!-- Folding Slot Configuration -->
14:53:15:  <gpu v='false'/>
14:53:15:
14:53:15:  <!-- Network -->
14:53:15:  <proxy v=':8080'/>
14:53:15:
14:53:15:  <!-- User Information -->
14:53:15:  <user v='PeterJammo1'/>
14:53:15:
14:53:15:  <!-- Folding Slots -->
14:53:15:  <slot id='0' type='CPU'>
14:53:15:    <cpus v='2'/>
14:53:15:  </slot>
14:53:15:</config>
14:53:15:Trying to access database...
14:53:15:Successfully acquired database lock
14:53:15:Enabled folding slot 00: READY cpu:2
14:53:15:WU00:FS00:Starting
14:53:15:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 706 -lifeline 1234 -checkpoint 15 -np 2
14:53:15:WU00:FS00:Started FahCore on PID 1243
14:53:15:WU00:FS00:Core PID:1247
14:53:15:WU00:FS00:FahCore 0xa7 started
14:53:15:WU00:FS00:0xa7:*********************** Log Started 2020-05-28T14:53:15Z ***********************
14:53:15:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
14:53:15:WU00:FS00:0xa7:       Type: 0xa7
14:53:15:WU00:FS00:0xa7:       Core: Gromacs
14:53:15:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 706 -lifeline 1243 -checkpoint 15 -np 2
14:53:15:WU00:FS00:0xa7:************************************ CBang *************************************
14:53:15:WU00:FS00:0xa7:       Date: Nov 5 2019
14:53:15:WU00:FS00:0xa7:       Time: 05:57:01
14:53:15:WU00:FS00:0xa7:   Revision: 46c96f1aa8419571d83f3e63f9c99a0d602f6da9
14:53:15:WU00:FS00:0xa7:     Branch: master
14:53:15:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
14:53:15:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie -fPIC
14:53:15:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:53:15:WU00:FS00:0xa7:       Bits: 64
14:53:15:WU00:FS00:0xa7:       Mode: Release
14:53:15:WU00:FS00:0xa7:************************************ System ************************************
14:53:15:WU00:FS00:0xa7:        CPU: Intel(R) Core(TM)2 Duo CPU T5750 @ 2.00GHz
14:53:15:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 15 Stepping 13
14:53:15:WU00:FS00:0xa7:       CPUs: 2
14:53:15:WU00:FS00:0xa7:     Memory: 3.84GiB
14:53:15:WU00:FS00:0xa7:Free Memory: 3.37GiB
14:53:15:WU00:FS00:0xa7:    Threads: POSIX_THREADS
14:53:15:WU00:FS00:0xa7: OS Version: 4.15
14:53:15:WU00:FS00:0xa7:Has Battery: false
14:53:15:WU00:FS00:0xa7: On Battery: false
14:53:15:WU00:FS00:0xa7: UTC Offset: 1
14:53:15:WU00:FS00:0xa7:        PID: 1247
14:53:15:WU00:FS00:0xa7:        CWD: /var/lib/fahclient/work
14:53:15:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
14:53:15:WU00:FS00:0xa7:    Version: 0.0.18
14:53:15:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:53:15:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
14:53:15:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
14:53:15:WU00:FS00:0xa7:       Date: Nov 5 2019
14:53:15:WU00:FS00:0xa7:       Time: 06:13:26
14:53:15:WU00:FS00:0xa7:   Revision: 490c9aa2957b725af319379424d5c5cb36efb656
14:53:15:WU00:FS00:0xa7:     Branch: master
14:53:15:WU00:FS00:0xa7:   Compiler: GNU 8.3.0
14:53:15:WU00:FS00:0xa7:    Options: -std=c++11 -O3 -funroll-loops -fno-pie
14:53:15:WU00:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
14:53:15:WU00:FS00:0xa7:       Bits: 64
14:53:15:WU00:FS00:0xa7:       Mode: Release
14:53:15:WU00:FS00:0xa7:************************************ Build *************************************
14:53:15:WU00:FS00:0xa7:       SIMD: sse2
14:53:15:WU00:FS00:0xa7:********************************************************************************
14:53:15:WU00:FS00:0xa7:Project: 16804 (Run 75, Clone 311, Gen 56)
14:53:15:WU00:FS00:0xa7:Unit: 0x0000004582ed0b915e9deeb4898bb304
14:53:15:WU00:FS00:0xa7:Digital signatures verified
14:53:15:WU00:FS00:0xa7:Calling: mdrun -s frame56.tpr -o frame56.trr -cpi state.cpt -cpt 15 -nt 2
14:53:17:WU00:FS00:0xa7:Steps: first=28000000 total=500000
14:53:20:WU00:FS00:0xa7:Completed 154797 out of 500000 steps (30%)

I'll have a look at the network settings on that machine when I have a minute. I set that one up 2-3 years ago and I think I had some wireless issues with it, so I may have done anything to get it working. I haven't changed anything on the network settings since starting folding though.

On the CS>WS bit, it's 3 days since the the wu uploaded to the CS and still no sign of it reaching the WS. That probably takes it past deadline. When the deadline expires, does the WS still accept delayed wu from the CS?

The wu I started this thread for never showed, now 5 weeks later. I assume it's long lost. As above I'm not bothered about the loss of points or even loss of effort, but if this (unnecesssary reissuing of wu many hours after a successful one has reached a CS) is happening with any degree of regularity it would be nice to know that it's a known and assessed problem, and not just being missed in the vast volume of successful work.

[Joe_H]

Once a CS or WS has accepted a WU, the points are based on that upload time even if there is a delay transferring the WU to the WS from a CS. The developer has under consideration changing the server code to have stats updates for WUs returned to a CS be sent from the CS instead of waiting for the transfer to the WS. Then just generation of the next Gen WU would be held up.

Points entries for WUs may show up weeks later. They do periodic checks to see if stats update logs failed to be registered with the database, or were not completely processed.

[peterjammo]

Then just generation of the next Gen WU would be held up.

Thanks Joe, I knew most of that already. As I said, the points part doesn't bother me at all. It's the next gen WU being held up that does. It seems to me that 2 wu out of 70 which have gone to a CS and not then been transferred to the WS for at least 11 hrs MIGHT suggest a system configuration issue, particularly when the 2 servers were both showing up during that time. I don't suppose that the CS are also configured with the exponential time delay for retries contacting the WS?

As I already said, if the issue has already been flagged and/or assessed and/or dismissed, that's fine by me.