Slow uploads to 140.163.4.241

rwh202 · Post by **rwh202** » Wed Mar 04, 2020 12:18 pm

Last night it managed the first 96% quick before slowing down:

00:47:52:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
00:47:52:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:11739 run:25 clone:8 gen:40 core:0x22 unit:0x0000002f8ca304f15e0fb94eec113f04
00:47:52:WU01:FS01:Uploading 20.45MiB to 140.163.4.241
00:47:52:WU01:FS01:Connecting to 140.163.4.241:8080
00:47:59:WU01:FS01:Upload 96.26%
00:48:34:WU01:FS01:Upload 97.79%
00:49:14:WU01:FS01:Upload 98.10%
00:49:55:WU01:FS01:Upload 98.40%
00:50:42:WU01:FS01:Upload 98.71%
00:51:23:WU01:FS01:Upload 99.01%
00:52:05:WU01:FS01:Upload 99.32%
00:52:08:WU01:FS01:Upload complete
00:52:08:WU01:FS01:Server responded WORK_ACK (400)
00:52:08:WU01:FS01:Final credit estimate, 77881.00 points
00:52:09:WU01:FS01:Cleaning up

Now, it's slow from the start:

Code: Select all

11:43:47:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
11:43:47:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:11738 run:0 clone:1506 gen:45 core:0x22 unit:0x000000328ca304f15e34fa533ca7e2c2
11:43:48:WU01:FS01:Uploading 86.94MiB to 140.163.4.241
11:43:48:WU01:FS01:Connecting to 140.163.4.241:8080
11:43:55:WU01:FS01:Upload 6.47%
11:45:35:WU01:FS01:Upload 6.83%
11:47:25:WU01:FS01:Upload 6.90%
11:48:52:WU01:FS01:Upload 6.97%
11:53:51:WU01:FS01:Upload 7.33%
12:05:51:WU01:FS01:Upload 7.40%

Don't think it will ever get there - will see what a restart achieves over lunch time...

Edit - got there after a restart. However, I'll now spend 10 minutes getting back to where I Ieft off and I can't babysit all 20 clients

Code: Select all

12:30:03:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:11738 run:0 clone:1506 gen:45 core:0x22 unit:0x000000328ca304f15e34fa533ca7e2c2
12:30:03:WU01:FS01:Uploading 86.94MiB to 140.163.4.241
12:30:03:WU01:FS01:Connecting to 140.163.4.241:8080
12:30:09:WU01:FS01:Upload 4.96%
12:30:16:WU01:FS01:Upload 9.78%
12:30:23:WU01:FS01:Upload 9.85%
12:30:29:WU01:FS01:Upload 31.70%
12:30:35:WU01:FS01:Upload 49.32%
12:30:43:WU01:FS01:Upload 60.89%
12:30:49:WU01:FS01:Upload 61.03%
12:30:55:WU01:FS01:Upload 76.20%
12:31:01:WU01:FS01:Upload 89.64%
12:31:06:WU01:FS01:Upload complete
12:31:07:WU01:FS01:Server responded WORK_ACK (400)
12:31:07:WU01:FS01:Final credit estimate, 142632.00 points
12:31:07:WU01:FS01:Cleaning up

rickoic · Post by **rickoic** » Wed Mar 04, 2020 4:30 pm

I have had the same problem. I found that if I do a pause on the wu's and after paused a fold the upload will pickup where it left off at regular speed. After a couple of minutes.

I'm not convinced it's a server problem, but with the client.

Mstenholm · Post by **Mstenholm** » Wed Mar 04, 2020 8:34 pm

Windows or Linux? My two Win7 takes around 15-18 minutes to upload the "86.85MiB to 140.163.4.241" (wire). My two Linux does the same in less than a minute (one wire, one not). It has been so for a long time, weeks at least.

rickoic · Post by **rickoic** » Wed Mar 04, 2020 9:11 pm

My machines are running Windows 10 1 wired 1 not. I haven't seen a problem with a upload if it finishes before the new wu reaches 1%. Seems to happen only at and after reaching 1%.

Kjetil · Post by **Kjetil** » Thu Mar 05, 2020 6:30 pm

18:23:47:WU01:FS01:Upload 2.10%
18:23:47:WU00:FS01:0x22:Completed 0 out of 2000000 steps (0%)
18:23:47:WU00:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
18:23:53:WU01:FS01:Upload 5.25%
18:23:59:WU01:FS01:Upload 7.93%
18:24:05:WU01:FS01:Upload 11.09%
18:24:11:WU01:FS01:Upload 14.56%
18:24:17:WU01:FS01:Upload 17.92%
18:24:23:WU01:FS01:Upload 21.44%
18:24:29:WU01:FS01:Upload 24.91%
18:24:30:WU00:FS01:0x22:Completed 20000 out of 2000000 steps (1%)
18:24:35:WU01:FS01:Upload 28.43%
18:24:41:WU01:FS01:Upload 31.90%
18:24:47:WU01:FS01:Upload 35.21%
18:24:53:WU01:FS01:Upload 38.73%
18:24:59:WU01:FS01:Upload 42.09%
18:25:05:WU01:FS01:Upload 45.19%
18:25:11:WU01:FS01:Upload 48.29%
18:25:12:WU00:FS01:0x22:Completed 40000 out of 2000000 steps (2%)
18:25:17:WU01:FS01:Upload 51.66%
18:25:23:WU01:FS01:Upload 55.07%
18:25:29:WU01:FS01:Upload 58.17%
18:25:35:WU01:FS01:Upload 60.48%
18:25:41:WU01:FS01:Upload 64.27%
18:25:47:WU01:FS01:Upload 67.79%
18:25:53:WU01:FS01:Upload 71.68%
18:25:54:WU00:FS01:0x22:Completed 60000 out of 2000000 steps (3%)
18:25:59:WU01:FS01:Upload 75.20%
18:26:05:WU01:FS01:Upload 78.19%
18:26:11:WU01:FS01:Upload 81.61%
18:26:17:WU01:FS01:Upload 84.97%
18:26:23:WU01:FS01:Upload 87.39%
18:26:29:WU01:FS01:Upload 89.28%
18:26:35:WU01:FS01:Upload 91.01%
18:26:36:WU00:FS01:0x22:Completed 80000 out of 2000000 steps (4%)
18:26:41:WU01:FS01:Upload 93.01%
18:26:47:WU01:FS01:Upload 96.27%
18:26:53:WU01:FS01:Upload 99.89%
18:26:54:WU01:FS01:Upload complete

Calcii · Post by **Calcii** » Wed Mar 11, 2020 4:53 pm

+ 1 Win 7, wire, 23.06 MiB about 10 minutes

Code: Select all

16:41:53:WU01:FS01:0x22:Completed 2000000 out of 2000000 steps (100%)
16:41:56:WU01:FS01:0x22:Saving result file ..\logfile_01.txt
16:41:56:WU01:FS01:0x22:Saving result file checkpointState.xml
16:41:57:WU01:FS01:0x22:Saving result file checkpt.crc
16:41:57:WU01:FS01:0x22:Saving result file positions.xtc
16:41:57:WU01:FS01:0x22:Saving result file science.log
16:41:57:WU01:FS01:0x22:Folding@home Core Shutdown: FINISHED_UNIT
16:41:57:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
16:41:57:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:11742 run:0 clone:1560 gen:6 core:0x22 unit:0x000000098ca304f15e67da1839ceef56
16:41:57:WU01:FS01:Uploading 23.06MiB to 140.163.4.241
16:41:57:WU01:FS01:Connecting to 140.163.4.241:8080
16:42:06:Started thread 18 on PID 3520
16:42:15:WU01:FS01:Upload 0.54%
16:42:22:WU01:FS01:Upload 1.63%
16:42:28:WU01:FS01:Upload 2.71%
16:42:34:WU01:FS01:Upload 3.79%
16:42:41:WU01:FS01:Upload 4.88%
16:42:47:WU01:FS01:Upload 5.69%
16:42:53:WU01:FS01:Upload 6.78%
16:42:59:WU01:FS01:Upload 7.86%
16:43:05:WU01:FS01:Upload 8.94%
16:43:11:WU01:FS01:Upload 10.03%
16:43:18:WU01:FS01:Upload 11.11%
16:43:24:WU01:FS01:Upload 12.20%
16:43:30:WU01:FS01:Upload 13.28%
16:43:36:WU01:FS01:Upload 14.36%
16:43:42:WU01:FS01:Upload 15.45%
16:43:48:WU01:FS01:Upload 16.53%
16:43:55:WU01:FS01:Upload 17.89%
16:44:01:WU01:FS01:Upload 18.97%
16:44:07:WU01:FS01:Upload 20.05%
16:44:13:WU01:FS01:Upload 21.14%
16:44:19:WU01:FS01:Upload 22.22%
16:44:26:WU01:FS01:Upload 23.31%
16:44:32:WU01:FS01:Upload 24.39%
16:44:38:WU01:FS01:Upload 25.47%
16:44:44:WU01:FS01:Upload 26.56%
16:44:51:WU01:FS01:Upload 27.91%
16:44:57:WU01:FS01:Upload 29.00%
16:45:03:WU01:FS01:Upload 30.08%
16:45:10:WU01:FS01:Upload 31.44%
16:45:16:WU01:FS01:Upload 32.52%
16:45:22:WU01:FS01:Upload 33.60%
16:45:28:WU01:FS01:Upload 34.69%
16:45:34:WU01:FS01:Upload 35.77%
16:45:41:WU01:FS01:Upload 36.86%
16:45:48:WU01:FS01:Upload 38.21%
16:45:54:WU01:FS01:Upload 39.30%
16:46:00:WU01:FS01:Upload 40.38%
16:46:06:WU01:FS01:Upload 41.46%
16:46:12:WU01:FS01:Upload 42.55%
16:46:18:WU01:FS01:Upload 43.63%
16:46:25:WU01:FS01:Upload 44.72%
16:46:32:WU01:FS01:Upload 46.07%
16:46:39:WU01:FS01:Upload 47.43%
16:46:45:WU01:FS01:Upload 48.51%
16:46:52:WU01:FS01:Upload 49.86%
16:46:58:WU01:FS01:Upload 50.95%
16:47:05:WU01:FS01:Upload 52.30%
16:47:11:WU01:FS01:Upload 53.39%
16:47:18:WU01:FS01:Upload 54.47%
16:47:25:WU01:FS01:Upload 55.56%
16:47:32:WU01:FS01:Upload 56.64%
16:47:38:WU01:FS01:Upload 57.72%
16:47:45:WU01:FS01:Upload 58.81%
16:47:52:WU01:FS01:Upload 59.89%
16:47:58:WU01:FS01:Upload 60.98%
16:48:05:WU01:FS01:Upload 62.06%
16:48:11:WU01:FS01:Upload 62.87%
16:48:18:WU01:FS01:Upload 63.96%
16:48:24:WU01:FS01:Upload 64.77%
16:48:31:WU01:FS01:Upload 65.85%
16:48:37:WU01:FS01:Upload 66.67%
16:48:44:WU01:FS01:Upload 67.75%
16:48:51:WU01:FS01:Upload 68.83%
16:48:57:WU01:FS01:Upload 69.65%
16:49:04:WU01:FS01:Upload 70.73%
16:49:10:WU01:FS01:Upload 71.54%
16:49:17:WU01:FS01:Upload 72.63%
16:49:23:WU01:FS01:Upload 73.44%
16:49:30:WU01:FS01:Upload 74.53%
16:49:36:WU01:FS01:Upload 75.34%
16:49:43:WU01:FS01:Upload 76.42%
16:49:49:WU01:FS01:Upload 77.24%
16:49:56:WU01:FS01:Upload 78.32%
16:50:02:WU01:FS01:Upload 79.13%
16:50:09:WU01:FS01:Upload 79.95%
16:50:15:WU01:FS01:Upload 80.76%
16:50:21:WU01:FS01:Upload 81.57%
16:50:27:WU01:FS01:Upload 82.38%
16:50:34:WU01:FS01:Upload 83.47%
16:50:40:WU01:FS01:Upload 84.28%
16:50:46:WU01:FS01:Upload 85.09%
16:50:52:WU01:FS01:Upload 85.91%
16:50:59:WU01:FS01:Upload 86.99%
16:51:05:WU01:FS01:Upload 87.80%
16:51:11:WU01:FS01:Upload 88.62%
16:51:18:WU01:FS01:Upload 89.70%
16:51:24:WU01:FS01:Upload 90.51%
16:51:30:WU01:FS01:Upload 91.33%
16:51:36:WU01:FS01:Upload 92.14%
16:51:42:WU01:FS01:Upload 92.95%
16:51:48:WU01:FS01:Upload 93.77%
16:51:54:WU01:FS01:Upload 94.58%
16:52:01:WU01:FS01:Upload 95.39%
16:52:08:WU01:FS01:Upload 96.48%
16:52:14:WU01:FS01:Upload 97.29%
16:52:21:WU01:FS01:Upload 98.37%
16:52:27:WU01:FS01:Upload 99.19%
16:52:33:WU01:FS01:Upload 100.00%

Post by **toTOW** » Thu Mar 12, 2020 11:42 pm

Due to the high demand, it is hardly keeping up. So you might sometimes see slow transfers to/from it, or even WUs for other researches that still need to be done.

Rafal has set up another server (140.163.4.231) with Coronavirus-related projects to help balance the load.

gordonbb · Post by **gordonbb** » Fri Mar 13, 2020 5:05 am

toTOW wrote:Due to the high demand, it is hardly keeping up. So you might sometimes see slow transfers to/from it, or even WUs for other researches that still need to be done.

Rafal has set up another server (140.163.4.231) with Coronavirus-related projects to help balance the load.

It's stuck trying to connect to that server for me

Code: Select all

03:08:22:WU05:FS05:Connecting to 65.254.110.245:8080
03:08:22:WU05:FS05:Assigned to work server 140.163.4.231
03:08:22:WU05:FS05:Requesting new work unit for slot 05: READY gpu:5:TU106 [GeForce RTX 2060 Super] from 140.163.4.231
03:08:22:WU05:FS05:Connecting to 140.163.4.231:8080
03:10:32:WARNING:WU05:FS05:WorkServer connection failed on port 8080 trying 80
03:10:32:WU05:FS05:Connecting to 140.163.4.231:80
03:12:43:ERROR:WU05:FS05:Exception: Failed to connect to 140.163.4.231:80: Connection timed out
03:12:43:WU05:FS05:Connecting to 65.254.110.245:8080
03:12:43:WU05:FS05:Assigned to work server 140.163.4.231
03:12:43:WU05:FS05:Requesting new work unit for slot 05: READY gpu:5:TU106 [GeForce RTX 2060 Super] from 140.163.4.231
03:12:43:WU05:FS05:Connecting to 140.163.4.231:8080
03:14:54:WARNING:WU05:FS05:WorkServer connection failed on port 8080 trying 80
03:14:54:WU05:FS05:Connecting to 140.163.4.231:80
03:17:05:ERROR:WU05:FS05:Exception: Failed to connect to 140.163.4.231:80: Connection timed out
03:17:05:WU05:FS05:Connecting to 65.254.110.245:8080
03:17:05:WU05:FS05:Assigned to work server 140.163.4.231
03:17:05:WU05:FS05:Requesting new work unit for slot 05: READY gpu:5:TU106 [GeForce RTX 2060 Super] from 140.163.4.231
03:17:05:WU05:FS05:Connecting to 140.163.4.231:8080
03:19:16:WARNING:WU05:FS05:WorkServer connection failed on port 8080 trying 80
03:19:16:WU05:FS05:Connecting to 140.163.4.231:80
03:21:27:ERROR:WU05:FS05:Exception: Failed to connect to 140.163.4.231:80: Connection timed out
03:23:56:WU05:FS05:Connecting to 65.254.110.245:8080
03:23:56:WU05:FS05:Assigned to work server 140.163.4.231
03:23:57:WU05:FS05:Requesting new work unit for slot 05: READY gpu:5:TU106 [GeForce RTX 2060 Super] from 140.163.4.231
03:23:57:WU05:FS05:Connecting to 140.163.4.231:8080
03:26:08:WARNING:WU05:FS05:WorkServer connection failed on port 8080 trying 80
03:26:08:WU05:FS05:Connecting to 140.163.4.231:80
03:28:19:ERROR:WU05:FS05:Exception: Failed to connect to 140.163.4.231:80: Connection timed out
03:35:02:WU05:FS05:Connecting to 65.254.110.245:8080
03:35:02:WU05:FS05:Assigned to work server 140.163.4.231
03:35:02:WU05:FS05:Requesting new work unit for slot 05: READY gpu:5:TU106 [GeForce RTX 2060 Super] from 140.163.4.231
03:35:02:WU05:FS05:Connecting to 140.163.4.231:8080
03:37:13:WARNING:WU05:FS05:WorkServer connection failed on port 8080 trying 80
03:37:13:WU05:FS05:Connecting to 140.163.4.231:80
03:39:24:ERROR:WU05:FS05:Exception: Failed to connect to 140.163.4.231:80: Connection timed out
03:52:58:WU05:FS05:Connecting to 65.254.110.245:8080
03:52:59:WU05:FS05:Assigned to work server 140.163.4.231
03:52:59:WU05:FS05:Requesting new work unit for slot 05: READY gpu:5:TU106 [GeForce RTX 2060 Super] from 140.163.4.231
03:52:59:WU05:FS05:Connecting to 140.163.4.231:8080
03:55:08:WARNING:WU05:FS05:WorkServer connection failed on port 8080 trying 80
03:55:08:WU05:FS05:Connecting to 140.163.4.231:80
03:57:20:ERROR:WU05:FS05:Exception: Failed to connect to 140.163.4.231:80: Connection timed out
04:22:01:WU05:FS05:Connecting to 65.254.110.245:8080
04:22:01:WU05:FS05:Assigned to work server 140.163.4.231
04:22:01:WU05:FS05:Requesting new work unit for slot 05: READY gpu:5:TU106 [GeForce RTX 2060 Super] from 140.163.4.231
04:22:01:WU05:FS05:Connecting to 140.163.4.231:8080
04:24:11:WARNING:WU05:FS05:WorkServer connection failed on port 8080 trying 80
04:24:11:WU05:FS05:Connecting to 140.163.4.231:80
04:26:22:ERROR:WU05:FS05:Exception: Failed to connect to 140.163.4.231:80: Connection timed out
03:10:32:WARNING:WU05:FS05:WorkServer connection failed on port 8080 trying 80
03:10:32:WU05:FS05:Connecting to 140.163.4.231:80
03:12:43:ERROR:WU05:FS05:Exception: Failed to connect to 140.163.4.231:80: Connection timed out
03:12:43:WU05:FS05:Connecting to 65.254.110.245:8080
03:12:43:WU05:FS05:Assigned to work server 140.163.4.231
03:12:43:WU05:FS05:Requesting new work unit for slot 05: READY gpu:5:TU106 [GeForce RTX 2060 Super] from 140.163.4.231
03:12:43:WU05:FS05:Connecting to 140.163.4.231:8080
03:14:54:WARNING:WU05:FS05:WorkServer connection failed on port 8080 trying 80
03:14:54:WU05:FS05:Connecting to 140.163.4.231:80
03:17:05:ERROR:WU05:FS05:Exception: Failed to connect to 140.163.4.231:80: Connection timed out
03:17:05:WU05:FS05:Connecting to 65.254.110.245:8080
03:17:05:WU05:FS05:Assigned to work server 140.163.4.231
03:17:05:WU05:FS05:Requesting new work unit for slot 05: READY gpu:5:TU106 [GeForce RTX 2060 Super] from 140.163.4.231
03:17:05:WU05:FS05:Connecting to 140.163.4.231:8080
03:19:16:WARNING:WU05:FS05:WorkServer connection failed on port 8080 trying 80
03:19:16:WU05:FS05:Connecting to 140.163.4.231:80
03:21:27:ERROR:WU05:FS05:Exception: Failed to connect to 140.163.4.231:80: Connection timed out
03:23:56:WU05:FS05:Connecting to 65.254.110.245:8080
03:23:56:WU05:FS05:Assigned to work server 140.163.4.231
03:23:57:WU05:FS05:Requesting new work unit for slot 05: READY gpu:5:TU106 [GeForce RTX 2060 Super] from 140.163.4.231
03:23:57:WU05:FS05:Connecting to 140.163.4.231:8080
03:26:08:WARNING:WU05:FS05:WorkServer connection failed on port 8080 trying 80
03:26:08:WU05:FS05:Connecting to 140.163.4.231:80
03:28:19:ERROR:WU05:FS05:Exception: Failed to connect to 140.163.4.231:80: Connection timed out
03:35:02:WU05:FS05:Connecting to 65.254.110.245:8080
03:35:02:WU05:FS05:Assigned to work server 140.163.4.231
03:35:02:WU05:FS05:Requesting new work unit for slot 05: READY gpu:5:TU106 [GeForce RTX 2060 Super] from 140.163.4.231
03:35:02:WU05:FS05:Connecting to 140.163.4.231:8080
03:37:13:WARNING:WU05:FS05:WorkServer connection failed on port 8080 trying 80
03:37:13:WU05:FS05:Connecting to 140.163.4.231:80
03:39:24:ERROR:WU05:FS05:Exception: Failed to connect to 140.163.4.231:80: Connection timed out
03:52:58:WU05:FS05:Connecting to 65.254.110.245:8080
03:52:59:WU05:FS05:Assigned to work server 140.163.4.231
03:52:59:WU05:FS05:Requesting new work unit for slot 05: READY gpu:5:TU106 [GeForce RTX 2060 Super] from 140.163.4.231
03:52:59:WU05:FS05:Connecting to 140.163.4.231:8080
03:55:08:WARNING:WU05:FS05:WorkServer connection failed on port 8080 trying 80
03:55:08:WU05:FS05:Connecting to 140.163.4.231:80
03:57:20:ERROR:WU05:FS05:Exception: Failed to connect to 140.163.4.231:80: Connection timed out
04:22:01:WU05:FS05:Connecting to 65.254.110.245:8080
04:22:01:WU05:FS05:Assigned to work server 140.163.4.231
04:22:01:WU05:FS05:Requesting new work unit for slot 05: READY gpu:5:TU106 [GeForce RTX 2060 Super] from 140.163.4.231
04:22:01:WU05:FS05:Connecting to 140.163.4.231:8080
04:24:11:WARNING:WU05:FS05:WorkServer connection failed on port 8080 trying 80
04:24:11:WU05:FS05:Connecting to 140.163.4.231:80
04:26:22:ERROR:WU05:FS05:Exception: Failed to connect to 140.163.4.231:80: Connection timed out

And just as I was about to reboot the system another WU on a different slot in the same system completed, uploaded to the same WS and then downloaded another WU and the stuck system finally succeeded

Code: Select all

05:08:59:WU05:FS05:Connecting to 65.254.110.245:8080
05:09:01:WU05:FS05:Assigned to work server 140.163.4.231
05:09:01:WU05:FS05:Requesting new work unit for slot 05: READY gpu:5:TU106 [GeForce RTX 2060 Super] from 140.163.4.231
05:09:01:WU05:FS05:Connecting to 140.163.4.231:8080
05:09:27:WU05:FS05:Downloading 51.29MiB
05:09:33:WU05:FS05:Download 11.45%
05:09:39:WU05:FS05:Download 26.44%
05:09:45:WU05:FS05:Download 47.28%
05:09:51:WU05:FS05:Download 69.82%
05:09:57:WU05:FS05:Download 86.14%
05:10:00:WU05:FS05:Download complete
05:10:00:WU05:FS05:Received Unit: id:05 state:DOWNLOAD error:NO_ERROR project:11751 run:0 clone:2229 gen:0 core:0x22 unit:0x000000008ca304e75e6a80457ad9884a
05:10:00:WU05:FS05:Starting

Post by **toTOW** » Sat Mar 14, 2020 12:37 am

Yes, I'm also having a hard time getting work from and returning work to these servers. Luckily, Collection Server is doing fine in accepting my returns, and I have to be patient to get work from .241 and 231, downloading at speeds < 500 kbps ...

But as long it keeps running, I'm fine.

gordonbb · Post by **gordonbb** » Sat Mar 14, 2020 1:53 am

toTOW wrote:... But as long it keeps running, I'm fine.

Agreed

Thing have been a bit bumpy and slow but I’m seeing a ton of small medium and large WUs getting processed and hopefully we’ll generate some useful results for the Researchers to help them move forward.

ely105 · Post by **ely105** » Sat Mar 14, 2020 5:56 am

I've been having lots of problems today with .231 and .241. I have 8-10 systems with GTX/RTX GPUs. Seems like they are only able to download a new WU every so often but fail repeatedly. Either short messages or get somewhere into the download process and fails. I've got 10m ppd of GPUs with many sitting idle.

Code: Select all

05:28:20:WU00:FS01:Connecting to 65.254.110.245:8080
05:28:20:WU00:FS01:Assigned to work server 140.163.4.241
05:28:20:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:TU104 [GeForce RTX 2080] from 140.163.4.241
05:28:20:WU00:FS01:Connecting to 140.163.4.241:8080
05:29:35:ERROR:WU00:FS01:Exception: 10002: Received short response, expected 512 bytes, got 0
05:29:35:WU00:FS01:Connecting to 65.254.110.245:8080
05:29:36:WU00:FS01:Assigned to work server 140.163.4.231
05:29:36:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:TU104 [GeForce RTX 2080] from 140.163.4.231
05:29:36:WU00:FS01:Connecting to 140.163.4.231:8080
05:29:57:WARNING:WU00:FS01:WorkServer connection failed on port 8080 trying 80
05:29:57:WU00:FS01:Connecting to 140.163.4.231:80
05:31:08:ERROR:WU00:FS01:Exception: 10002: Received short response, expected 512 bytes, got 0
05:31:13:WU00:FS01:Connecting to 65.254.110.245:8080
05:31:13:WU00:FS01:Assigned to work server 140.163.4.241
05:31:13:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:TU104 [GeForce RTX 2080] from 140.163.4.241
05:31:13:WU00:FS01:Connecting to 140.163.4.241:8080
05:32:52:ERROR:WU00:FS01:Exception: 10002: Received short response, expected 512 bytes, got 0
05:33:50:WU00:FS01:Connecting to 65.254.110.245:8080
05:33:50:WU00:FS01:Assigned to work server 140.163.4.241
05:33:50:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:TU104 [GeForce RTX 2080] from 140.163.4.241
05:33:50:WU00:FS01:Connecting to 140.163.4.241:8080
05:35:29:ERROR:WU00:FS01:Exception: 10002: Received short response, expected 512 bytes, got 0
05:38:04:WU00:FS01:Connecting to 65.254.110.245:8080
05:38:04:WU00:FS01:Assigned to work server 140.163.4.231
05:38:04:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:TU104 [GeForce RTX 2080] from 140.163.4.231
05:38:04:WU00:FS01:Connecting to 140.163.4.231:8080
05:38:26:ERROR:WU00:FS01:Exception: 10002: Received short response, expected 512 bytes, got 0
05:44:55:WU00:FS01:Connecting to 65.254.110.245:8080
05:44:56:WU00:FS01:Assigned to work server 140.163.4.241
05:44:56:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:TU104 [GeForce RTX 2080] from 140.163.4.241
05:44:56:WU00:FS01:Connecting to 140.163.4.241:8080
05:45:17:WARNING:WU00:FS01:WorkServer connection failed on port 8080 trying 80
05:45:17:WU00:FS01:Connecting to 140.163.4.241:80
05:45:36:ERROR:WU00:FS01:Exception: 10002: Received short response, expected 512 bytes, got 0

Leonardo · Post by **Leonardo** » Sat Mar 14, 2020 6:06 am

Yes, this server and 140.163.4.241 seemed to be overloaded. I've got six GPU slots; off and one they are showing the errors others have posted here and in the ~.231 thread. On another topic, but related, thanks for the Covid-19/Covid projects! Rock on!

KjartanD · Post by **KjartanD** » Tue Mar 24, 2020 10:30 pm

No fixes yet for the 140.163.4.241 server?

Takes 20 minutes for 3%

Code: Select all

22:22:25:WU00:FS01:Upload 1.00%
22:22:47:WU00:FS01:Upload 1.13%
22:23:17:WU00:FS01:Upload 1.25%
22:23:28:WU02:FS01:0x22:Completed 20000 out of 2000000 steps (1%)
22:23:43:WU00:FS01:Upload 1.38%
22:24:07:WU00:FS01:Upload 1.50%
22:24:45:WU00:FS01:Upload 1.63%
22:24:47:WU02:FS01:0x22:Completed 40000 out of 2000000 steps (2%)
22:25:18:WU00:FS01:Upload 1.75%
22:25:48:WU00:FS01:Upload 1.88%
22:26:08:WU02:FS01:0x22:Completed 60000 out of 2000000 steps (3%)
22:26:15:WU00:FS01:Upload 2.00%
22:26:38:WU00:FS01:Upload 2.13%
22:27:09:WU00:FS01:Upload 2.25%
22:27:27:WU02:FS01:0x22:Completed 80000 out of 2000000 steps (4%)
22:27:27:WU00:FS01:Upload 2.38%
22:27:40:WU00:FS01:Upload 2.50%
22:27:51:WU00:FS01:Upload 2.63%
22:28:00:WU00:FS01:Upload 2.75%
22:28:15:WU00:FS01:Upload 3.00%
22:28:24:WU00:FS01:Upload 3.13%
22:28:34:WU00:FS01:Upload 3.26%
22:28:40:WU00:FS01:Upload 3.38%
22:28:46:WU02:FS01:0x22:Completed 100000 out of 2000000 steps (5%)
22:28:48:WU00:FS01:Upload 3.51%
22:28:58:WU00:FS01:Upload 3.63%
22:29:08:WU00:FS01:Upload 3.76%
22:29:17:WU00:FS01:Upload 3.88%
22:29:23:WU00:FS01:Upload 4.01%
22:29:32:WU00:FS01:Upload 4.13%
22:29:42:WU00:FS01:Upload 4.26%
22:29:53:WU00:FS01:Upload 4.38%
22:30:03:WU00:FS01:Upload 4.51%
22:30:07:WU02:FS01:0x22:Completed 120000 out of 2000000 steps (6%)
22:30:09:WU00:FS01:Upload 4.63%

Foxbat · Post by **Foxbat** » Sat Mar 28, 2020 12:58 am

toTOW wrote:Rafal has set up another server (140.163.4.231) with Coronavirus-related projects to help balance the load.

I have been able to get work, but when my Folding Client attempts to upload to 140.163.4.231, it get so far and the server says, "PLEASE_WAIT (464)":

Code: Select all

******************************* Date: 2020-03-27 *******************************
23:17:59:WU03:FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:11747 run:0 clone:2983 gen:1 core:0x22 unit:0x000000068ca304e75e6a7fd4ef565568
23:17:59:WU03:FS02:Uploading 21.92MiB to 140.163.4.231
23:17:59:WU03:FS02:Connecting to 140.163.4.231:8080
23:18:05:WU03:FS02:Upload 6.27%
23:18:24:WU03:FS02:Upload 10.84%
23:18:30:WU03:FS02:Upload 17.39%
23:18:36:WU03:FS02:Upload 23.67%
23:18:43:WU03:FS02:Upload 27.66%
23:18:49:WU03:FS02:Upload 33.36%
23:18:55:WU03:FS02:Upload 37.07%
23:19:01:WU03:FS02:Upload 43.63%
23:19:07:WU03:FS02:Upload 50.18%
23:19:13:WU03:FS02:Upload 54.75%
23:19:19:WU03:FS02:Upload 60.45%
23:19:26:WU03:FS02:Upload 64.16%
23:19:32:WU03:FS02:Upload 69.57%
23:19:39:WU03:FS02:Upload 75.28%
23:19:45:WU03:FS02:Upload 80.12%
23:19:51:WU03:FS02:Upload 85.83%
23:19:57:WU03:FS02:Upload 92.10%
23:20:03:WU03:FS02:Upload 97.80%
23:20:07:WU03:FS02:Upload complete
23:20:07:WU03:FS02:Server responded PLEASE_WAIT (464)
23:20:07:WARNING:WU03:FS02:Failed to send results, will try again later
00:39:38:WU03:FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:11747 run:0 clone:2983 gen:1 core:0x22 unit:0x000000068ca304e75e6a7fd4ef565568
00:39:38:WU03:FS02:Uploading 21.92MiB to 140.163.4.231
00:39:38:WU03:FS02:Connecting to 140.163.4.231:8080
00:40:29:WU03:FS02:Upload 1.43%
00:40:35:WU03:FS02:Upload 6.84%
00:40:41:WU03:FS02:Upload 12.83%
00:40:47:WU03:FS02:Upload 17.96%
00:40:53:WU03:FS02:Upload 23.95%
00:40:59:WU03:FS02:Upload 29.37%
00:41:05:WU03:FS02:Upload 35.36%
00:41:16:WU03:FS02:Upload 40.77%
00:41:22:WU03:FS02:Upload 47.05%
00:41:28:WU03:FS02:Upload 52.75%
00:41:34:WU03:FS02:Upload 58.45%
00:41:40:WU03:FS02:Upload 63.87%
00:41:48:WU03:FS02:Upload 70.43%
00:41:54:WU03:FS02:Upload 76.99%
00:42:00:WU03:FS02:Upload 82.69%
00:42:06:WU03:FS02:Upload 87.25%
00:42:13:WU03:FS02:Upload 90.96%
00:42:19:WU03:FS02:Upload 97.52%
00:42:23:WU03:FS02:Upload complete
00:42:23:WU03:FS02:Server responded PLEASE_WAIT (464)
00:42:23:WARNING:WU03:FS02:Failed to send results, will try again later
00:42:24:WU03:FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:11747 run:0 clone:2983 gen:1 core:0x22 unit:0x000000068ca304e75e6a7fd4ef565568
00:42:24:WU03:FS02:Uploading 21.92MiB to 140.163.4.231
00:42:24:WU03:FS02:Connecting to 140.163.4.231:8080
00:43:22:WU03:FS02:Upload 1.43%
00:43:28:WU03:FS02:Upload 6.84%
00:43:34:WU03:FS02:Upload 12.83%
00:43:40:WU03:FS02:Upload 19.39%
00:43:46:WU03:FS02:Upload 23.38%
00:43:52:WU03:FS02:Upload 29.08%
00:43:58:WU03:FS02:Upload 33.93%
00:44:05:WU03:FS02:Upload 40.20%
00:44:11:WU03:FS02:Upload 45.34%
00:44:17:WU03:FS02:Upload 48.76%
00:44:23:WU03:FS02:Upload 55.32%
00:44:29:WU03:FS02:Upload 58.17%
00:44:35:WU03:FS02:Upload 63.02%
00:44:41:WU03:FS02:Upload 67.58%
00:44:47:WU03:FS02:Upload 74.14%
00:44:53:WU03:FS02:Upload 78.70%
00:44:59:WU03:FS02:Upload 85.26%
00:45:05:WU03:FS02:Upload 91.81%
00:45:12:WU03:FS02:Upload 97.52%
00:45:18:WU03:FS02:Upload complete
00:45:18:WU03:FS02:Server responded PLEASE_WAIT (464)
00:45:18:WARNING:WU03:FS02:Failed to send results, will try again later
00:45:18:WU03:FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:11747 run:0 clone:2983 gen:1 core:0x22 unit:0x000000068ca304e75e6a7fd4ef565568
00:45:18:WU03:FS02:Uploading 21.92MiB to 140.163.4.231
00:45:18:WU03:FS02:Connecting to 140.163.4.231:8080
00:46:16:WU03:FS02:Upload 0.86%
00:46:22:WU03:FS02:Upload 7.70%
00:46:28:WU03:FS02:Upload 14.54%
00:46:34:WU03:FS02:Upload 19.10%
00:46:40:WU03:FS02:Upload 21.96%
00:46:46:WU03:FS02:Upload 27.94%
00:46:52:WU03:FS02:Upload 33.93%
00:46:58:WU03:FS02:Upload 38.21%
00:47:04:WU03:FS02:Upload 44.48%
00:47:10:WU03:FS02:Upload 49.33%
00:47:16:WU03:FS02:Upload 55.60%
00:47:22:WU03:FS02:Upload 62.16%
00:47:29:WU03:FS02:Upload 67.86%
00:47:35:WU03:FS02:Upload 72.71%
00:47:41:WU03:FS02:Upload 76.13%
00:47:48:WU03:FS02:Upload 78.41%
00:47:54:WU03:FS02:Upload 81.83%
00:48:00:WU03:FS02:Upload 85.26%
00:48:06:WU03:FS02:Upload 90.67%
00:48:12:WU03:FS02:Upload 97.23%
00:48:16:WU03:FS02:Upload complete
00:48:17:WU03:FS02:Server responded PLEASE_WAIT (464)
00:48:17:WARNING:WU03:FS02:Failed to send results, will try again later
00:49:32:WU03:FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:11747 run:0 clone:2983 gen:1 core:0x22 unit:0x000000068ca304e75e6a7fd4ef565568
00:49:32:WU03:FS02:Uploading 21.92MiB to 140.163.4.231
00:49:32:WU03:FS02:Connecting to 140.163.4.231:8080
00:50:13:WU03:FS02:Upload 1.43%
00:50:19:WU03:FS02:Upload 7.41%
00:50:25:WU03:FS02:Upload 13.40%
00:50:31:WU03:FS02:Upload 20.24%
00:50:37:WU03:FS02:Upload 24.81%
00:50:43:WU03:FS02:Upload 26.80%
00:50:49:WU03:FS02:Upload 33.36%
00:50:55:WU03:FS02:Upload 39.63%
00:51:01:WU03:FS02:Upload 45.34%
00:51:07:WU03:FS02:Upload 51.61%
00:51:13:WU03:FS02:Upload 55.03%
00:51:19:WU03:FS02:Upload 61.30%
00:51:25:WU03:FS02:Upload 67.86%
00:51:31:WU03:FS02:Upload 73.28%
00:51:37:WU03:FS02:Upload 79.84%
00:51:43:WU03:FS02:Upload 86.11%
00:51:49:WU03:FS02:Upload 91.24%
00:51:55:WU03:FS02:Upload 97.52%
00:51:59:WU03:FS02:Upload complete
00:51:59:WU03:FS02:Server responded PLEASE_WAIT (464)
00:51:59:WARNING:WU03:FS02:Failed to send results, will try again later
00:56:24:WU03:FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:11747 run:0 clone:2983 gen:1 core:0x22 unit:0x000000068ca304e75e6a7fd4ef565568

Or, should I create a new Thread for this issue? I tried searching the board for "PLEASE_WAIT", but "please" and the "_" get striped from the search.

Foxbat · Post by **Foxbat** » Sat Mar 28, 2020 4:30 am

Ah, did someone wiggle the cable? This WU finally uploaded but to a different server, 128.252.203.4:

Code: Select all

04:22:05:WU03:FS02:Server responded PLEASE_WAIT (464)
04:22:05:WARNING:WU03:FS02:Failed to send results, will try again later
04:22:05:WU03:FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:11747 run:0 clone:2983 gen:1 core:0x22 unit:0x000000068ca304e75e6a7fd4ef565568
04:22:05:WU03:FS02:Uploading 21.92MiB to 140.163.4.231
04:22:05:WU03:FS02:Connecting to 140.163.4.231:8080
04:23:35:WU03:FS02:Upload 0.57%
04:23:35:WARNING:WU03:FS02:Exception: Failed to send results to work server: Transfer failed
04:23:35:WU03:FS02:Trying to send results to collection server
04:23:35:WU03:FS02:Uploading 21.92MiB to 128.252.203.4
04:23:35:WU03:FS02:Connecting to 128.252.203.4:8080
04:23:41:WU03:FS02:Upload 5.99%
04:23:47:WU03:FS02:Upload 12.83%
04:23:53:WU03:FS02:Upload 18.53%
04:23:59:WU03:FS02:Upload 23.95%
04:24:05:WU03:FS02:Upload 29.37%
04:24:11:WU03:FS02:Upload 34.22%
04:24:17:WU03:FS02:Upload 41.06%
04:24:24:WU03:FS02:Upload 47.62%
04:24:30:WU03:FS02:Upload 54.46%
04:24:36:WU03:FS02:Upload 60.45%
04:24:42:WU03:FS02:Upload 66.15%
04:24:49:WU03:FS02:Upload 72.99%
04:24:55:WU03:FS02:Upload 79.55%
04:25:02:WU03:FS02:Upload 86.40%
04:25:08:WU03:FS02:Upload 92.95%
04:25:14:WU03:FS02:Upload 98.66%
04:25:20:WU03:FS02:Upload complete
04:25:20:WU03:FS02:Server responded WORK_ACK (400)
04:25:20:WU03:FS02:Final credit estimate, 15396.00 points
04:25:20:WU03:FS02:Cleaning up

Folding Forum

Slow uploads to 140.163.4.241

Slow uploads to 140.163.4.241

Re: Slow uploads to 140.163.4.241

Re: Slow uploads to 140.163.4.241

Re: Slow uploads to 140.163.4.241

Re: Slow uploads to 140.163.4.241

Re: Slow uploads to 140.163.4.241

Re: Slow uploads to 140.163.4.241

Re: Slow uploads to 140.163.4.241

Re: Slow uploads to 140.163.4.241

Re: Slow uploads to 140.163.4.241

Re: Slow uploads to 140.163.4.241

Re: Slow uploads to 140.163.4.241

Re: Slow uploads to 140.163.4.241

Re: Slow uploads to 140.163.4.241

Re: Slow uploads to 140.163.4.241