52.224.109.74 - Multiple pending results

Moderators: Site Moderators, FAHC Science Team

MatthewM
Posts: 5
Joined: Fri Mar 27, 2020 7:43 pm

52.224.109.74 - Multiple pending results

Post by MatthewM »

I have multiple pending results to 52.224.109.74 since 4/7 - Connecting to 52.224.109.74:80 is extremely long.

The stats page shows a warning for the server - It also shows that server up only a day - Reboot issue?

LOG>
16:51:09:WARNING:WU02:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
16:52:14:ERROR:WU02:FS01:Exception: Transfer failed
16:52:26:WARNING:WU02:FS01:Exception: Failed to send results to work server: Transfer failed
16:53:30:ERROR:WU02:FS01:Exception: Transfer failed
aol
Posts: 2
Joined: Wed Apr 08, 2020 12:58 am

Re: 52.224.109.74 - Multiple pending results

Post by aol »

If having more details helps server admins, we talked about this here as well:
viewtopic.php?f=61&t=34071

I hope this is resolved soon; my work servers are addicted to sending results to this overloaded server.
All my current work units point to this collection server, which I didn't expect to be an issue when work servers can accept the results.
Problem is, the work servers aren't accepting the results and are pushing that duty all on to fah4...

Huge thanks and respect to server admins for trying to keep up with the increased load, though!
dragon4444
Posts: 1
Joined: Wed Apr 08, 2020 8:52 pm

Re: 52.224.109.74 - Multiple pending results

Post by dragon4444 »

Just chiming in I also have this issue for two (soon to be four) different work units.

I'm going to turn off folding for a bit once my current WU's finish until this is resolved as this happened sometime last night (4/7) and is continuing today.
MatthewM
Posts: 5
Joined: Fri Mar 27, 2020 7:43 pm

Re: 52.224.109.74 - Multiple pending results

Post by MatthewM »

<Edit> Disregard
Last edited by MatthewM on Thu Apr 09, 2020 1:39 pm, edited 1 time in total.
MatthewM
Posts: 5
Joined: Fri Mar 27, 2020 7:43 pm

Re: 52.224.109.74 - Multiple pending results

Post by MatthewM »

UPDATE: Issue is back - I had cleared a backlog of 4 last night, now this AM have a backlog of 5 WUs against this server.

Please please fix this.
rwh202
Posts: 425
Joined: Mon Nov 15, 2010 8:51 pm
Hardware configuration: 8x GTX 1080
3x GTX 1080 Ti
3x GTX 1060
Various other bits and pieces
Location: South Coast, UK

Re: 52.224.109.74 - Multiple pending results

Post by rwh202 »

Multiple uploads hanging. End up needing a restart to reset connections and upload.

Code: Select all

12:35:55:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:13878 run:0 clone:622 gen:17 core:0x22 unit:0x0000001334e06d4a5e80cfe592ad2446
12:35:55:WU01:FS01:Uploading 48.05MiB to 52.224.109.74
12:35:55:WU01:FS01:Connecting to 52.224.109.74:8080
12:35:55:WU00:FS01:Starting
12:35:55:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/beta/Core_22.fah/FahCore_22 -dir 00 -suffix 01 -version 704 -lifeline 1173 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:35:55:WU00:FS01:Started FahCore on PID 6345
12:35:55:WU00:FS01:Core PID:6349
12:35:55:WU00:FS01:FahCore 0x22 started
12:35:56:WU00:FS01:0x22:*********************** Log Started 2020-04-09T12:35:55Z ***********************
12:35:56:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
12:35:56:WU00:FS01:0x22:       Type: 0x22
12:35:56:WU00:FS01:0x22:       Core: Core22
12:35:56:WU00:FS01:0x22:    Website: https://foldingathome.org/
12:35:56:WU00:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
12:35:56:WU00:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
12:35:56:WU00:FS01:0x22:             <rafal.wiewiora@choderalab.org>
12:35:56:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 704 -lifeline 6345 -checkpoint 15 -gpu
12:35:56:WU00:FS01:0x22:             0 -gpu-vendor nvidia
12:35:56:WU00:FS01:0x22:     Config: <none>
12:35:56:WU00:FS01:0x22:************************************ Build *************************************
12:35:56:WU00:FS01:0x22:    Version: 0.0.2
12:35:56:WU00:FS01:0x22:       Date: Dec 6 2019
12:35:56:WU00:FS01:0x22:       Time: 21:20:17
12:35:56:WU00:FS01:0x22: Repository: Git
12:35:56:WU00:FS01:0x22:   Revision: f87d92b58abdf7e6bf2e173cfbc4dc3e837c7042
12:35:56:WU00:FS01:0x22:     Branch: core22
12:35:56:WU00:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
12:35:56:WU00:FS01:0x22:    Options: -std=gnu++98 -O3 -funroll-loops
12:35:56:WU00:FS01:0x22:   Platform: linux2 4.9.87-linuxkit-aufs
12:35:56:WU00:FS01:0x22:       Bits: 64
12:35:56:WU00:FS01:0x22:       Mode: Release
12:35:56:WU00:FS01:0x22:************************************ System ************************************
12:35:56:WU00:FS01:0x22:        CPU: Intel(R) Pentium(R) CPU G3258 @ 3.20GHz
12:35:56:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
12:35:56:WU00:FS01:0x22:       CPUs: 2
12:35:56:WU00:FS01:0x22:     Memory: 7.74GiB
12:35:56:WU00:FS01:0x22:Free Memory: 5.23GiB
12:35:56:WU00:FS01:0x22:    Threads: POSIX_THREADS
12:35:56:WU00:FS01:0x22: OS Version: 3.19
12:35:56:WU00:FS01:0x22:Has Battery: false
12:35:56:WU00:FS01:0x22: On Battery: false
12:35:56:WU00:FS01:0x22: UTC Offset: 1
12:35:56:WU00:FS01:0x22:        PID: 6349
12:35:56:WU00:FS01:0x22:        CWD: /var/lib/fahclient/work
12:35:56:WU00:FS01:0x22:         OS: Linux 3.19.0-32-generic x86_64
12:35:56:WU00:FS01:0x22:    OS Arch: AMD64
12:35:56:WU00:FS01:0x22:********************************************************************************
12:35:56:WU00:FS01:0x22:Project: 11742 (Run 0, Clone 3922, Gen 37)
12:35:56:WU00:FS01:0x22:Unit: 0x0000003a8ca304f15e69cb1e1cac4282
12:35:56:WU00:FS01:0x22:Reading tar file core.xml
12:35:56:WU00:FS01:0x22:Reading tar file integrator.xml
12:35:56:WU00:FS01:0x22:Reading tar file state.xml
12:35:56:WU00:FS01:0x22:Reading tar file system.xml
12:35:56:WU00:FS01:0x22:Digital signatures verified
12:35:56:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
12:35:56:WU00:FS01:0x22:Version 0.0.2
12:36:04:WU00:FS01:0x22:Completed 0 out of 2000000 steps (0%)
12:36:04:WU00:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
12:36:36:WU01:FS01:Upload 0.52%
12:36:42:WU01:FS01:Upload 2.21%
12:36:48:WU01:FS01:Upload 4.03%
12:36:55:WU01:FS01:Upload 5.46%
12:37:01:WU01:FS01:Upload 7.41%
12:37:08:WU01:FS01:Upload 9.36%
12:37:14:WU01:FS01:Upload 11.58%
12:37:16:WU00:FS01:0x22:Completed 20000 out of 2000000 steps (1%)
12:37:21:WU01:FS01:Upload 12.75%
12:37:27:WU01:FS01:Upload 14.44%
12:37:32:WU02:FS00:0x22:Completed 2600000 out of 4000000 steps (65%)
12:37:33:WU01:FS01:Upload 15.74%
12:37:39:WU01:FS01:Upload 16.65%
12:37:45:WU01:FS01:Upload 18.86%
12:37:52:WU01:FS01:Upload 19.90%
12:37:58:WU01:FS01:Upload 20.81%
12:38:04:WU01:FS01:Upload 22.11%
12:38:13:WU01:FS01:Upload 23.41%
12:38:20:WU01:FS01:Upload 24.58%
12:38:27:WU00:FS01:0x22:Completed 40000 out of 2000000 steps (2%)
12:38:28:WU01:FS01:Upload 25.49%
12:38:34:WU01:FS01:Upload 26.40%
12:38:42:WU01:FS01:Upload 28.23%
12:38:48:WU01:FS01:Upload 29.27%
12:38:55:WU01:FS01:Upload 30.18%
12:39:01:WU01:FS01:Upload 31.61%
12:39:07:WU01:FS01:Upload 32.65%
12:39:14:WU01:FS01:Upload 33.82%
12:39:20:WU01:FS01:Upload 35.51%
12:39:26:WU01:FS01:Upload 36.68%
12:39:32:WU01:FS01:Upload 38.63%
12:39:38:WU01:FS01:Upload 40.32%
12:39:40:WU00:FS01:0x22:Completed 60000 out of 2000000 steps (3%)
12:39:44:WU01:FS01:Upload 41.49%
12:39:50:WU01:FS01:Upload 43.18%
12:39:56:WU01:FS01:Upload 44.48%
12:40:03:WU01:FS01:Upload 45.91%
12:40:09:WU01:FS01:Upload 47.35%
12:40:12:WU02:FS00:0x22:Completed 2640000 out of 4000000 steps (66%)
12:40:15:WU01:FS01:Upload 49.17%
12:40:21:WU01:FS01:Upload 50.60%
12:40:28:WU01:FS01:Upload 52.55%
12:40:34:WU01:FS01:Upload 53.46%
12:40:40:WU01:FS01:Upload 55.28%
12:40:46:WU01:FS01:Upload 56.71%
12:40:52:WU00:FS01:0x22:Completed 80000 out of 2000000 steps (4%)
12:40:52:WU01:FS01:Upload 58.66%
12:40:58:WU01:FS01:Upload 60.35%
12:41:04:WU01:FS01:Upload 62.04%
12:41:10:WU01:FS01:Upload 63.73%
12:41:17:WU01:FS01:Upload 65.95%
12:41:23:WU01:FS01:Upload 67.12%
12:41:30:WU01:FS01:Upload 68.55%
12:41:36:WU01:FS01:Upload 69.98%
12:41:42:WU01:FS01:Upload 71.41%
12:41:49:WU01:FS01:Upload 73.10%
12:41:56:WU01:FS01:Upload 74.79%
12:42:03:WU00:FS01:0x22:Completed 100000 out of 2000000 steps (5%)
12:42:03:WU01:FS01:Upload 76.35%
12:42:09:WU01:FS01:Upload 78.04%
12:42:15:WU01:FS01:Upload 79.47%
12:42:21:WU01:FS01:Upload 80.38%
12:42:29:WU01:FS01:Upload 82.07%
12:42:35:WU01:FS01:Upload 83.50%
12:42:42:WU01:FS01:Upload 85.46%
12:42:48:WU01:FS01:Upload 87.02%
12:42:51:WU02:FS00:0x22:Completed 2680000 out of 4000000 steps (67%)
12:42:54:WU01:FS01:Upload 87.93%
12:43:00:WU01:FS01:Upload 89.23%
12:43:06:WU01:FS01:Upload 90.14%
12:43:13:WU01:FS01:Upload 91.18%
12:43:16:WU00:FS01:0x22:Completed 120000 out of 2000000 steps (6%)
12:43:19:WU01:FS01:Upload 91.83%
12:43:25:WU01:FS01:Upload 94.04%
12:43:31:WU01:FS01:Upload 95.73%
12:43:37:WU01:FS01:Upload 97.16%
12:43:43:WU01:FS01:Upload 97.68%
12:43:50:WU01:FS01:Upload 99.24%
12:44:27:WU00:FS01:0x22:Completed 140000 out of 2000000 steps (7%)
12:45:31:WU02:FS00:0x22:Completed 2720000 out of 4000000 steps (68%)
12:45:41:WU00:FS01:0x22:Completed 160000 out of 2000000 steps (8%)
12:46:52:WU00:FS01:0x22:Completed 180000 out of 2000000 steps (9%)
12:48:04:WU00:FS01:0x22:Completed 200000 out of 2000000 steps (10%)
12:48:10:WU02:FS00:0x22:Completed 2760000 out of 4000000 steps (69%)
12:49:17:WU00:FS01:0x22:Completed 220000 out of 2000000 steps (11%)
12:50:29:WU00:FS01:0x22:Completed 240000 out of 2000000 steps (12%)
12:50:48:WU02:FS00:0x22:Completed 2800000 out of 4000000 steps (70%)
12:51:42:WU00:FS01:0x22:Completed 260000 out of 2000000 steps (13%)
12:52:54:WU00:FS01:0x22:Completed 280000 out of 2000000 steps (14%)
12:53:27:WU02:FS00:0x22:Completed 2840000 out of 4000000 steps (71%)
12:54:05:WU00:FS01:0x22:Completed 300000 out of 2000000 steps (15%)
12:55:18:WU00:FS01:0x22:Completed 320000 out of 2000000 steps (16%)
12:56:07:WU02:FS00:0x22:Completed 2880000 out of 4000000 steps (72%)
12:56:30:WU00:FS01:0x22:Completed 340000 out of 2000000 steps (17%)
12:57:43:WU00:FS01:0x22:Completed 360000 out of 2000000 steps (18%)
12:58:46:WU02:FS00:0x22:Completed 2920000 out of 4000000 steps (73%)
12:58:54:WU00:FS01:0x22:Completed 380000 out of 2000000 steps (19%)
Epsilon_Process
Posts: 6
Joined: Fri Apr 10, 2020 5:52 am

Re: 52.224.109.74 - Multiple pending results

Post by Epsilon_Process »

Hi all, just wanted to report I'm having the same issue. I have a large result upload that has been retrying for hours to this server.

05:46:17:WU02:FS01:Uploading 271.27MiB to 52.224.109.74
05:46:17:WU02:FS01:Connecting to 52.224.109.74:8080
05:46:18:ERROR:WU02:FS01:Exception: Transfer failed
Epsilon_Process
Posts: 6
Joined: Fri Apr 10, 2020 5:52 am

Re: 52.224.109.74 - Multiple pending results

Post by Epsilon_Process »

Epsilon_Process wrote:05:46:17:WU02:FS01:Uploading 271.27MiB to 52.224.109.74
05:46:17:WU02:FS01:Connecting to 52.224.109.74:8080
05:46:18:ERROR:WU02:FS01:Exception: Transfer failed
So I Wiresharked the connection and saw the reason I was getting the transfer failed error was due to the 413 HTTP_REQUEST_ENTITY_TOO_LARGE error that others have seen as well. So given that the wuresults.dat file was an unusually large size of 271.27MiB,I looked inside and saw a lot of "Bad state detected" and "Particle coordinate is NaN" errors and finally "ERROR 114: Max Retries Reached." Putting all those together led me to believe the WU was either faulty or somehow got fouled up, so I deleted it. FahClient simply just downloaded a new WU and started over. I'm not overclocking my GPU and it's been running smoothly otherwise, so possibly I got a bad WU or my GPU decided to glitch on that WU for whatever reason. It's been running fine since then.
KimboJ
Posts: 6
Joined: Mon Apr 13, 2020 12:26 am

Re: 52.224.109.74 - Multiple pending results

Post by KimboJ »

I have work waiting for this server too.
anandhanju
Posts: 526
Joined: Mon Dec 03, 2007 4:33 am
Location: Australia

Re: 52.224.109.74 - Multiple pending results

Post by anandhanju »

Can you please post the section of the log that has the Project, Run, Clone and Gen numbers when it is trying to upload as well as the line that has the upload size? This will help the researchers get to the root of the problem sooner.

For example,
12:35:55:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:13878 run:0 clone:622 gen:17 core:0x22 unit:0x0000001334e06d4a5e80cfe592ad2446
12:35:55:WU01:FS01:Uploading 48.05MiB to 52.224.109.74
L0w3r
Posts: 10
Joined: Sun Mar 15, 2020 8:05 pm

Re: 52.224.109.74 - Multiple pending results

Post by L0w3r »

i have been attempting to send a WU to this server for a day and a half.

Here is some log notes, if you need more, please let me know.

I am working on other WU but i would like to get this one to upload before it expires on the 18th

Code: Select all

******************************* Date: 2020-04-12 *******************************
08:35:16:WU00:FS01:0xa7:Completed 480000 out of 500000 steps (96%)
08:46:50:WU00:FS01:0xa7:Completed 485000 out of 500000 steps (97%)
08:58:23:WU00:FS01:0xa7:Completed 490000 out of 500000 steps (98%)
09:10:02:WU00:FS01:0xa7:Completed 495000 out of 500000 steps (99%)
09:21:03:WU00:FS01:0xa7:Completed 500000 out of 500000 steps (100%)
09:21:04:WU00:FS01:0xa7:Saving result file ..\logfile_01.txt
09:21:04:WU00:FS01:0xa7:Saving result file frame13.edr
09:21:04:WU00:FS01:0xa7:Saving result file frame13.trr
09:21:04:WU00:FS01:0xa7:Saving result file frame13.xtc
09:21:04:WU00:FS01:0xa7:Saving result file md.log
09:21:04:WU00:FS01:0xa7:Saving result file science.log
09:21:04:WU00:FS01:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
09:21:05:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
09:21:05:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:13851 run:0 clone:4753 gen:13 core:0xa7 unit:0x0000001d287234c95e72581fd43cf311
09:21:05:WU00:FS01:Uploading 2.54MiB to 40.114.52.201
09:21:05:WU00:FS01:Connecting to 40.114.52.201:8080
09:21:11:WU00:FS01:Upload 56.60%
09:21:15:WU00:FS01:Upload complete
09:21:15:WU00:FS01:Server responded PLEASE_WAIT (464)
09:21:15:WARNING:WU00:FS01:Failed to send results, will try again later
09:21:15:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:13851 run:0 clone:4753 gen:13 core:0xa7 unit:0x0000001d287234c95e72581fd43cf311
09:21:15:WU00:FS01:Uploading 2.54MiB to 40.114.52.201
09:21:15:WU00:FS01:Connecting to 40.114.52.201:8080
09:21:21:WU00:FS01:Upload 59.07%
09:21:24:WU00:FS01:Upload complete
09:21:25:WU00:FS01:Server responded PLEASE_WAIT (464)
09:21:25:WARNING:WU00:FS01:Failed to send results, will try again later
09:22:15:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:13851 run:0 clone:4753 gen:13 core:0xa7 unit:0x0000001d287234c95e72581fd43cf311
09:22:15:WU00:FS01:Uploading 2.54MiB to 40.114.52.201
09:22:15:WU00:FS01:Connecting to 40.114.52.201:8080
09:22:21:WU00:FS01:Upload 59.07%
09:22:25:WU00:FS01:Upload complete
09:22:25:WU00:FS01:Server responded PLEASE_WAIT (464)
09:22:25:WARNING:WU00:FS01:Failed to send results, will try again later
09:23:52:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:13851 run:0 clone:4753 gen:13 core:0xa7 unit:0x0000001d287234c95e72581fd43cf311
09:23:52:WU00:FS01:Uploading 2.54MiB to 40.114.52.201
09:23:52:WU00:FS01:Connecting to 40.114.52.201:8080
09:23:58:WU00:FS01:Upload 56.60%
09:24:02:WU00:FS01:Upload complete
09:24:02:WU00:FS01:Server responded PLEASE_WAIT (464)
09:24:02:WARNING:WU00:FS01:Failed to send results, will try again later
09:26:29:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:13851 run:0 clone:4753 gen:13 core:0xa7 unit:0x0000001d287234c95e72581fd43cf311
09:26:29:WU00:FS01:Uploading 2.54MiB to 40.114.52.201
09:26:29:WU00:FS01:Connecting to 40.114.52.201:8080
09:26:35:WU00:FS01:Upload 49.22%
09:26:40:WU00:FS01:Upload complete
09:26:40:WU00:FS01:Server responded PLEASE_WAIT (464)
09:26:40:WARNING:WU00:FS01:Failed to send results, will try again later
09:30:44:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:13851 run:0 clone:4753 gen:13 core:0xa7 unit:0x0000001d287234c95e72581fd43cf311
09:30:44:WU00:FS01:Uploading 2.54MiB to 40.114.52.201
09:30:44:WU00:FS01:Connecting to 40.114.52.201:8080
09:30:50:WU00:FS01:Upload 61.53%
09:30:53:WU00:FS01:Upload complete
09:30:53:WU00:FS01:Server responded PLEASE_WAIT (464)
09:30:53:WARNING:WU00:FS01:Failed to send results, will try again later
09:37:35:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:13851 run:0 clone:4753 gen:13 core:0xa7 unit:0x0000001d287234c95e72581fd43cf311
09:37:35:WU00:FS01:Uploading 2.54MiB to 40.114.52.201
09:37:35:WU00:FS01:Connecting to 40.114.52.201:8080
09:37:41:WU00:FS01:Upload 56.60%
09:37:45:WU00:FS01:Upload complete
09:37:45:WU00:FS01:Server responded PLEASE_WAIT (464)
09:37:45:WARNING:WU00:FS01:Failed to send results, will try again later
09:48:41:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:13851 run:0 clone:4753 gen:13 core:0xa7 unit:0x0000001d287234c95e72581fd43cf311
09:48:41:WU00:FS01:Uploading 2.54MiB to 40.114.52.201
09:48:41:WU00:FS01:Connecting to 40.114.52.201:8080
09:48:47:WU00:FS01:Upload 63.99%
09:48:50:WU00:FS01:Upload complete
09:48:50:WU00:FS01:Server responded PLEASE_WAIT (464)
09:48:50:WARNING:WU00:FS01:Failed to send results, will try again later
10:06:37:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:13851 run:0 clone:4753 gen:13 core:0xa7 unit:0x0000001d287234c95e72581fd43cf311
10:06:37:WU00:FS01:Uploading 2.54MiB to 40.114.52.201
10:06:37:WU00:FS01:Connecting to 40.114.52.201:8080
10:06:43:WU00:FS01:Upload 54.14%
10:06:47:WU00:FS01:Upload complete
10:06:47:WU00:FS01:Server responded PLEASE_WAIT (464)
10:06:47:WARNING:WU00:FS01:Failed to send results, will try again later
10:35:40:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:13851 run:0 clone:4753 gen:13 core:0xa7 unit:0x0000001d287234c95e72581fd43cf311
10:35:40:WU00:FS01:Uploading 2.54MiB to 40.114.52.201
10:35:40:WU00:FS01:Connecting to 40.114.52.201:8080
10:35:46:WU00:FS01:Upload 61.53%
10:35:49:WU00:FS01:Upload complete
10:35:49:WU00:FS01:Server responded PLEASE_WAIT (464)
10:35:49:WARNING:WU00:FS01:Failed to send results, will try again later
11:22:38:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:13851 run:0 clone:4753 gen:13 core:0xa7 unit:0x0000001d287234c95e72581fd43cf311
11:22:38:WU00:FS01:Uploading 2.54MiB to 40.114.52.201
11:22:38:WU00:FS01:Connecting to 40.114.52.201:8080
11:22:44:WU00:FS01:Upload 54.14%
11:22:48:WU00:FS01:Upload complete
11:22:48:WU00:FS01:Server responded PLEASE_WAIT (464)
11:22:48:WARNING:WU00:FS01:Failed to send results, will try again later
12:38:39:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:13851 run:0 clone:4753 gen:13 core:0xa7 unit:0x0000001d287234c95e72581fd43cf311
12:38:39:WU00:FS01:Uploading 2.54MiB to 40.114.52.201
12:38:39:WU00:FS01:Connecting to 40.114.52.201:8080
12:38:45:WU00:FS01:Upload 56.60%
12:38:49:WU00:FS01:Upload complete
12:38:49:WU00:FS01:Server responded PLEASE_WAIT (464)
12:38:49:WARNING:WU00:FS01:Failed to send results, will try again later
******************************* Date: 2020-04-12 *******************************
14:41:39:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:13851 run:0 clone:4753 gen:13 core:0xa7 unit:0x0000001d287234c95e72581fd43cf311
14:41:39:WU00:FS01:Uploading 2.54MiB to 40.114.52.201
14:41:39:WU00:FS01:Connecting to 40.114.52.201:8080
14:41:45:WU00:FS01:Upload 61.53%
14:41:48:WU00:FS01:Upload complete
14:41:49:WU00:FS01:Server responded PLEASE_WAIT (464)
14:41:49:WARNING:WU00:FS01:Failed to send results, will try again later
18:00:39:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:13851 run:0 clone:4753 gen:13 core:0xa7 unit:0x0000001d287234c95e72581fd43cf311
18:00:39:WU00:FS01:Uploading 2.54MiB to 40.114.52.201
18:00:39:WU00:FS01:Connecting to 40.114.52.201:8080
18:00:45:WU00:FS01:Upload 54.14%
18:00:49:WU00:FS01:Upload complete
18:00:49:WU00:FS01:Server responded PLEASE_WAIT (464)
18:00:49:WARNING:WU00:FS01:Failed to send results, will try again later
******************************* Date: 2020-04-12 *******************************
23:22:39:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:13851 run:0 clone:4753 gen:13 core:0xa7 unit:0x0000001d287234c95e72581fd43cf311
23:22:39:WU00:FS01:Uploading 2.54MiB to 40.114.52.201
23:22:39:WU00:FS01:Connecting to 40.114.52.201:8080
23:22:45:WU00:FS01:Upload 54.14%
23:22:49:WU00:FS01:Upload complete
23:22:49:WU00:FS01:Server responded PLEASE_WAIT (464)
23:22:49:WARNING:WU00:FS01:Failed to send results, will try again later
******************************* Date: 2020-04-13 *******************************
05:22:40:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:13851 run:0 clone:4753 gen:13 core:0xa7 unit:0x0000001d287234c95e72581fd43cf311
05:22:40:WU00:FS01:Uploading 2.54MiB to 40.114.52.201
05:22:40:WU00:FS01:Connecting to 40.114.52.201:8080
05:22:46:WU00:FS01:Upload 63.99%
05:22:49:WU00:FS01:Upload complete
05:22:49:WU00:FS01:Server responded PLEASE_WAIT (464)
05:22:49:WARNING:WU00:FS01:Failed to send results, will try again later
******************************* Date: 2020-04-13 *******************************
Last edited by Joe_H on Mon Apr 13, 2020 3:11 pm, edited 1 time in total.
Reason: add Code tags to log
anandhanju
Posts: 526
Joined: Mon Dec 03, 2007 4:33 am
Location: Australia

Re: 52.224.109.74 - Multiple pending results

Post by anandhanju »

@L0w3r, Your uploads are to a different server (40.114.52.201). The necessary folks have been notified and will be looking into it.
Last edited by anandhanju on Tue Apr 14, 2020 5:31 am, edited 1 time in total.
ToeBlister
Posts: 36
Joined: Thu Mar 26, 2020 3:23 pm

Re: 52.224.109.74 - Multiple pending results

Post by ToeBlister »

same problem.

Code: Select all

14:37:03:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:14549 run:0 clone:1347 gen:8 core:0x22 unit:0x0000000b0d5262775e863e36dfd3e715
14:37:03:WU01:FS00:Uploading 22.07MiB to 13.82.98.119
14:37:03:WU01:FS00:Connecting to 13.82.98.119:8080
14:37:28:WU01:FS00:Upload 0.57%
14:37:28:WARNING:WU01:FS00:Exception: Failed to send results to work server: Transfer failed
14:37:28:WU01:FS00:Trying to send results to collection server
14:37:28:WU01:FS00:Uploading 22.07MiB to 52.224.109.74
14:37:28:WU01:FS00:Connecting to 52.224.109.74:8080
14:37:47:WU01:FS00:Upload 0.57%
14:37:47:ERROR:WU01:FS00:Exception: Transfer failed
L0w3r
Posts: 10
Joined: Sun Mar 15, 2020 8:05 pm

Re: 52.224.109.74 - Multiple pending results

Post by L0w3r »

anandhanju wrote:@L0w3r, You're uploads are to a different server (40.114.52.201). The necessary folks have been notified and will be looking into it.

apologies, i was going off the advanced control display that shows the WU "collection server" as 52.224.109.74 and assumed that this was the server responsible, when the log clearly shows the one you quoted.

thanks.
uyaem
Posts: 222
Joined: Sat Mar 21, 2020 7:35 pm
Location: Esslingen, Germany

Re: 52.224.109.74 - Multiple pending results

Post by uyaem »

The client will always attempt to upload to the Work Server (WS) where it got the WU.
If that one is busy, or unavailable, the collection server (which is just an extended queue as I understand it) will take care of it (if available).
Not all WS have a CS though.
Image
CPU: Ryzen 9 3900X (1x21 CPUs) ~ GPU: nVidia GeForce GTX 1660 Super (Asus)
Locked