Server responded PLEASE_WAIT (464)

Moderators: Site Moderators, FAHC Science Team

Post Reply
Grandpa_01
Posts: 1122
Joined: Wed Mar 04, 2009 7:36 am
Hardware configuration: 3 - Supermicro H8QGi-F AMD MC 6174=144 cores 2.5Ghz, 96GB G.Skill DDR3 1333Mhz Ubuntu 10.10
2 - Asus P6X58D-E i7 980X 4.4Ghz 6GB DDR3 2000 A-Data 64GB SSD Ubuntu 10.10
1 - Asus Rampage Gene III 17 970 4.3Ghz DDR3 2000 2-500GB Segate 7200.11 0-Raid Ubuntu 10.10
1 - Asus G73JH Laptop i7 740QM 1.86Ghz ATI 5870M

Server responded PLEASE_WAIT (464)

Post by Grandpa_01 »

I saw this in today's log and I can not remember ever seeing it before, what triggers this response from the server

22:52:31:WU01:FS00:Server responded PLEASE_WAIT (464)

Code: Select all

22:33:54:WU00:FS00:0x18:*********************** Log Started 2015-10-03T22:33:53Z ***********************
22:33:54:WU00:FS00:0x18:Project: 10476 (Run 0, Clone 52, Gen 183)
22:33:54:WU00:FS00:0x18:Unit: 0x00000105538b3dba53f381011eadb10b
22:33:54:WU00:FS00:0x18:CPU: 0x00000000000000000000000000000000
22:33:54:WU00:FS00:0x18:Machine: 0
22:33:54:WU00:FS00:0x18:Reading tar file state.xml
22:33:54:WU00:FS00:0x18:Reading tar file system.xml
22:33:54:WU00:FS00:0x18:Reading tar file integrator.xml
22:33:54:WU00:FS00:0x18:Reading tar file core.xml
22:33:54:WU00:FS00:0x18:Digital signatures verified
22:33:54:WU00:FS00:0x18:Folding@home GPU core18
22:33:54:WU00:FS00:0x18:Version 0.0.4
22:34:09:WU00:FS00:0x18:Completed 0 out of 5000000 steps (0%)
22:34:09:WU00:FS00:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
22:34:55:WU01:FS00:Upload 6.79%
22:36:34:WU00:FS00:0x18:Completed 50000 out of 5000000 steps (1%)
22:38:55:WU00:FS00:0x18:Completed 100000 out of 5000000 steps (2%)
22:41:21:WU00:FS00:0x18:Completed 150000 out of 5000000 steps (3%)
22:43:42:WU00:FS00:0x18:Completed 200000 out of 5000000 steps (4%)
22:46:03:WU00:FS00:0x18:Completed 250000 out of 5000000 steps (5%)
22:48:29:WU00:FS00:0x18:Completed 300000 out of 5000000 steps (6%)
22:50:50:WU00:FS00:0x18:Completed 350000 out of 5000000 steps (7%)
22:52:05:WU01:FS00:Upload 8.93%
22:52:05:WARNING:WU01:FS00:Exception: Failed to send results to work server: Transfer failed
22:52:05:WU01:FS00:Trying to send results to collection server
22:52:05:WU01:FS00:Uploading 17.49MiB to 171.65.103.160
22:52:05:WU01:FS00:Connecting to 171.65.103.160:8080
22:52:11:WU01:FS00:Upload 21.80%
22:52:17:WU01:FS00:Upload 45.38%
22:52:23:WU01:FS00:Upload 71.11%
22:52:29:WU01:FS00:Upload 94.34%
22:52:31:WU01:FS00:Upload complete
22:52:31:WU01:FS00:Server responded PLEASE_WAIT (464)
22:52:31:WARNING:WU01:FS00:Failed to send results, will try again later
22:52:31:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:9208 run:0 clone:1 gen:3 core:0x21 unit:0x00000004664f2dd055edd356cab05a2c
22:52:31:WU01:FS00:Uploading 17.49MiB to 171.64.65.104
22:52:31:WU01:FS00:Connecting to 171.64.65.104:8080
22:52:37:WU01:FS00:Upload 24.30%
22:52:43:WU01:FS00:Upload 48.24%
22:52:49:WU01:FS00:Upload 72.90%
22:52:55:WU01:FS00:Upload 96.48%
22:53:15:WU01:FS00:Upload complete
22:53:15:WU01:FS00:Server responded WORK_ACK (400)
22:53:15:WU01:FS00:Final credit estimate, 118374.00 points
22:53:15:WU01:FS00:Cleaning up
Image
2 - SM H8QGi-F AMD 6xxx=112 cores @ 3.2 & 3.9Ghz
5 - SM X9QRI-f+ Intel 4650 = 320 cores @ 3.15Ghz
2 - I7 980X 4.4Ghz 2-GTX680
1 - 2700k 4.4Ghz GTX680
Total = 464 cores folding
Calcii
Posts: 57
Joined: Fri Dec 16, 2011 12:47 pm

Re: Server responded PLEASE_WAIT (464)

Post by Calcii »

+1

Code: Select all

12:49:34:WU04:FS00:Server responded PLEASE_WAIT (464)
12:49:34:WARNING:WU04:FS00:Failed to send results, will try again later
12:49:51:WU08:FS02:0x21:Completed 575000 out of 2500000 steps (23%)
12:50:16:WARNING:WU03:FS02:Exception: Failed to send results to work server: Failed to connect to 171.67.108.155:80: Connection timed out
12:50:16:WU03:FS02:Trying to send results to collection server
12:50:16:WU03:FS02:Uploading 19.20MiB to 171.65.103.160
12:50:16:WU03:FS02:Connecting to 171.65.103.160:8080
12:50:22:WU03:FS02:Upload 18.55%
12:50:28:WU03:FS02:Upload 37.11%
12:50:34:WU03:FS02:Upload 55.99%
12:50:40:WU03:FS02:Upload 76.17%
12:50:46:WU03:FS02:Upload 94.72%
12:50:49:WU03:FS02:Upload complete
12:50:49:WU03:FS02:Server responded PLEASE_WAIT (464)
12:50:49:WARNING:WU03:FS02:Failed to send results, will try again later
12:51:06:WU00:FS00:0x21:Completed 2275000 out of 2500000 steps (91%)
12:51:08:WU06:FS01:Sending unit results: id:06 state:SEND error:NO_ERROR project:9712 run:26 clone:0 gen:68 core:0x21 unit:0x000000f5ab40416255b9aa222aafaedc
12:51:08:WU06:FS01:Uploading 9.51MiB to 171.64.65.98
12:51:08:WU06:FS01:Connecting to 171.64.65.98:8080
12:51:24:WU07:FS01:0x21:Completed 1275000 out of 2500000 steps (51%)
12:51:45:WU04:FS00:Sending unit results: id:04 state:SEND error:NO_ERROR project:9704 run:24 clone:13 gen:68 core:0x21 unit:0x00000062ab404162553ebf6add47633d
12:51:45:WU04:FS00:Uploading 14.99MiB to 171.64.65.98
12:51:45:WU04:FS00:Connecting to 171.64.65.98:8080
12:52:53:WU03:FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:9638 run:0 clone:0 gen:25 core:0x21 unit:0x0000001dab436c9b5609bee3f076f695
12:52:53:WU03:FS02:Uploading 19.20MiB to 171.67.108.155
12:52:53:WU03:FS02:Connecting to 171.67.108.155:8080
12:53:15:WARNING:WU06:FS01:WorkServer connection failed on port 8080 trying 80
12:53:15:WU06:FS01:Connecting to 171.64.65.98:80
12:53:52:WARNING:WU04:FS00:WorkServer connection failed on port 8080 trying 80
12:53:52:WU04:FS00:Connecting to 171.64.65.98:80
12:55:00:WARNING:WU03:FS02:WorkServer connection failed on port 8080 trying 80
12:55:00:WU03:FS02:Connecting to 171.67.108.155:80
12:55:22:WARNING:WU06:FS01:Exception: Failed to send results to work server: Failed to connect to 171.64.65.98:80: Connection timed out
12:55:22:WU06:FS01:Trying to send results to collection server
12:55:22:WU06:FS01:Uploading 9.51MiB to 171.65.103.160
12:55:22:WU06:FS01:Connecting to 171.65.103.160:8080
12:55:28:WU06:FS01:Upload 34.82%
12:55:34:WU06:FS01:Upload 72.26%
12:55:39:WU06:FS01:Upload complete
12:55:39:WU06:FS01:Server responded PLEASE_WAIT (464)
12:55:39:WARNING:WU06:FS01:Failed to send results, will try again later
12:55:52:WU08:FS02:0x21:Completed 600000 out of 2500000 steps (24%)
12:55:59:WARNING:WU04:FS00:Exception: Failed to send results to work server: Failed to connect to 171.64.65.98:80: Connection timed out
12:55:59:WU04:FS00:Trying to send results to collection server
12:55:59:WU04:FS00:Uploading 14.99MiB to 171.65.103.160
12:55:59:WU04:FS00:Connecting to 171.65.103.160:8080
12:56:05:WU04:FS00:Upload 22.52%
12:56:11:WU04:FS00:Upload 47.13%
12:56:17:WU04:FS00:Upload 72.57%
12:56:23:WU04:FS00:Upload 98.85%
12:56:24:WU04:FS00:Upload complete
12:56:24:WU04:FS00:Server responded PLEASE_WAIT (464)
12:56:24:WARNING:WU04:FS00:Failed to send results, will try again later
12:57:07:WARNING:WU03:FS02:Exception: Failed to send results to work server: Failed to connect to 171.67.108.155:80: Connection timed out
12:57:07:WU03:FS02:Trying to send results to collection server
12:57:07:WU03:FS02:Uploading 19.20MiB to 171.65.103.160
12:57:07:WU03:FS02:Connecting to 171.65.103.160:8080
12:57:13:WU03:FS02:Upload 17.58%
12:57:19:WU03:FS02:Upload 35.48%
12:57:25:WU03:FS02:Upload 55.34%
12:57:31:WU03:FS02:Upload 73.24%
12:57:32:WU00:FS00:0x21:Completed 2300000 out of 2500000 steps (92%)
12:57:37:WU03:FS02:Upload 93.09%
12:57:40:WU03:FS02:Upload complete
12:57:40:WU03:FS02:Server responded PLEASE_WAIT (464)
12:57:40:WARNING:WU03:FS02:Failed to send results, will try again later
12:57:57:WU07:FS01:0x21:Completed 1300000 out of 2500000 steps (52%)
13:02:08:WU08:FS02:0x21:Completed 625000 out of 2500000 steps (25%)
13:02:13:WU06:FS01:Sending unit results: id:06 state:SEND error:NO_ERROR project:9712 run:26 clone:0 gen:68 core:0x21 unit:0x000000f5ab40416255b9aa222aafaedc
13:02:13:WU06:FS01:Uploading 9.51MiB to 171.64.65.98
13:02:13:WU06:FS01:Connecting to 171.64.65.98:8080
13:02:50:WU04:FS00:Sending unit results: id:04 state:SEND error:NO_ERROR project:9704 run:24 clone:13 gen:68 core:0x21 unit:0x00000062ab404162553ebf6add47633d
13:02:50:WU04:FS00:Uploading 14.99MiB to 171.64.65.98
13:02:50:WU04:FS00:Connecting to 171.64.65.98:8080
13:03:58:WU03:FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:9638 run:0 clone:0 gen:25 core:0x21 unit:0x0000001dab436c9b5609bee3f076f695
13:03:58:WU03:FS02:Uploading 19.20MiB to 171.67.108.155
13:03:58:WU03:FS02:Connecting to 171.67.108.155:8080
13:04:11:WU00:FS00:0x21:Completed 2325000 out of 2500000 steps (93%)
13:04:20:WARNING:WU06:FS01:WorkServer connection failed on port 8080 trying 80
13:04:20:WU06:FS01:Connecting to 171.64.65.98:80
13:04:45:WU07:FS01:0x21:Completed 1325000 out of 2500000 steps (53%)
13:04:58:WARNING:WU04:FS00:WorkServer connection failed on port 8080 trying 80
13:04:58:WU04:FS00:Connecting to 171.64.65.98:80
13:06:05:WARNING:WU03:FS02:WorkServer connection failed on port 8080 trying 80
13:06:05:WU03:FS02:Connecting to 171.67.108.155:80
13:06:28:WARNING:WU06:FS01:Exception: Failed to send results to work server: Failed to connect to 171.64.65.98:80: Connection timed out
13:06:28:WU06:FS01:Trying to send results to collection server
13:06:28:WU06:FS01:Uploading 9.51MiB to 171.65.103.160
13:06:28:WU06:FS01:Connecting to 171.65.103.160:8080
13:06:34:WU06:FS01:Upload 38.10%
13:06:40:WU06:FS01:Upload 78.83%
13:06:44:WU06:FS01:Upload complete
13:06:44:WU06:FS01:Server responded PLEASE_WAIT (464)
13:06:44:WARNING:WU06:FS01:Failed to send results, will try again later
13:07:05:WARNING:WU04:FS00:Exception: Failed to send results to work server: Failed to connect to 171.64.65.98:80: Connection timed out
13:07:05:WU04:FS00:Trying to send results to collection server
13:07:05:WU04:FS00:Uploading 14.99MiB to 171.65.103.160
13:07:05:WU04:FS00:Connecting to 171.65.103.160:8080
TheWolf
Posts: 286
Joined: Thu Jan 24, 2008 10:34 am

Re: Server responded PLEASE_WAIT (464)

Post by TheWolf »

This is going on the 2nd day that this file will not upload. Who ever tripped over the server cord, Please plug it back in boot it and check that everything is okay!

[quote06:37:07:WU01:FS00:Uploading 1.41MiB to 40.114.52.201
06:37:07:WU01:FS00:Connecting to 40.114.52.201:8080
06:37:13:WU01:FS00:Upload 22.10%
06:37:20:WU01:FS00:Upload 44.20%
06:37:26:WU01:FS00:Upload 70.72%
06:37:29:WU01:FS00:Upload complete
06:37:29:WU01:FS00:Server responded PLEASE_WAIT (464)][/quote]
foldy
Posts: 2061
Joined: Sat Dec 01, 2012 3:43 pm
Hardware configuration: Folding@Home Client 7.6.13 (1 GPU slots)
Windows 7 64bit
Intel Core i5 2500k@4Ghz
Nvidia gtx 1080ti driver 441

Re: Server responded PLEASE_WAIT (464)

Post by foldy »

https://apps.foldingathome.org/serverstats
Server 40.114.52.201 is out of disk space. Maybe as workaround in firewall try to block connection to 40.114.52.201 until it gets more disk space. That should give you a different server to upload to.
PantherX
Site Moderator
Posts: 7020
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: Server responded PLEASE_WAIT (464)

Post by PantherX »

Who ever tripped over the Server cord will have to get a massive USB to transfer the data out of 40.114.52.201 as that Server has no free space... it might take a wee bit of time.
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
Neil-B
Posts: 2027
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: Server responded PLEASE_WAIT (464)

Post by Neil-B »

WUs can only be returned to the WS they were downloaded from or the associated CS ... firewalling it wont mean the WUs awaiting upload go to another WS they will just expire without being uploaded.
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070

(Green/Bold = Active)
TheWolf
Posts: 286
Joined: Thu Jan 24, 2008 10:34 am

Re: Server responded PLEASE_WAIT (464)

Post by TheWolf »

You would think these servers were all or mostly on the same network, just transfer the data across the network, Admin.
TheWolf
Posts: 286
Joined: Thu Jan 24, 2008 10:34 am

Re: Server responded PLEASE_WAIT (464)

Post by TheWolf »

14:21:57:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:14574 run:0 clone:3006 gen:39 core:0xa7 unit:0x00000032287234c95e7b868ffd9b17b7
14:21:57:WU01:FS00:Uploading 1.41MiB to 40.114.52.201
14:21:57:WU01:FS00:Connecting to 40.114.52.201:8080
14:22:07:WU01:FS00:Upload 8.84%
14:22:32:WU01:FS00:Upload 22.10%
14:22:50:WU01:FS00:Upload 30.94%
14:24:17:WU01:FS00:Upload 35.36%
14:24:17:WARNING:WU01:FS00:Exception: Failed to send results to work server: Transfer failed
14:24:17:WU01:FS00:Trying to send results to collection server
14:24:17:WU01:FS00:Uploading 1.41MiB to 52.224.109.74
14:24:17:WU01:FS00:Connecting to 52.224.109.74:8080
14:24:23:WU01:FS00:Upload 66.30%
14:24:26:WU01:FS00:Upload complete
14:24:26:WU01:FS00:Server responded WORK_ACK (400)
14:24:26:WU01:FS00:Final credit estimate, 738.00 points
14:24:26:WU01:FS00:Cleaning up
14:25:40:WU02:FS00:0xa7:Completed 2500 out of 250000 steps (1%)
14:30:27:WU02:FS00:0xa7:Completed 5000 out of 250000 steps (2%)
14:34:49:WU02:FS00:0xa7:Completed 7500 out of 250000 steps (3%)
Joe_H
Site Admin
Posts: 7856
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: Server responded PLEASE_WAIT (464)

Post by Joe_H »

TheWolf wrote:You would think these servers were all or mostly on the same network, just transfer the data across the network, Admin.
Not even close, a 40... network to a 52... one. If you had bothered to look at the serve status page, they are both server instances through Azure. The connection was not failing over to the CS, that has been taken care of and your WU has uploaded now. The CS was having its own issues over the weekend.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
TheWolf
Posts: 286
Joined: Thu Jan 24, 2008 10:34 am

Re: Server responded PLEASE_WAIT (464)

Post by TheWolf »

With this research being so important the servers should be checked each day if not more than once. Knowing that most was going to be home for Easter things should hav been checked extra close the day before everyone is to leave. Thanks for fixing the problem.
Looking forward to seeing Corona Virus being added as a project,
PantherX
Site Moderator
Posts: 7020
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: Server responded PLEASE_WAIT (464)

Post by PantherX »

TheWolf wrote:You would think these servers were all or mostly on the same network, just transfer the data across the network, Admin.
Actually, the F@H Infrastructure is a bit more than a single network. It is a hybrid cloud solution where:
1) Some Servers are running in AWS
2) Some Servers are running in Azure
3) Some servers are physically running at WUSTL, Temple and MSKCC as the main institutions behind F@H
4) Some Servers (especially Work Servers) are physically located in different labs (universities and research institutes) across the globe

It is by no means a single network but a complex one that involves collaboration across multiple teams from different institutes across different countries in different time zones.
TheWolf wrote:...Looking forward to seeing Corona Virus being added as a project,
Please note that there are already several COVID-19 projects for CPU and GPUs. New ones will be coming down the pipeline if the researchers have the need for it. If you're taking about the Preference option, then that is still a while away (after the release of a new client) but the workaround has already been implemented by ensuing that the COVID-19 research has a high priority than the other projects currently.
Last edited by PantherX on Tue Apr 14, 2020 3:11 am, edited 3 times in total.
Reason: Clarified point 3 as per information below
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
Joe_H
Site Admin
Posts: 7856
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: Server responded PLEASE_WAIT (464)

Post by Joe_H »

I would just change one line:

3) Some servers are physically running at WUSTL, Temple and MSKCC as the main institutions behind F@h

As far as I know, currently there are no servers still located at Stanford since Dr Pande left and his students graduated.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
TheWolf
Posts: 286
Joined: Thu Jan 24, 2008 10:34 am

Re: Server responded PLEASE_WAIT (464)

Post by TheWolf »

Great info guys, thanks.
Post Reply