Finished Work Units not Sending to/from 155.247.166.*

[swingarm]

Found that my finished work units(3 of them) are not sending. Running 7.5.1. I am going through ExpressVPN service. I am running Norton Security Suite. I am running Windows 10 64bit 1903. Here is a snippet of the log:

23:48:50:WU05:FS01:0x21:Completed 860000 out of 1000000 steps (86%)
23:48:50:WU05:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
23:49:35:WU03:FS00:0xa7:Completed 862500 out of 1250000 steps (69%)
23:50:00:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:14188 run:0 clone:773 gen:9 core:0xa7 unit:0x0000000d0002894b5d77e6f75e347b1a
23:50:00:WU01:FS00:Uploading 56.67MiB to 155.247.166.219
23:50:00:WU01:FS00:Connecting to 155.247.166.219:8080
23:50:00:WARNING:WU01:FS00:Exception: Failed to send results to work server: Transfer failed
23:50:00:WU01:FS00:Trying to send results to collection server
23:50:00:WU01:FS00:Uploading 56.67MiB to 155.247.166.220
23:50:00:WU01:FS00:Connecting to 155.247.166.220:8080
23:50:00:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:14189 run:6 clone:466 gen:11 core:0xa7 unit:0x0000000b0002894b5d77e24774ef9ef8
23:50:00:WU02:FS00:Uploading 130.62MiB to 155.247.166.219
23:50:00:WU02:FS00:Connecting to 155.247.166.219:8080
23:50:00:ERROR:WU01:FS00:Exception: Transfer failed
23:50:00:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:13794 run:14 clone:10 gen:20 core:0xa7 unit:0x000000210002894c5d5d9429ac7f12fc
23:50:00:WU00:FS00:Uploading 58.74MiB to 155.247.166.220
23:50:00:WU00:FS00:Connecting to 155.247.166.220:8080
23:50:00:WARNING:WU02:FS00:Exception: Failed to send results to work server: Transfer failed
23:50:00:WU02:FS00:Trying to send results to collection server
23:50:00:WU02:FS00:Uploading 130.62MiB to 155.247.166.220
23:50:00:WU02:FS00:Connecting to 155.247.166.220:8080
23:50:00:WARNING:WU00:FS00:Exception: Failed to send results to work server: Transfer failed
23:50:00:WU00:FS00:Trying to send results to collection server
23:50:00:WU00:FS00:Uploading 58.74MiB to 155.247.166.219
23:50:00:WU00:FS00:Connecting to 155.247.166.219:8080
23:50:00:ERROR:WU02:FS00:Exception: Transfer failed
23:50:01:ERROR:WU00:FS00:Exception: Transfer failed


There is an exception in my Norton Security for this program and I shut off the ExpressVPN service and it still doesn't send. I quit this program and restarted it but it still doesn't send.

[toTOW]

This is the same server/issue as in this thread : viewtopic.php?f=18&t=31876

Since you mentioned a VPN service, did you try to change the exit location of the VPN ? Did you try to disable Norton ?

[swingarm]

Yes, I changed locations on the VPN and even disconnected it. Yes, I disabled Norton.

I did an internet search on this problem before I posted and that thread didn't come up, strange. I didn't know work units could expire, now I know.

Will switching VPN locations mess with the sending completed work units on FAHClient?

[bruce]

Will switching VPN locations mess with the sending completed work units on FAHClient?

Not really.

Something strange may happen to the one or two WUs that happen to be transferring at the movement you make the change. A) The active Up/Download may abort and restart later. or- B) the active WU may actually complete normally. WUs which have not started transferring will still be queued.

[swingarm]

I uninstalled FAHClient(including the data) and reinstalled, we'll see if it happens again.

[bruce]

I uninstalled FAHClient(including the data) and reinstalled, we'll see if it happens again.

Uninstall/reinstall won't hurt, but it probably isn/t necessary. The initial problem is on two FAH's servers 155.247.166.* which has nothing to do with your installation. This seems to be happening about every third day until somebody intervenes.

This is exacerbated by a known client bug which can be "cured" by restarting FAHClient. The nature of the unknown communications error probably varies and it's impossible to know if redirecting your VPN will produce one.

[swingarm]

Hmm, still doing it.

20:17:55:WU00:FS00:Trying to send results to collection server
20:17:55:WU00:FS00:Uploading 150.37MiB to 128.252.203.4
20:17:55:WU00:FS00:Connecting to 128.252.203.4:8080
20:17:55:ERROR:WU00:FS00:Exception: Transfer failed
23:36:55:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:14190 run:31 clone:153 gen:8 core:0xa7 unit:0x0000000c0002894b5d5d2c5fb6783f29
23:36:55:WU00:FS00:Uploading 150.37MiB to 155.247.166.219
23:36:55:WU00:FS00:Connecting to 155.247.166.219:8080
23:36:55:WARNING:WU00:FS00:Exception: Failed to send results to work server: Transfer failed

[bruce]

When the WU fails to upload, is it redirected to a series of Collection Servers?

Please expand the segment of the log so show the full series of attempts. Which WS was tried first? Which CS was tried next? (was it 128.252.203.4?) Was 155.247.166.219 the second CS tried? After the last failure shown, was another CS tried?

How many failed connections have you seen since FAHClient was restarted?

[swingarm]

15:42:52:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:14190 run:31 clone:153 gen:8 core:0xa7 unit:0x0000000c0002894b5d5d2c5fb6783f29
15:42:52:WU00:FS00:Uploading 150.37MiB to 155.247.166.219
15:42:52:WU00:FS00:Connecting to 155.247.166.219:8080
15:42:53:WARNING:WU00:FS00:Exception: Failed to send results to work server: Transfer failed
15:42:53:WU00:FS00:Trying to send results to collection server
15:42:53:WU00:FS00:Uploading 150.37MiB to 128.252.203.4
15:42:53:WU00:FS00:Connecting to 128.252.203.4:8080
15:42:53:ERROR:WU00:FS00:Exception: Transfer failed
16:11:55:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:14190 run:31 clone:153 gen:8 core:0xa7 unit:0x0000000c0002894b5d5d2c5fb6783f29
16:11:55:WU00:FS00:Uploading 150.37MiB to 155.247.166.219
16:11:55:WU00:FS00:Connecting to 155.247.166.219:8080
16:11:55:WARNING:WU00:FS00:Exception: Failed to send results to work server: Transfer failed
16:11:55:WU00:FS00:Trying to send results to collection server
16:11:55:WU00:FS00:Uploading 150.37MiB to 128.252.203.4
16:11:55:WU00:FS00:Connecting to 128.252.203.4:8080
16:11:55:ERROR:WU00:FS00:Exception: Transfer failed
16:58:54:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:14190 run:31 clone:153 gen:8 core:0xa7 unit:0x0000000c0002894b5d5d2c5fb6783f29
16:58:54:WU00:FS00:Uploading 150.37MiB to 155.247.166.219
16:58:54:WU00:FS00:Connecting to 155.247.166.219:8080
16:58:54:WARNING:WU00:FS00:Exception: Failed to send results to work server: Transfer failed
16:58:54:WU00:FS00:Trying to send results to collection server
16:58:54:WU00:FS00:Uploading 150.37MiB to 128.252.203.4
16:58:54:WU00:FS00:Connecting to 128.252.203.4:8080
16:58:54:ERROR:WU00:FS00:Exception: Transfer failed
18:14:55:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:14190 run:31 clone:153 gen:8 core:0xa7 unit:0x0000000c0002894b5d5d2c5fb6783f29
18:14:55:WU00:FS00:Uploading 150.37MiB to 155.247.166.219
18:14:55:WU00:FS00:Connecting to 155.247.166.219:8080
18:14:55:WARNING:WU00:FS00:Exception: Failed to send results to work server: Transfer failed
18:14:55:WU00:FS00:Trying to send results to collection server
18:14:55:WU00:FS00:Uploading 150.37MiB to 128.252.203.4
18:14:55:WU00:FS00:Connecting to 128.252.203.4:8080
18:14:55:ERROR:WU00:FS00:Exception: Transfer failed
******************************* Date: 2019-10-24 *******************************
20:17:54:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:14190 run:31 clone:153 gen:8 core:0xa7 unit:0x0000000c0002894b5d5d2c5fb6783f29
20:17:54:WU00:FS00:Uploading 150.37MiB to 155.247.166.219
20:17:54:WU00:FS00:Connecting to 155.247.166.219:8080
20:17:55:WARNING:WU00:FS00:Exception: Failed to send results to work server: Transfer failed
20:17:55:WU00:FS00:Trying to send results to collection server
20:17:55:WU00:FS00:Uploading 150.37MiB to 128.252.203.4
20:17:55:WU00:FS00:Connecting to 128.252.203.4:8080
20:17:55:ERROR:WU00:FS00:Exception: Transfer failed
23:36:55:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:14190 run:31 clone:153 gen:8 core:0xa7 unit:0x0000000c0002894b5d5d2c5fb6783f29
23:36:55:WU00:FS00:Uploading 150.37MiB to 155.247.166.219
23:36:55:WU00:FS00:Connecting to 155.247.166.219:8080
23:36:55:WARNING:WU00:FS00:Exception: Failed to send results to work server: Transfer failed
23:36:55:WU00:FS00:Trying to send results to collection server
23:36:55:WU00:FS00:Uploading 150.37MiB to 128.252.203.4
23:36:55:WU00:FS00:Connecting to 128.252.203.4:8080
23:36:55:ERROR:WU00:FS00:Exception: Transfer failed

[bruce]

Thank you. That's what I was looking for.

I think I have figured out the problem you're reporting -- although it has nothing to do with what I just asked.

The current version of FAHCore_a7 for Windows has a bug and a corrected version is currently being beta tested. The symptoms of the problem are that extra data is added to the upload packet whenever the the WU is paused. If the WU has been paused many times, the results bet to be aabnormally large.

You are attempting to upload a package of over 150 MiB. A normal upload for that project should be a rather small fraction of that size. Please look back in your logs and estimate how many times that WU was paused since it was downloaded. (You may or may not be using the on "Idle" setting.)

I'm assuming a couple of things which may or may not be facts: 1) You're running Windows. 2) The WU was, in fact, paused multiple times.

The extra data generated by this bug is contributing to a congestion problem on several FAH server -- and it's imperative that we get the new FAHCore_a7 into production. It's not clear what will happen to these oversized results but most likely they will never be accepted. WUs like project:14190 run:31 clone:153 gen:8 will eventually be reissued and completed using the new version of FAHCore_a7.

If all of this turns out to be true, you might as well discard the results residing on your computer in WU00.

[swingarm]

Ah ok, thanks for telling me what the problem is. You were right about 1) and 2), I only do folding at night on idle.