[SOLVED] 3.21.157.11 assigned/connects/no download/hangs

Moderators: Site Moderators, FAHC Science Team

Neil-B
Posts: 2027
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: [SOLUTION] 3.21.157.11 assigned/connects/no download/han

Post by Neil-B »

The alarm clock approach is working … Caught another one :) … This time a single close connection was enough to get me an assignment to another server :)
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070

(Green/Bold = Active)
Neil-B
Posts: 2027
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: [SOLUTION] 3.21.157.11 assigned/connects/no download/han

Post by Neil-B »

… and another one … most times now it seems that the first try by the AS sends me to 3.21.157.11 … Probably I guess as it sees this server has a very low assign rate and therefore should have capacity … luckily I got a different WS after only one connection closing cycle.
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070

(Green/Bold = Active)
Neil-B
Posts: 2027
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: [WORKAROUND] 3.21.157.11 assigned/connects/no download/h

Post by Neil-B »

… and another one … looks like I might have a broken nights sleep trying to keep the slots running !! … This time was a close the connection, reassigned to this server, close the connection then get lucky and be assigned somewhere else pattern.

Changed the Title to "Workaround" as tbh what I am doing doesn't feel like a long term viable solution ;)

With this server assignment rate down to 12.00 an hour I don't reckon it is just one or two folders having this issue … Might be time for some server tlc - a cricket bat might do the trick :)

Even as I typed that the assignment rate leapt up … to 36.00 an hour - I must have scared it :lol:
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070

(Green/Bold = Active)
Joe_H
Site Admin
Posts: 7867
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: [WORKAROUND] 3.21.157.11 assigned/connects/no download/h

Post by Joe_H »

I posted a message for the work server admins about this, not sure if any projects are active on this WA, none showed for me when I just checked the Project Summary page.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Neil-B
Posts: 2027
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: [WORKAROUND] 3.21.157.11 assigned/connects/no download/h

Post by Neil-B »

The beta series 14801, 14802, 14702 are showing https://apps.foldingathome.org/psummary?visibility=BETA ... and there are a few more projects in that series which I guess are coming from that server ... https://apps.foldingathome.org/psummary?visibility=ALL shows there may be more and the beta forum announcement also.

I have posted here as it is a Server Issue (imho) not a Beta Project one - but it is I believe having probably a significant impact on those projects if they are still trying to run them.
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070

(Green/Bold = Active)
Neil-B
Posts: 2027
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: [WORKAROUND] 3.21.157.11 assigned/connects/no download/h

Post by Neil-B »

… and another - this time the ASs assigned me to this server seven (yup that many) times before finally got a different WS.

Well, with over 24hrs nursemaiding FAH I think I really now need to get some sleep … I have one slot due to finish in an hour the other in just over 3 hours … at current rates I reckon the chances of either slot actually actively folding something when I get up in 5hrs is close to zero which is a bit of a shame.

I think I have generated enough evidence today to show this is a repeatable and consistent issue.
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070

(Green/Bold = Active)
Neil-B
Posts: 2027
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: [WORKAROUND] 3.21.157.11 assigned/connects/no download/h

Post by Neil-B »

... and I was correct ... both slot "ready" and waiting for me this morning (one had been patiently waiting on the Established connection for 2 1/2 hrs the other just 1/2 hr so could have been worse) ... closed both Established Connections (but inactive) to 3.21.157.11 and both slots assigned to other WSs first time, getting WUs and immediately recommencing folding ... server stats still show this server having negligible connections per hour - from what I am witnessing all it is likely to be doing is stalling folders clients?

Hopefully someone will get a chance today to either sort the server out (if there is an issue as the behaviour I am witnessing is suggesting) or identify if it is some issue with my kit that is causing this (which although the evidence might stack up against this is I concede still a possibility).

I'll edit this post in a bit to confirm how long the slots were stalled for - all I did was kick the connections and get the slots working - but for now grabbing 30mins more shuteye until next WU is due to complete (and the next Connection fail is likely to need sorting).
Last edited by Neil-B on Wed May 13, 2020 9:46 am, edited 1 time in total.
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070

(Green/Bold = Active)
PantherX
Site Moderator
Posts: 7020
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: [WORKAROUND] 3.21.157.11 assigned/connects/no download/h

Post by PantherX »

FYI, I have informed the researcher so let's see what happens :)
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
HaloJones
Posts: 920
Joined: Thu Jul 24, 2008 10:16 am

Re: [WORKAROUND] 3.21.157.11 assigned/connects/no download/h

Post by HaloJones »

what's a Linux equivalent to TCPView?
single 1070

Image
Neil-B
Posts: 2027
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: [WORKAROUND] 3.21.157.11 assigned/connects/no download/h

Post by Neil-B »

Not sure how similar, but https://github.com/chipmunk-sm/tcpview may be a port?

I guess using netstat and killing the right process might be the same thing - Every time I ask colleagues for a "similar" tool on Linux to a gui one I use in windows they seem to go straight to command line type a couple of strings and do the same thing - they don't appreciate I need an idiot level gui based interface to process information :)

The important bit for me with the windows TCPView is that I can see this server has an Established Connection as a row, I can right click on the row and select close connection - and that is simple enough that I can't (easily) mess it up !!
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070

(Green/Bold = Active)
Neil-B
Posts: 2027
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: [WORKAROUND] 3.21.157.11 assigned/connects/no download/h

Post by Neil-B »

… and just in case anyone was wondering … still happening - luckily the ASs seem to have more options at the moment so getting other WS assignments as well as this one so not always having to close the connection :)

So far over last 48 hrs or so since this issue started I have had around 30 assignments to this server every single one of which have had to be manually "closed" … I'll increase this tally at notable moments - I guess the next is likely to be 50 "failures" - may get there within the next 24 hours at this rate :shock: 8-)
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070

(Green/Bold = Active)
Kebast
Posts: 386
Joined: Thu Aug 06, 2015 5:21 pm

Re: [WORKAROUND] 3.21.157.11 assigned/connects/no download/h

Post by Kebast »

I just had to remove the beta flag from my CPU. I couldn't keep up with all the failures.
Image
Ryzen 5900x 12T - RTX 4070 TI
HaloJones
Posts: 920
Joined: Thu Jul 24, 2008 10:16 am

Re: [WORKAROUND] 3.21.157.11 assigned/connects/no download/h

Post by HaloJones »

This is why I think the AS remembers people because I haven't had more than one or two of these and I have 7 GPU slots running.
single 1070

Image
Bastiaan_NL
Posts: 25
Joined: Wed May 13, 2020 4:34 am
Hardware configuration: I7 7700k, RTX 2080Ti
I3 9100F, 2x 5700XT
Location: Netherlands

Re: [WORKAROUND] 3.21.157.11 assigned/connects/no download/h

Post by Bastiaan_NL »

Kebast wrote:I just had to remove the beta flag from my CPU. I couldn't keep up with all the failures.
I did the same thing an hour ago, and it started folding in a minute.
Neil-B
Posts: 2027
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: [WORKAROUND] 3.21.157.11 assigned/connects/no download/h

Post by Neil-B »

Probably more linked with the type/size of slots and possibly OS … I run large(ish) CPU slots on Windows … The projects I am aware of on this server are Beta CPU projects … Kebast, Bastiaan_NL, HaloJones, what types of slots do you run?

Removal of the beta flag overnight for me might have to be done - two nights with minimal sleep periods and I am a tad shattered tbh

Sorry just read previous posts a bit better … HaloJones - your GPU slots are unlikely to be assigned to this server at the moment as I believe the projects on there are CPU ones so you may not have seen this much (only off CPU slots if you run them) … Kebast - I guess it is you CPU slot that gets these given you have removed the beta flag off that slot …
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070

(Green/Bold = Active)
Post Reply