What is happening at CERN Team?

Moderators: Site Moderators, FAHC Science Team

TPL
Posts: 104
Joined: Sun Apr 19, 2020 11:37 am

What is happening at CERN Team?

Post by TPL »

I made observation when checking my own last CPUs page. There have been constantly the same user with unsuccessful WUs.

Check for example these two:
https://apps.foldingathome.org/cpu?q=ALICE-IPNL
https://apps.foldingathome.org/cpu?q=ALICE-Legnaro

What is the point to go on like this? Huge load to servers.

I checked some of those WUs and former one has some successful WUs but latter none that I could find. Still there are over 23000 lines on that page.
NRT_AntiKytherA
Posts: 111
Joined: Sun May 10, 2020 11:50 pm

Re: What is happening at CERN Team?

Post by NRT_AntiKytherA »

Maybe the machines associated with those IDs have stability issues they are not aware of yet. Given the fact most of the world has been on lockdown in the last 3 months it is entirely possible that nobody has been able to do anything about this even if they are aware of any such issues. Lockdown is beginning to be lifted at differing rates so I wouldn't be too concerned about this.
TPL
Posts: 104
Joined: Sun Apr 19, 2020 11:37 am

Re: What is happening at CERN Team?

Post by TPL »

It seems there are many of those user accounts failing the most if not all of WUs. It can make 100's of thousands of wasted downloads all together and it seems to happen frequently, every 1-10 seconds.

Also there are a huge number of clients. Like every time new ID. I don't know why but was wondering if they know of this big failure rate. Maybe they should.

I think CERN computers are possible to manage remotely anyway, lockdown or not, but what do I know about it.
WTS
Posts: 97
Joined: Sun May 19, 2019 5:49 pm
Location: Arkansas

Re: What is happening at CERN Team?

Post by WTS »

TPL wrote:It seems there are many of those user accounts failing the most if not all of WUs. It can make 100's of thousands of wasted downloads all together and it seems to happen frequently, every 1-10 seconds.

Also there are a huge number of clients. Like every time new ID. I don't know why but was wondering if they know of this big failure rate. Maybe they should.

I think CERN computers are possible to manage remotely anyway, lockdown or not, but what do I know about it.
When the Pandemic is over, and we have both a vaccine and a treatment, it'll be interesting to see how much of our efforts meant something, and how much of our efforts were wasted. On the subject of folding in general, I hope we'll have taken some steps into the future, and I hope that many will stay with us. We'll always need more folders, even after the Pandemic.
Reality is what you stumble over when you walk around with your eyes closed.
NRT_AntiKytherA
Posts: 111
Joined: Sun May 10, 2020 11:50 pm

Re: What is happening at CERN Team?

Post by NRT_AntiKytherA »

All rather depends on whomever usually manages them being in a fit state to do so or have the means to at home. If you are that concerned try emailing CERN about it ;)
TPL
Posts: 104
Joined: Sun Apr 19, 2020 11:37 am

Re: What is happening at CERN Team?

Post by TPL »

WTS wrote:When the Pandemic is over, and we have both a vaccine and a treatment, it'll be interesting to see how much of our efforts meant something, and how much of our efforts were wasted. On the subject of folding in general, I hope we'll have taken some steps into the future, and I hope that many will stay with us. We'll always need more folders, even after the Pandemic.
I think we will never receive any thanks for a good job and we still don't know if any vaccine will be effective. But better try than not. There is no known vaccine for any corona virus atm. That is one of the most important reasons to keep going. There will be more than this one. Actually thousands. So lets fold on. I find no reason to stop when this will be over. You know, Ebola for example is still alive and kicking. Cancer is not gone anywhere nor Alzheimer. There is a lot to do and will be that way.

Anyway, this kind of WUs continuous failing right in the beginning will not be helpful at all but only waisting resources. A lot of bandwith there for nothing.

I AM a little bit worried when I find CERN is failing that much on just basic level. It should be one of the leading research bodies in nuclear research in the whole world with the pack of the best scientists.

But anyway, if this is ok to FAH-Team, it is ok to me of course. It would be a little embarrassing to notify them by me and I wouldn't like to be the one.
NRT_AntiKytherA
Posts: 111
Joined: Sun May 10, 2020 11:50 pm

Re: What is happening at CERN Team?

Post by NRT_AntiKytherA »

I don't know about anyone else here but I certainly don't fold in the hope of ever being thanked for it, the 'thanks' we will receive is not dying from the researched diseases ourselves or saving future generations from the same fate. I concur about the wasted bandwidth and hardware runtime though, it's not ideal for one normal machine let alone a rack of blades or two. They have essentially got security, building and services maintenance crews at CERN only right now.

https://home.cern/news/news/cern/gradua ... activities
PantherX
Site Moderator
Posts: 7020
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: What is happening at CERN Team?

Post by PantherX »

NRT_AntiKytherA wrote:I don't know about anyone else here but I certainly don't fold in the hope of ever being thanked for it, the 'thanks' we will receive is not dying from the researched diseases ourselves or saving future generations from the same fate...
AFAIK, the research paper does acknowledge Donors (https://www-cs.stanford.edu/people/ihaq ... gpuser.pdf):
"We foremost thank the Folding@home donors, without whom this study would not be possible."
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
Neil-B
Posts: 2027
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: What is happening at CERN Team?

Post by Neil-B »

This has been reported to a CERN contact ... It may look "bad" (and those are just a couple of "users" with issues) and definitely needs resolving but do take into account the vast number of WUs CERN are folding - check EOC top ten folders - they had 3/4 in the top ten recently so what looks bad is actually a small percentage against the good they are doing.
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070

(Green/Bold = Active)
NRT_AntiKytherA
Posts: 111
Joined: Sun May 10, 2020 11:50 pm

Re: What is happening at CERN Team?

Post by NRT_AntiKytherA »

I have seen this in research papers too and that's nice recognition but I still see the potential cures as the real reward
TPL
Posts: 104
Joined: Sun Apr 19, 2020 11:37 am

Re: What is happening at CERN Team?

Post by TPL »

NRT_AntiKytherA wrote:I have seen this in research papers too and that's nice recognition but I still see the potential cures as the real reward
Me too. As I said I'm not expecting any more. It would be nice to know how actually we have helped but not excpecting to ever know.

Please understand my concern about server heavy loading on this. What we see from last CPUs page is the last WU for every ID. We don't see any previous. Seems like many of those ALICE-coded "users" have had problems and we don't know how many times per ID in the past. In worst case this can make millions. If there are 23000 lines all failures how much it can be in total during time?

I'm happy it has been informed.

If you see something like ALICE-ZA_CHPC, Credit 8,945,842, WUs 267,522 it makes 33 points/WU avg. Can't be true and it isn't. There are not just couple of those "users".

Also these failed units are increasing points and WU count but not doing any good. So there is a reason to lift this up. I loaded one all-failed-page into LibreOffice and sum of it's points is 285k. 23k WUs.
mlassnig
Posts: 2
Joined: Fri Apr 10, 2020 8:13 am

Re: What is happening at CERN Team?

Post by mlassnig »

I've notified my colleagues at CERN who are running the F@H clients on our distributed infrastructure. It's past midnight now, so I can't guarantee that somebody will be able to do something in the next few hours though.
mlassnig
Posts: 2
Joined: Fri Apr 10, 2020 8:13 am

Re: What is happening at CERN Team?

Post by mlassnig »

Hi, my colleagues told me that it is difficult to say from their side what the actual issue is with these nodes (as they run our jobs just fine), therefore they have turned the F@H clients off on them so it should not impact you any more.
toTOW
Site Moderator
Posts: 6309
Joined: Sun Dec 02, 2007 10:38 am
Location: Bordeaux, France
Contact:

Re: What is happening at CERN Team?

Post by toTOW »

If they want to post a couple of logs here, we could help them find out what's wrong ...
Image

Folding@Home beta tester since 2002. Folding Forum moderator since July 2008.
fwyzard
Posts: 1
Joined: Sun May 31, 2020 2:51 pm

Re: What is happening at CERN Team?

Post by fwyzard »

Hi,
if anyone ever sees issues with the contributions from CMS-Experiment, please do contact me - either PM me, or email me.
I assume the admins can access my email form the forum registration and/or from the passkey registration.

.Andrea
Post Reply