Stats servers down

Moderators: Site Moderators, FAHC Science Team

drougnor
Posts: 147
Joined: Tue Dec 29, 2009 2:21 am

Re: Stats servers down

Post by drougnor »

The flat files that are for external download and use are frozen at the 13:31 GMT update for 03/26/2022 (9:31 am, EDT). The 'live stats' page appears to be updating.

Can we get the flat files server kicked back into gear as this is keeping anyone's automated systems from being able to update in the prescribed manner?

Thanks!

d
Joe_H
Site Admin
Posts: 7266
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp3
Location: W. MA

Re: Stats servers down

Post by Joe_H »

drougnor wrote:The flat files that are for external download and use are frozen at the 13:31 GMT update for 03/26/2022 (9:31 am, EDT). The 'live stats' page appears to be updating.

Can we get the flat files server kicked back into gear as this is keeping anyone's automated systems from being able to update in the prescribed manner?

Thanks!

d
I have seen a notice that servers were in the process of being moved on cloud services in connection with passkeys not getting sent out until permissions were updated for emailing from the servers. The developer was asked if that server move was linked to these stats not updating, no response yet.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Lazvon
Posts: 3
Joined: Wed Jan 05, 2022 1:06 am

Re: Stats servers down

Post by Lazvon »

Thank you for keeping us informed.
Kana-chan
Posts: 16
Joined: Wed Nov 15, 2017 9:17 am

Re: Stats servers down

Post by Kana-chan »

Hello,

I would like to know where we can post about the new API.
I would try to use it to retrieve all donors from my team, but only the 1000 first are in the list.

And/or about the flat files, is it possible to add the new user id in the team flat file?

Thanks in advance.
------------------
Regards, Kana-chan.
ImageImage
aetch
Posts: 410
Joined: Thu Jun 25, 2020 3:04 pm
Location: Between chair and keyboard

Re: Stats servers down

Post by aetch »

The flat files are periodic snapshots of the stats, when a new user/donor submits a work unit they are automatically added to the flat files when the next snapshot is taken.
The flat files for the teams contains - Team ID, TeamName, Point accrued (Score), Work unit returned (wu). This currently ~125,000 entries in size.
The flat files for the Donors contains - Donor's name (name), point accrued (score), work units returned (wu), team ID. This is currently ~2,600,000 entries in size.
AMD Ryzen 9 3900X, 16GB, RTX 2070 Super, Win 10 Pro, F@H 7.6.21
Intel i5-7600K, 16GB, GTX 1080 Ti, Win 10 Pro, F@H 7.6.21 (on summer holiday)

ImageImage

How to post logs and other useful info
fz4z
Posts: 22
Joined: Fri Jul 16, 2021 10:22 am

Re: Stats servers down

Post by fz4z »

Joe_H wrote: I have seen a notice that servers were in the process of being moved on cloud services in connection with passkeys not getting sent out until permissions were updated for emailing from the servers.
Is this related to the Bowman lab's move to University of Pennsylvania this summer ?
( Move the servers in WUSTL on cloud at first. ) :roll:
Last edited by fz4z on Thu Mar 31, 2022 5:24 am, edited 1 time in total.
Joe_H
Site Admin
Posts: 7266
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp3
Location: W. MA

Re: Stats servers down

Post by Joe_H »

fz4z wrote:Is this related to the Bowman lab's move to University of Pennsylvania this summer ?
As far as I know it is not related. The servers from what I can tell are ones already on cloud servers
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
drougnor
Posts: 147
Joined: Tue Dec 29, 2009 2:21 am

Re: Stats servers down

Post by drougnor »

Just FYI for anyone else who tracks the flat files - We appear to be to every other hour updates now instead of hourly. However, all the data is still there, just not as frequent.

Personally, I'd prefer going back to hourly, but it does all boil down to what the project can support for attention and for processing cycles.

d
goodyca
Posts: 186
Joined: Sun Dec 02, 2007 12:36 pm

Re: Stats servers down

Post by goodyca »

What URL are you using to download the flat files? The URL at fah-web.stanford.edu is no longer found.
Joe_H
Site Admin
Posts: 7266
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp3
Location: W. MA

Re: Stats servers down

Post by Joe_H »

goodyca wrote: Sat Apr 09, 2022 5:57 pm What URL are you using to download the flat files? The URL at fah-web.stanford.edu is no longer found.
The stanford.edu addresses have been dead for years, some had redirects to the current site. Those may have finally been removed in part or completely. Download links for the flat files can be found on the official stats front page - https://foldingathome.org/statistics/.

At one point they were updating the flat files hourly, but ran into load issues on the stats database. Initially they reduced it to every 4 hours, then after a request from the person maintaining the EOC stats increased it to every 3 hours.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
goodyca
Posts: 186
Joined: Sun Dec 02, 2007 12:36 pm

Re: Stats servers down

Post by goodyca »

Thank you for the information. I had been using the old URL until it stopped working on March 27th.
Post Reply