What makes a project a "big one"?

Moderators: Site Moderators, FAHC Science Team

Demmers
Posts: 28
Joined: Sat Mar 07, 2020 12:57 pm

What makes a project a "big one"?

Post by Demmers »

As a CPU folder only, I was surprised a few weeks back when I got a project that gave 50,000 base points plus, but where the atom count was only above 20,000 plus atoms (I recall being from the batch of projects 16982 - 16994, as seen here https://apps.foldingathome.org/psummary ) I was surprised at the numbers, especially as my average ppd is around 55,000. I got project 16994 yesterday, which is what reminded me to ask here.
I saw someone on this forum mentioned "how big these projects are", based on how long they take to complete compared to the majority of the others. So i'm interested in understanding why it doesn't seem to matter how many atoms there are in a given work unit compared to how long the ETA is. For example, projects 18206, 18210, 18211 and 18212 all have atoms over 300,000, but the base credit is only 2470. What is it being worked out that makes a project a big one?
Joe_H
Site Admin
Posts: 7856
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: What makes a project a "big one"?

Post by Joe_H »

There are several things that can make a project "big". The most common ones are the number of atoms involved in the simulation and the number of time steps taken by each WU. Less commonly mentioned is the file size.

The number of atoms is fairly straightforward, more atoms results in more calculations of the forces and motion between all of them. These need to be done for avery possible atom to atom interaction, but for distant pairs that can be approximated.

The number of steps varies between WUs from different projects. The lowest I recall from recent WUs has been 125,000, and the highest is 10,000,000. Each time step is 2 or 4 femtoseconds. All of the CPU projects I know of use 2 fs, some GPU projects use 2 and others use 4.

When it comes to file size there is a fairly direct relationship between the number of atoms and the download file size. More atoms require more entries in the downloaded WU to describe where and what type of atoms is located.. The upload file size though varies more due to differing data being required to be returned from the simulation runs. Some need more detailed and frequent samples from the calculated data than others.

The default "Normal" is for WUs of up to 25 MB, there is a "Small", and "Big" is over 25 MB.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
aetch
Posts: 447
Joined: Thu Jun 25, 2020 3:04 pm
Location: Between chair and keyboard

Re: What makes a project a "big one"?

Post by aetch »

50,000 is not a big CPU project, it's medium at best. There is a 205,000 CPU project live right now with more in the pipeline. https://stats.foldingathome.org/project

I suppose there's essentially two things that go into determining the size of the project - length and breadth.
Length = the length of time being simulated, usually measured in nanoseconds/picoseconds and broken down into steps. The current big projects are simulating 10 million steps. Prior to that they could be from thousands to 2.5 million steps.
Breadth = number of atoms being used to simulate the protein. More atoms mean more calculations for each step.

You can have a large protein with lots of atoms and a short simulation time be worth the same as a small protein with few atoms but a long simulation time because they're both using roughly the same number of calculations.
Folding Rigs - None (25-Jun-2022)

ImageImage
Jonazz
Posts: 357
Joined: Sun Jan 17, 2010 2:08 pm

Re: What makes a project a "big one"?

Post by Jonazz »

aetch wrote:50,000 is not a big CPU project, it's medium at best. There is a 205,000 CPU project live right now with more in the pipeline. https://stats.foldingathome.org/project
Oh it is, there are several GPU projects with fewer base points. The 200k one is simply huge.
aetch
Posts: 447
Joined: Thu Jun 25, 2020 3:04 pm
Location: Between chair and keyboard

Re: What makes a project a "big one"?

Post by aetch »

A few weeks ago I thought it was big viewtopic.php?f=72&t=37374

Not any more.
Folding Rigs - None (25-Jun-2022)

ImageImage
toTOW
Site Moderator
Posts: 6296
Joined: Sun Dec 02, 2007 10:38 am
Location: Bordeaux, France
Contact:

Re: What makes a project a "big one"?

Post by toTOW »

Base credit is not really a good indicator of the WU size ... short deadline inflates the base credit actificially ...

There are only two concept of big WUs :
- the original one is based on the number of atoms ... also, more atoms requires bigger data files to describe it, so it was the original concept of a big WU (the max-packet-size small/normal/big parameter) and was created when connections where slower and limited ... WUs are considered as big when the number of atoms is above 150-200k ...
- the other concept should be called long WUs ... these are usually simulating longer timesacles ...

The first case is usually easy to handle, since the number of atoms is what drives how a WU will behave on a given hardware (more atoms fits better on GPUs with more SPs or CPUs with more cores) ... :)

The second case is problematic, because a small WU can be long ... which won't scale well with more SPs or threads but still require a huge amount of compute power ... :(
Image

Folding@Home beta tester since 2002. Folding Forum moderator since July 2008.
Demmers
Posts: 28
Joined: Sat Mar 07, 2020 12:57 pm

Re: What makes a project a "big one"?

Post by Demmers »

Got the picture now, thanks everyone. Just found where "steps" is mentioned in the logs. Which makes me wonder, if displaying steps in the control panel would be another useful bit of information to have. In-consequential I know.
Demmers
Posts: 28
Joined: Sat Mar 07, 2020 12:57 pm

Re: What makes a project a "big one"?

Post by Demmers »

Now currently running 16990. TPF is over 15mins. Looking in the logs, I notice the steps written as

Code: Select all

17:10:15:WU01:FS00:0xa8:Steps: first=40000000 total=50000000
17:10:16:WU01:FS00:0xa8:Completed 1 out of 10000000 steps (0%)
What does the first line represent if the total amount steps to be completed is 10,000,000?
Joe_H
Site Admin
Posts: 7856
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: What makes a project a "big one"?

Post by Joe_H »

The first step of your WU is step 40,000,000 or after the 4 previous Gens of the particular Run and Clone of the project. Your system will process 10,000,000 steps, and when returned will be used to create the starting conditions for the next Gen WU in the series.

So Gen 0 of the WU will do from 0 to 10,000,000, Gen 1 is created from the returned data and does the next 10,000,000 steps. This repeats until as many Gens are done that are needed or the series reaches a stopping condition.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
debs3759
Posts: 138
Joined: Fri Oct 07, 2011 3:29 am

Re: What makes a project a "big one"?

Post by debs3759 »

How do I set my GPU to give preference to big wu? is it "client-type" "big"? I can't find it in the help areas or faqs
JimboPalmer
Posts: 2573
Joined: Mon Feb 16, 2009 4:12 am
Location: Greenwood MS USA

Re: What makes a project a "big one"?

Post by JimboPalmer »

If you set max-packet-size extra slot option to a value of big the download will be bigger, but that only very loosely corresponds to the completion time expected.
Tsar of all the Rushers
I tried to remain childlike, all I achieved was childish.
A friend to those who want no friends
psaam0001
Posts: 383
Joined: Mon May 18, 2020 2:02 am
Location: Ruckersville, Virginia, USA

Re: What makes a project a "big one"?

Post by psaam0001 »

JimboPalmer wrote:If you set max-packet-size extra slot option to a value of big the download will be bigger, but that only very loosely corresponds to the completion time expected.
Would that be set as (for example): max-packet-size, with a value = big? And also, would it be done in Extra Slot Options or Extra Core Options?

Paul
JimboPalmer
Posts: 2573
Joined: Mon Feb 16, 2009 4:12 am
Location: Greenwood MS USA

Re: What makes a project a "big one"?

Post by JimboPalmer »

name max-packet-size value big

I think it should be a slot option, the core doesn't do the upload or download.
Tsar of all the Rushers
I tried to remain childlike, all I achieved was childish.
A friend to those who want no friends
aetch
Posts: 447
Joined: Thu Jun 25, 2020 3:04 pm
Location: Between chair and keyboard

Re: What makes a project a "big one"?

Post by aetch »

I would think it would be either a slot or client option. The client handles the downloads while the core just processes what has been downloaded.

Best way is to test and report back.

I just added it to "Extra client options", I'm hoping it will affect all slots.
Folding Rigs - None (25-Jun-2022)

ImageImage
psaam0001
Posts: 383
Joined: Mon May 18, 2020 2:02 am
Location: Ruckersville, Virginia, USA

Re: What makes a project a "big one"?

Post by psaam0001 »

I'll have to give it a try on Tuesday, to get my 3950X rolling again once the new PSU is in.

Paul
Post Reply