New psummary.html column: Kfactor

Moderators: Site Moderators, PandeGroup

New psummary.html column: Kfactor

Postby smoking2000 » Wed Nov 18, 2009 8:44 pm

Since two hours ago, the psummary pages contain a new column "Kfactor" (although the table header is not all pages).

What is the meaning of the values in this column? And will this column remain in the psummary pages, or was this just a test or hickup?

I would like to know this, as would all other 3rd party devs (I presume) who have to update their psummary parsers :)
User avatar
smoking2000
 
Posts: 572
Joined: Mon Dec 03, 2007 6:20 am
Location: Amsterdam

Re: New psummary.html column: Kfactor

Postby ChasR » Wed Nov 18, 2009 8:49 pm

Could it be to calculate the -bigadv WUs? They have a k factor.
Image
User avatar
ChasR
 
Posts: 815
Joined: Sun Dec 02, 2007 5:36 am
Location: Atlanta, GA

Re: New psummary.html column: Kfactor

Postby smoking2000 » Wed Nov 18, 2009 8:54 pm

Heh, just after this post I read the following on the FAH blog:
We will be adding one new field to the psummary web pages (eg, http://fah-web.stanford.edu/psummary.html) to include a new part of FAH stats. We will give more info soon, but for now, please note the additional column on the far right.

For third party tools which parse these web pages, we have added the column at the far right in the hopes that this would not break current tools' parsing routines. Note that we are also looking in developing more systematic ways to interact with third party utilities, although that is still in the works. For now, we will give heads up to changes here in this blog.
User avatar
smoking2000
 
Posts: 572
Joined: Mon Dec 03, 2007 6:20 am
Location: Amsterdam

Re: New psummary.html column: Kfactor

Postby smoking2000 » Wed Nov 18, 2009 9:31 pm

Since the psummary is being updated, would this be the right time for some improvement requests?

- Move the <META> tags to the <head>, and not before the <html> as it is now, to make the code W3C valid.
- Don't use two different content formats for the Kfactor column (one uses: <font size=-1>1</font>, the other uses only: 3.30)
User avatar
smoking2000
 
Posts: 572
Joined: Mon Dec 03, 2007 6:20 am
Location: Amsterdam

Re: New psummary.html column: Kfactor

Postby VijayPande » Thu Nov 19, 2009 1:53 am

We'll add more info on Kfactor pretty soon -- we wanted to get out ahead of things with the infrastructure though. Good point regarding the cleanup -- I'll pass that request along.
Prof. Vijay Pande, PhD
Departments of Chemistry, Structural Biology, and Computer Science
Chair, Biophysics
Director, Folding@home Distributed Computing Project
Stanford University
User avatar
VijayPande
Pande Group Member
 
Posts: 2728
Joined: Fri Nov 30, 2007 6:25 am
Location: Stanford

Re: New psummary.html column: Kfactor

Postby smoking2000 » Thu Nov 19, 2009 5:48 am

Thanks
User avatar
smoking2000
 
Posts: 572
Joined: Mon Dec 03, 2007 6:20 am
Location: Amsterdam

Re: New psummary.html column: Kfactor

Postby toTOW » Thu Nov 19, 2009 10:48 am

Since not all projects use this factor (yet ?), I guess it would be better to choose an escape character (like "-" or "NA") on projects that doesn't use the "BigAdv" formula instead of 1 (imho, no bonus scheme is different from bonus scheme with k=1) ... I guess it would help 3rd party developers generalize their code to all projects
Folding@Home beta tester since 2002. Folding Forum moderator since July 2008.

FAH-Addict : latest news, tests and reviews about Folding@Home project.

Image
User avatar
toTOW
Site Moderator
 
Posts: 7999
Joined: Sun Dec 02, 2007 10:38 am
Location: Bordeaux, France

Re: New psummary.html column: Kfactor

Postby smoking2000 » Thu Nov 19, 2009 10:56 am

toTOW wrote:Since not all projects use this factor (yet ?), I guess it would be better to choose an escape character (like "-" or "NA") on projects that doesn't use the "BigAdv" formula instead of 1 (imho, no bonus scheme is different from bonus scheme with k=1) ... I guess it would help 3rd party developers generalize their code to all projects


Please don't. A factor of 1 is a valid factor too. Also the value in column is now either an integer (\d+) or floating point (\d+\.\d+), this is easy to parse with regular expressions. Not so if you mix in characters for string like "NA" or "-".

The current values can be used in code like: $some_number * $kfactor. Or to compare kfactors ($project_x_kfractor > $project_y_kfactor), this isn't possible when strings are also used in the kfactor column.
User avatar
smoking2000
 
Posts: 572
Joined: Mon Dec 03, 2007 6:20 am
Location: Amsterdam

Re: New psummary.html column: Kfactor

Postby toTOW » Thu Nov 19, 2009 11:02 am

I guess you didn't get my point : if some projects are not using the bonus scheme (and I guess only BigAdv projects actually use it), it's not the same as projects using the bonus scheme with k = 1 ... so you can't set the Kfactor column to 1 by default as it is currently done ...
User avatar
toTOW
Site Moderator
 
Posts: 7999
Joined: Sun Dec 02, 2007 10:38 am
Location: Bordeaux, France

Re: New psummary.html column: Kfactor

Postby P5-133XL » Thu Nov 19, 2009 12:06 pm

I agree that a parseable number is a much better alternative to fill the column than some invalid characters like "NA" which would require some form of exception treatment. While a k=factor of 1 still produces a bonus using the bigadv equations, the k-factor of 0 won't so that is probably a safe default for non bonus WU's.

Really, the programmers are very likely to already understand these types of concepts and I trust them to do what is necessary and best for the project. I would contend that this level of programming detail does not need to be discussed here, until or unless they mess up.
Image
P5-133XL
Site Moderator
 
Posts: 3993
Joined: Sun Dec 02, 2007 4:36 am
Location: Salem. OR USA

Re: New psummary.html column: Kfactor

Postby VijayPande » Thu Nov 19, 2009 3:28 pm

I'll pass the default value issue along as well. This is easy to change in the psummary code, so this is more of an issue of what makes the most sense.
User avatar
VijayPande
Pande Group Member
 
Posts: 2728
Joined: Fri Nov 30, 2007 6:25 am
Location: Stanford

Re: New psummary.html column: Kfactor

Postby harlam357 » Fri Nov 20, 2009 6:53 am

Thank you for adding it to the right. That definitely saved my code, as it's pretty "dumb" in regards to the psummary parsing. Other than being rather inflexible, it's worked great so I haven't messed with it much. This change gives me a reason to overhaul and make it smarter. :)

Based on these formulas:

Code: Select all
Total points = base points * bonus factor

The bonus factor is computed based on the time from when our server issues the work unit to when it receives the work unit (WU_time), the time from work issuance to when the deadline would expire (deadline_time), the time from issuance to when the work unit times out and is marked for reissuance (timeout_time), and a constant factor k.
If WU_time > timeout time, bonus factor = 1.
If WU_time <= timeout time, bonus factor = sqrt(deadline_time * k / WU_time)
.

I feel that if a Project does not qualify for a bonus, then a k value of 0 should be assigned... since, as someone else mentioned, a k value of 1 would be valid for Bonus Projects.

The addition of this k value also give us (I think) everything we need to correctly calculate bonus PPD! :)

A few other questions (since I want to try and be as accurate as possible with the calculation):

- Is there anywhere we can find the timeout_time? Is this the final deadline? I'm under the impression that the current bigadv trial projects are 3 days (neither the preferred or final deadline), but I imagine this value will vary with new projects later on. It will be essential to know this value to determine when to set the bonus factor back to 1 and effectively remove all bonus PPD from the calculation.

- To follow on that, is the deadline_time preferred or final deadline... I assume the former.

If there's anywhere I can find an example calculation using available information, that would be most helpful.
User avatar
harlam357
 
Posts: 219
Joined: Fri Jun 27, 2008 11:03 pm
Location: Alabama - USA

Re: New psummary.html column: Kfactor

Postby ChasR » Fri Nov 20, 2009 11:07 am

timeout_time = preferred deadline
deadtime_time = final deadline

YHM
User avatar
ChasR
 
Posts: 815
Joined: Sun Dec 02, 2007 5:36 am
Location: Atlanta, GA


Return to Discussions of General-FAH topics

Who is online

Users browsing this forum: No registered users and 2 guests