FahSpy (monitoring tool)

[shdbcamping]

Does this calculate the A3's yet?

[ChelseaOilman]

Does this calculate the A3's yet?

Your answer is a couple posts back in this thread.
viewtopic.php?p=125962#p125962

[bingo-dog]

I like the UI very much and decided to try it after the update to handle bigadv, but there seems to be an issue with bonus calculations. It works for a while and then the bonus multiplier gets out of whack. For example, a system with avg time per step of 23:40 shows up as 66721 ppd and 4.3167 multiplier, when earlier in the same WU it was correctly saying around 42000 ppd.

[ElectricVehicle]

I'm trying to figure out why sometimes it calculates the bonus and other times not for the A3 units. The WU is at about 56%, Credit: 476, Bonus factor: 1.0000 . In the Parameter / Value area on the lower left for the selected folder (fah client) it shows:

Code: Select all

[quote]Configuration: [b]Q6600 SMP2[/b]
Project number: 6021 (0-140-2)
Work unit: p6021_Protein in POPC
WU size: 1.69 MB
WU result:
Credit: 476.00
Frames: 100
Core: GRO-A3
Server IP: 171.64.65.54
PPH (points per hour): 35.41
PPD (points per day): [b]850[/b]
Avg time per step: 0:08:04
Bonus factor: 1.0000
Client.cfg: bigpackets=big, type=3
Completed: 46%
[url=http://fahspy.org/][color=silver]FahSpy 2.0.1[/color][/url][/quote]


Note the Bonus factor: 1.0000

The project summary page at Stanford always shows the Kfactor as 2.10 for Project 6021:

Code: Select all

6021   171.64.65.54   p6021_Protein in POPC   77050   3.00   6.00   476.00   100   GRO-A3   Description   kasson   2.10

Yet wherever fahspy is getting the Bonus from shows 1.0000 . Even when I click the "Update WU Database" for the latest information. Then sometimes later on, it seems like fahspy starts calculating the bonus again.

It would also be cool if the two decimal digits of the Credit column could be suppressed, in all cases or as an option. I find the ".00" make the credit value harder to read at a glance, especially since I'm unaware of any WUs that have a non-integer credit value. "783.00" versus "783" For that matter, it would be nice if Stanford tweaked the psummary to suppress the ".00" on Credit.

I've also noticed the font can be hard to read at times. I'm not sure why that's so, since it looks like the font used by windows. I don't know if it's scaled from it's optimum resolution, the contrast or what, but some way to enhance the readability. Possibly an option to select the font and size, though that might mess up the layout and spacing. Anyway, whatever you think. It's a great tool anyway!

Thanks again for FahSpy!!!

[ElectricVehicle]

Hmm.. I just checked again with the WU at 77%, and now FahSpy is calculating the bonus (Credit: 2281) , note the Bonus factor: 4.8053 . Does FahSpy not calculate the bonus until the WU passes a certain completion percentage?

Code: Select all

[quote]Configuration: [b]Q6600 SMP2[/b]
Project number: 6021 (0-140-2)
Work unit: p6021_Protein in POPC
WU size: 1.69 MB
WU result:
Credit: 2287.32
Frames: 100
Core: GRO-A3
Server IP: 171.64.65.54
PPH (points per hour): 177.08
PPD (points per day): [b]4250[/b]
Avg time per step: 0:07:45
Bonus factor: 4.8053
Client.cfg: bigpackets=big, type=3
Completed: 77%
[url=http://fahspy.org/][color=silver]FahSpy 2.0.1[/color][/url][/quote]


[bruce]

Did you perhaps stop/start the WU in question?

All monitor programs must make certain assumptions based on the data they have at the time. This depends on what frame history it can see when you run the program. The bonus factor is a direct result of the instability to accurately gather enough data to know when the WU will be completed.

Notice that the first one shows PPD (points per day): 850 based on the frames that it used in the calculation and the second one shows PPD (points per day): 4250. If you continued to process at first estimated rate, you would not get a bonus. At the second estimate, you would.

[Angel999]

Bonus calculation is depended from the download time and preferred deadline. If you progress doesn’t complete before preferred time, you do not get a bonus. FahSpy highlights such work units by maroon color.

[bingo-dog]

Is this the best place to report bugs? I posted a few posts above about a bug that is 100% repeatable.

Edit: make that 66% repeatable

[ElectricVehicle]

Did you perhaps stop/start the WU in question?

All monitor programs must make certain assumptions based on the data they have at the time. This depends on what frame history it can see when you run the program. The bonus factor is a direct result of the instability to accurately gather enough data to know when the WU will be completed.

Notice that the first one shows PPD (points per day): 850 based on the frames that it used in the calculation and the second one shows PPD (points per day): 4250. If you continued to process at first estimated rate, you would not get a bonus. At the second estimate, you would.

I haven't start / stopped any of the WU's. All of the Wu's have had a continuous log file and have completed in 15 hours or less, all are eligible, and receiving bonuses from Stanford. The PPD differences are all due to the bonus not being properly recognized. In all cases the "Avg time per step" has been between about 7:30 minutes to 8:30 minutes, I know for sure never more than 10:00 minutes.

Code: Select all

Path to folder / Alias;Status;Completed (%);Issued;Predicted;Deadline;Run-Clone-Gen;Credit;PPH (points per hour);PPD (points per day);Preferred;Core;User (team);Project number
;;;;;;;;;;;;;;
;;;;;;;;;;;;;;
[EV]Solar SMP;running;45  ;4 Feb  17:11:05;4 Feb  06:33:05;10 Feb  17:11:05;6012 (0-381-14);470.00;35.20;845;7 Feb  17:11:05;GRO-A3;[EV]Solar (104636);6012;
[EV]Volt GPU1;running;21  ;4 Feb  22:27:35;4 Feb  02:30:51;7 Feb  22:27:35;10102 (141-2-4);548.00;135.43;3250;6 Feb  22:27:35;GROGPU2;[EV]Volt (104636);10102;
 

Parameter / Value pane:

Code: Select all

[quote]Configuration: [b]Q6600 SMP2[/b]
Project number: 6012 (0-381-14)
Work unit: p6012_hafp3
WU size: 1.71 MB
WU result: ~ 19.6 MB
Credit: 470.00
Frames: 100
Core: GRO-A3
Server IP: 130.237.232.140
PPH (points per hour): 35.20
PPD (points per day): [b]845[/b]
Avg time per step: 0:08:00
Bonus factor: 1.0000
Client.cfg: bigpackets=big, type=3
Completed: 45%
[url=http://fahspy.org/][color=silver]FahSpy 2.0.1[/color][/url][/quote]


Note in this case for the bonus SMP A3 WU:
Issued 4 Feb 17:11:05
Predicted 4 Feb 06:33:05

The Issued datetime is AFTER the predicted completion datetime! It appears that the time to complete the WU is being added to the hours and minutes correctly, but the overflow from the hours isn't incrementing the day from 4 Feb to 5 Feb. This unit should complete around 5 Feb 06:33:05, as I've seen on many previous units. So it's possible this mistake in the date calculation is also affecting the bonus calculation. Yup, if you notice, my first post showing no bonus was at "by ElectricVehicle » Wed Feb 03, 2010 10:34 pm" for a WU that is crossing the midnight boundary to the next day, and the bonus isn't being calculated correctly. Then the next post "by ElectricVehicle » Thu Feb 04, 2010 2:30 am" is after midnight, and the bonus calculation is correct!

So it looks like for bonus WU's that are executing across the midnight boundary from one day to the next won't have the bonus calculated correctly until the day on which they are going to complete due to the mistake in not incrementing the day when the hours overflow.

I'd noticed the issue in not incrementing the day before, but it didn't bother me and I didn't connect it to the incorrect bonus calculation until just now. Ps. thanks for enabling copy / paste of the client grid and parameter value areas of FahSpy. The copy / paste makes it MUCH easier to share or record information and to accurately report issues / bugs!

So Angel999 or Behc - is this a bug and is this the cause?

[ElectricVehicle]

I like the UI very much and decided to try it after the update to handle bigadv, but there seems to be an issue with bonus calculations. It works for a while and then the bonus multiplier gets out of whack. For example, a system with avg time per step of 23:40 shows up as 66721 ppd and 4.3167 multiplier, when earlier in the same WU it was correctly saying around 42000 ppd.

Check the bonus calculations you're seeing and see if they are related to the change of the day. I'm guessing you'll see the correct calculation on the day the WU completes, but prior to that day, the calculation will be funny.

[ElectricVehicle]

It must be the mistake in incrementing the day. The calcualtions continued to be incorrect until the first update after midnight and the bonus calculation changed to the correct values for the bonus eligible SMP A3 WU:
Credit 2169.05
PPD (points per day) 3825

Code: Select all

Path to folder / Alias;Status;Completed (%);Issued;Predicted;Deadline;Run-Clone-Gen;Credit;PPH (points per hour);PPD (points per day);Preferred;Core;User (team);Project number
;;;;;;;;;;;;;;
;;;;;;;;;;;;;;
[EV]Solar SMP;running;50  ;4 Feb  17:11:05;5 Feb  06:42:25;10 Feb  17:11:05;6012 (0-381-14);2169.05;159.36;3825;7 Feb  17:11:05;GRO-A3;[EV]Solar (104636);6012;
[EV]Volt GPU1;running;38  ;4 Feb  22:27:35;5 Feb  02:27:26;7 Feb  22:27:35;10102 (141-2-4);548.00;138.28;3319;6 Feb  22:27:35;GROGPU2;[EV]Volt (104636);10102;


Parameter/Value pane:
Bonus factor: 4.6243

Code: Select all

[quote]Configuration: [b]Q6600 SMP2[/b]
Project number: 6012 (0-381-14)
Work unit: p6012_hafp3
WU size: 1.71 MB
WU result: ~ 19.6 MB
Credit: 2173.42
Frames: 100
Core: GRO-A3
Server IP: 130.237.232.140
PPH (points per hour): 160.88
PPD (points per day): [b]3861[/b]
Avg time per step: 0:08:06
Bonus factor: 4.6243
Client.cfg: bigpackets=big, type=3
Completed: 51%
[url=http://fahspy.org/][color=silver]FahSpy 2.0.1[/color][/url][/quote]


Ps. The forum times are off by one hour (1:10am). It's currently 12:10am in California (also shown in the heading as "Stanford time: February 05, 2010 00:17:29" Time is passing as I'm updating this post...). Looks like DST didn't get turned off for the forum times now that DST is over.

[bingo-dog]

Check the bonus calculations you're seeing and see if they are related to the change of the day. I'm guessing you'll see the correct calculation on the day the WU completes, but prior to that day, the calculation will be funny.

I see similar but opposite behavior. Early on in the WU progress, the calculations are correct. Later, closer to completion, the multiplier and credit go crazy.

[ElectricVehicle]

Do you have the opportunity to observe your clients at midnight local time to see if the calculation craziness is due to the day change or if it might be caused by something else? I.e. are we chasing the same bug here or two different bugs?

[gigagiggles]

I've only recently begun using fahspy to gauge smp outputs.

On my laptop, the gpu client showed a predicted time of yesterday when it was downloaded and ran continuously today in approximately four hours.

The smp client had shown a predicted time of yesterday also. That was downloaded early this morning and is now finished.

On my desktop pc, I've just downloaded an smp tonight. FAHSpy predicts it will finish this morning, not tomorrow morning. Thus, there is only the 1.0000 bonus factor after completing 10 steps. I'll keep an eye on this one as midnight comes and goes.

[bingo-dog]

Do you have the opportunity to observe your clients at midnight local time to see if the calculation craziness is due to the day change or if it might be caused by something else? I.e. are we chasing the same bug here or two different bugs?

It was working normally this morning, and now well before midnight it's broken. PPD for one client is now estimated at 205479 (over 3x what it should be), and for the other client is about 1.5x what it should be. Neither client has not been interrupted during the duration of these particular WUs. The time per frame values are correct, issued times are correct, predicted times are correct, so there is a math error somewhere else in the calculations. Bonus factor, credit, PPH and PPD are wrong.

Sounds like a different bug.