#682 folding-2.pdc.kth.se: Noticeable V7 slowdown

Moderators: Site Moderators, FAHC Science Team

k1wi
Posts: 910
Joined: Tue Sep 22, 2009 10:48 pm

Re: folding-2.pdc.kth.se

Post by k1wi »

I think the issue is that grandpa has folded a LOT of -bigadv work units both v7 and v6. v6 to stanford or sweden has no problems, v7 to Stanford has no problems, but v7 to Sweden always has problems.

I'm testing to see whether v7 has the same issue as me, but I only have one bigadv machine and it's only an i7 @ 4.2Ghz, so my collaboration takes time. While a simultaneous upload would be nice, I don't think it proves anything that a constant repetitive outcome doesn't. The same results time after time is just as scientifically relevant, plus it removes any interaction between the two clients. The bottom line is there is something different about v7 uploading to Sweden, either because of the client uploading over such a distance, or the server somehow handling the two connections differently.. What would be most useful is if someone at Stanford could drop a message into the thread to discuss whether v7 handles uploading differently, so we can narrow down what we're dealing with better.
Image
k1wi
Posts: 910
Joined: Tue Sep 22, 2009 10:48 pm

Re: folding-2.pdc.kth.se

Post by k1wi »

Well that is mighty suspicious. I have never had an issue uploading -bigadv with v6 EVER - always maxed out my ADSL2+ connection @ ~60KB/s, to the point of being unable to skype etc because nothing gets left for it (great for getting results back fast). But with v7... well, you can see the results below. Looking at my mrtg logger, UL is stuck on ~31KB/s (max 31.9 kB/s) and takes just short of an hour to upload everything to Stanford. So compared with grandpa, different client location (New Zealand) different server location (California) similar distance, same effect.

Just to be clear, my ISP employs none of the comcast-type shaping and rarely if ever has had international traffic congestion as it owns the pipe between Stanford and myself (possibly the only benefit of a 20GB monthly cap, of which I'm still well within). I was pretty adamant to start with that it was a networking issue (sorry grandpa) but I am firmly sure it's a v7 + bigadv + distance problem now. Whether that's due to a client upload method or a server issue.

I'm happy to continue running bigadv work units on v7 to test this, but there is definitely a connection between v7 and capped -bigadv across long distances such as trans-pacific or trans-atlantic.

v6:

Code: Select all

[11:41:52] Completed 250000 out of 250000 steps (100%)
[11:42:04] DynamicWrapper: Finished Work Unit: sleep=10000
[11:42:14]
[11:42:14] Finished Work Unit:
[11:42:14] - Reading up to 52713120 from "work/wudata_06.trr": Read 52713120
[11:42:14] trr file hash check passed.
[11:42:14] - Reading up to 42834144 from "work/wudata_06.xtc": Read 42834144
[11:42:14] xtc file hash check passed.
[11:42:14] edr file hash check passed.
[11:42:14] logfile size: 201160
[11:42:14] Leaving Run
[11:42:18] - Writing 95916364 bytes of core data to disk...
[11:42:21] ... Done.
[11:42:28] - Shutting down core
[11:42:28]
[11:42:28] Folding@home Core Shutdown: FINISHED_UNIT
[11:42:40] CoreStatus = 64 (100)
[11:42:40] Unit 6 finished with 62 percent of time to deadline remaining.
[11:42:40] Updated performance fraction: 0.639498
[11:42:40] Sending work to server
[11:42:40] Project: 6900 (Run 2, Clone 3, Gen 48)


[11:42:40] + Attempting to send results [May 18 11:42:40 UTC]
[11:42:40] - Reading file work/wuresults_06.dat from core
[11:42:40] (Read 95916364 bytes from disk)
[11:42:40] Connecting to http://130.237.232.141:8080/
[12:10:13] Posted data.
[12:10:14] Initial: 0000; - Uploaded at ~56 kB/s
[12:10:17] - Averaged speed for that direction ~57 kB/s
[12:10:17] + Results successfully sent
[12:10:17] Thank you for your contribution to Folding@Home.
[12:10:17] + Number of Units Completed: 36

[12:10:24] Trying to send all finished work units
[12:10:24] + No unsent completed units remaining.
[12:10:24] + -oneunit flag given and have now finished a unit. Exiting.***** Got a SIGTERM signal (2)
[12:10:24] Killing all core threads
[12:10:24] Could not get process id information. Please kill core process manually

Folding@Home Client Shutdown.

v7:

Code: Select all

21:46:37:Unit 01:Folding@home Core Shutdown: FINISHED_UNIT
21:46:40:FahCore, running Unit 01, returned: FINISHED_UNIT (100)
21:46:40:Sending unit results: id:01 state:SEND project:2689 run:6 clone:6 gen:94 core:0xa5
21:46:40:Unit 01: Uploading 97.01MiB
21:46:40:Starting Unit 00
21:46:40:Connecting to 171.67.108.22:8080
21:46:40:Running core: B:/Users/Michael/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/Core_a3.fah/FahCore_a3.exe -dir 00 -suffix 01 -lifeline 3368 -version 701 -checkpoint 15 -np 8 -xxx
21:46:40:Started core on PID 3628
21:46:40:FahCore 0xa3 started
21:46:40:Started thread 9 on PID 3368
21:46:40:Unit 00:
21:46:40:Unit 00:*------------------------------*
21:46:40:Unit 00:Folding@Home Gromacs SMP Core
21:46:40:Unit 00:Version 2.27 (Dec. 15, 2010)
21:46:40:Unit 00:
21:46:40:Unit 00:Preparing to commence simulation
21:46:40:Unit 00:- Looking at optimizations...
21:46:40:Unit 00:- Created dyn
21:46:40:Unit 00:- Files status OK
21:46:40:Unit 00:- Expanded 1763303 -> 1944296 (decompressed 110.2 percent)
21:46:40:Unit 00:Called DecompressByteArray: compressed_data_size=1763303 data_size=1944296, decompressed_data_size=1944296 diff=0
21:46:40:Unit 00:- Digital signature verified
21:46:40:Unit 00:
21:46:40:Unit 00:Project: 6947 (Run 0, Clone 58, Gen 37)
21:46:40:Unit 00:
21:46:40:Unit 00:Assembly optimizations on if available.
21:46:40:Unit 00:Entering M.D.
21:46:46:Unit 01: 0.15%
21:46:46:Unit 00:Mapping NT from 8 to 8 
21:46:47:Unit 00:Completed 0 out of 500000 steps  (0%)
21:46:52:Unit 01: 0.33%
21:46:58:Unit 01: 0.52%
21:47:04:Unit 01: 0.70%
21:47:10:Unit 01: 0.88%
21:47:16:Unit 01: 1.05%
21:47:22:Unit 01: 1.24%
21:47:28:Unit 01: 1.42%
21:47:34:Unit 01: 1.60%
21:47:40:Unit 01: 1.78%
21:47:46:Unit 01: 1.96%
21:47:52:Unit 01: 2.14%
21:47:58:Unit 01: 2.32%
21:48:04:Unit 01: 2.50%
21:48:10:Unit 01: 2.68%
21:48:16:Unit 01: 2.86%
21:48:22:Unit 01: 3.04%
21:48:28:Unit 01: 3.22%
21:48:34:Unit 01: 3.40%
21:48:40:Unit 01: 3.58%
21:48:46:Unit 01: 3.76%
21:48:52:Unit 01: 3.94%
21:48:58:Unit 01: 4.12%
21:49:04:Unit 01: 4.30%
21:49:10:Unit 01: 4.48%
21:49:16:Unit 01: 4.66%
21:49:22:Unit 01: 4.84%
21:49:28:Unit 01: 5.03%
21:49:34:Unit 01: 5.21%
21:49:40:Unit 01: 5.38%
21:49:41:Unit 00:Completed 5000 out of 500000 steps  (1%)
21:49:46:Unit 01: 5.56%
21:49:52:Unit 01: 5.74%
21:49:58:Unit 01: 5.92%
21:50:04:Unit 01: 6.10%
21:50:10:Unit 01: 6.29%
21:50:16:Unit 01: 6.47%
21:50:22:Unit 01: 6.64%
21:50:28:Unit 01: 6.82%
21:50:34:Unit 01: 7.00%
21:50:40:Unit 01: 7.18%
21:50:46:Unit 01: 7.36%
21:50:52:Unit 01: 7.54%
21:50:58:Unit 01: 7.72%
21:51:04:Unit 01: 7.90%
21:51:10:Unit 01: 8.08%
21:51:16:Unit 01: 8.26%
21:51:22:Unit 01: 8.44%
21:51:28:Unit 01: 8.62%
21:51:34:Unit 01: 8.80%
21:51:40:Unit 01: 8.98%
21:51:46:Unit 01: 9.16%
21:51:52:Unit 01: 9.34%
21:51:58:Unit 01: 9.52%
21:52:04:Unit 01: 9.70%
21:52:10:Unit 01: 9.88%
21:52:16:Unit 01: 10.07%
21:52:22:Unit 01: 10.24%
21:52:28:Unit 01: 10.42%
21:52:34:Unit 01: 10.61%
21:52:36:Unit 00:Completed 10000 out of 500000 steps  (2%)
21:52:40:Unit 01: 10.78%
21:52:46:Unit 01: 10.97%
21:52:52:Unit 01: 11.15%
21:52:58:Unit 01: 11.33%
21:53:04:Unit 01: 11.51%
21:53:10:Unit 01: 11.69%
21:53:16:Unit 01: 11.87%
21:53:22:Unit 01: 12.05%
21:53:28:Unit 01: 12.23%
21:53:34:Unit 01: 12.41%
21:53:40:Unit 01: 12.59%
21:53:46:Unit 01: 12.77%
21:53:52:Unit 01: 12.95%
21:53:58:Unit 01: 13.13%
21:54:04:Unit 01: 13.31%
21:54:10:Unit 01: 13.49%
21:54:16:Unit 01: 13.67%
21:54:22:Unit 01: 13.85%
21:54:28:Unit 01: 14.03%
21:54:34:Unit 01: 14.21%
21:54:40:Unit 01: 14.39%
21:54:46:Unit 01: 14.57%
21:54:52:Unit 01: 14.75%
21:54:58:Unit 01: 14.93%
21:55:04:Unit 01: 15.11%
21:55:10:Unit 01: 15.29%
21:55:16:Unit 01: 15.47%
21:55:22:Unit 01: 15.65%
21:55:28:Unit 01: 15.84%
21:55:32:Unit 00:Completed 15000 out of 500000 steps  (3%)
21:55:34:Unit 01: 16.01%
21:55:40:Unit 01: 16.19%
21:55:46:Unit 01: 16.37%
21:55:52:Unit 01: 16.55%
21:55:58:Unit 01: 16.73%
21:56:04:Unit 01: 16.91%
21:56:10:Unit 01: 17.09%
21:56:16:Unit 01: 17.27%
21:56:22:Unit 01: 17.45%
21:56:28:Unit 01: 17.63%
21:56:34:Unit 01: 17.81%
21:56:40:Unit 01: 17.99%
21:56:46:Unit 01: 18.17%
21:56:52:Unit 01: 18.35%
21:56:58:Unit 01: 18.53%
21:57:04:Unit 01: 18.72%
21:57:10:Unit 01: 18.89%
21:57:16:Unit 01: 19.07%
21:57:22:Unit 01: 19.25%
21:57:28:Unit 01: 19.43%
21:57:34:Unit 01: 19.62%
21:57:40:Unit 01: 19.79%
21:57:46:Unit 01: 19.98%
21:57:52:Unit 01: 20.16%
21:57:58:Unit 01: 20.33%
21:58:04:Unit 01: 20.51%
21:58:10:Unit 01: 20.70%
21:58:16:Unit 01: 20.87%
21:58:22:Unit 01: 21.06%
21:58:28:Unit 01: 21.24%
21:58:28:Unit 00:Completed 20000 out of 500000 steps  (4%)
21:58:34:Unit 01: 21.42%
21:58:40:Unit 01: 21.60%
21:58:46:Unit 01: 21.78%
21:58:52:Unit 01: 21.96%
21:58:58:Unit 01: 22.14%
21:59:04:Unit 01: 22.32%
21:59:10:Unit 01: 22.50%
21:59:16:Unit 01: 22.68%
21:59:22:Unit 01: 22.86%
21:59:28:Unit 01: 23.04%
21:59:34:Unit 01: 23.22%
21:59:40:Unit 01: 23.40%
21:59:46:Unit 01: 23.58%
21:59:52:Unit 01: 23.76%
21:59:58:Unit 01: 23.94%
22:00:04:Unit 01: 24.13%
22:00:10:Unit 01: 24.30%
22:00:16:Unit 01: 24.49%
22:00:22:Unit 01: 24.67%
22:00:28:Unit 01: 24.85%
22:00:34:Unit 01: 25.03%
22:00:40:Unit 01: 25.21%
22:00:46:Unit 01: 25.39%
22:00:52:Unit 01: 25.57%
22:00:58:Unit 01: 25.73%
22:01:04:Unit 01: 25.91%
22:01:10:Unit 01: 26.09%
22:01:16:Unit 01: 26.27%
22:01:22:Unit 01: 26.45%
22:01:25:Unit 00:Completed 25000 out of 500000 steps  (5%)
22:01:28:Unit 01: 26.64%
22:01:34:Unit 01: 26.81%
22:01:40:Unit 01: 27.00%
22:01:46:Unit 01: 27.17%
22:01:52:Unit 01: 27.36%
22:01:58:Unit 01: 27.54%
22:02:04:Unit 01: 27.71%
22:02:10:Unit 01: 27.90%
22:02:16:Unit 01: 28.08%
22:02:22:Unit 01: 28.26%
22:02:28:Unit 01: 28.44%
22:02:34:Unit 01: 28.62%
22:02:40:Unit 01: 28.80%
22:02:46:Unit 01: 28.98%
22:02:52:Unit 01: 29.16%
22:02:58:Unit 01: 29.34%
22:03:04:Unit 01: 29.52%
22:03:10:Unit 01: 29.70%
22:03:16:Unit 01: 29.88%
22:03:22:Unit 01: 30.06%
22:03:28:Unit 01: 30.24%
22:03:34:Unit 01: 30.42%
22:03:40:Unit 01: 30.61%
22:03:46:Unit 01: 30.78%
22:03:52:Unit 01: 30.96%
22:03:58:Unit 01: 31.14%
22:04:04:Unit 01: 31.32%
22:04:10:Unit 01: 31.50%
22:04:16:Unit 01: 31.68%
22:04:20:Unit 00:Completed 30000 out of 500000 steps  (6%)
22:04:22:Unit 01: 31.87%
22:04:28:Unit 01: 32.04%
22:04:34:Unit 01: 32.22%
22:04:40:Unit 01: 32.41%
22:04:46:Unit 01: 32.59%
22:04:52:Unit 01: 32.77%
22:04:58:Unit 01: 32.94%
22:05:04:Unit 01: 33.13%
22:05:10:Unit 01: 33.31%
22:05:16:Unit 01: 33.49%
22:05:22:Unit 01: 33.67%
22:05:28:Unit 01: 33.85%
22:05:34:Unit 01: 34.03%
22:05:40:Unit 01: 34.21%
22:05:46:Unit 01: 34.39%
22:05:52:Unit 01: 34.57%
22:05:58:Unit 01: 34.75%
22:06:04:Unit 01: 34.93%
22:06:10:Unit 01: 35.11%
22:06:16:Unit 01: 35.29%
22:06:22:Unit 01: 35.47%
22:06:28:Unit 01: 35.65%
22:06:34:Unit 01: 35.84%
22:06:40:Unit 01: 36.01%
22:06:46:Unit 01: 36.19%
22:06:52:Unit 01: 36.38%
22:06:58:Unit 01: 36.56%
22:07:04:Unit 01: 36.73%
22:07:10:Unit 01: 36.91%
22:07:16:Unit 01: 37.10%
22:07:16:Unit 00:Completed 35000 out of 500000 steps  (7%)
22:07:22:Unit 01: 37.28%
22:07:28:Unit 01: 37.45%
22:07:34:Unit 01: 37.64%
22:07:40:Unit 01: 37.82%
22:07:46:Unit 01: 37.99%
22:07:52:Unit 01: 38.18%
22:07:58:Unit 01: 38.36%
22:08:04:Unit 01: 38.54%
22:08:10:Unit 01: 38.72%
22:08:16:Unit 01: 38.90%
22:08:22:Unit 01: 39.08%
22:08:28:Unit 01: 39.26%
22:08:34:Unit 01: 39.44%
22:08:40:Unit 01: 39.62%
22:08:46:Unit 01: 39.80%
22:08:52:Unit 01: 39.98%
22:08:58:Unit 01: 40.16%
22:09:04:Unit 01: 40.34%
22:09:10:Unit 01: 40.52%
22:09:16:Unit 01: 40.70%
22:09:22:Unit 01: 40.88%
22:09:28:Unit 01: 41.06%
22:09:34:Unit 01: 41.24%
22:09:40:Unit 01: 41.42%
22:09:46:Unit 01: 41.60%
22:09:52:Unit 01: 41.78%
22:09:58:Unit 01: 41.96%
22:10:04:Unit 01: 42.14%
22:10:10:Unit 01: 42.33%
22:10:12:Unit 00:Completed 40000 out of 500000 steps  (8%)
22:10:16:Unit 01: 42.50%
22:10:22:Unit 01: 42.68%
22:10:28:Unit 01: 42.87%
22:10:34:Unit 01: 43.04%
22:10:40:Unit 01: 43.23%
22:10:46:Unit 01: 43.41%
22:10:52:Unit 01: 43.59%
22:10:58:Unit 01: 43.77%
22:11:04:Unit 01: 43.95%
22:11:10:Unit 01: 44.13%
22:11:16:Unit 01: 44.31%
22:11:22:Unit 01: 44.49%
22:11:28:Unit 01: 44.67%
22:11:34:Unit 01: 44.85%
22:11:40:Unit 01: 45.03%
22:11:46:Unit 01: 45.21%
22:11:52:Unit 01: 45.39%
22:11:58:Unit 01: 45.57%
22:12:04:Unit 01: 45.75%
22:12:10:Unit 01: 45.93%
22:12:16:Unit 01: 46.11%
22:12:22:Unit 01: 46.28%
22:12:28:Unit 01: 46.46%
22:12:34:Unit 01: 46.64%
22:12:40:Unit 01: 46.82%
22:12:46:Unit 01: 47.00%
22:12:52:Unit 01: 47.18%
22:12:58:Unit 01: 47.36%
22:13:04:Unit 01: 47.54%
22:13:08:Unit 00:Completed 45000 out of 500000 steps  (9%)
22:13:10:Unit 01: 47.72%
22:13:16:Unit 01: 47.90%
22:13:22:Unit 01: 48.08%
22:13:28:Unit 01: 48.26%
22:13:34:Unit 01: 48.45%
22:13:40:Unit 01: 48.62%
22:13:46:Unit 01: 48.81%
22:13:52:Unit 01: 48.99%
22:13:58:Unit 01: 49.16%
22:14:04:Unit 01: 49.34%
22:14:10:Unit 01: 49.52%
22:14:16:Unit 01: 49.70%
22:14:22:Unit 01: 49.88%
22:14:28:Unit 01: 50.07%
22:14:34:Unit 01: 50.25%
22:14:40:Unit 01: 50.42%
22:14:46:Unit 01: 50.60%
22:14:52:Unit 01: 50.79%
22:14:58:Unit 01: 50.96%
22:15:04:Unit 01: 51.15%
22:15:10:Unit 01: 51.33%
22:15:16:Unit 01: 51.51%
22:15:22:Unit 01: 51.69%
22:15:28:Unit 01: 51.87%
22:15:34:Unit 01: 52.05%
22:15:40:Unit 01: 52.23%
22:15:46:Unit 01: 52.41%
22:15:52:Unit 01: 52.59%
22:15:58:Unit 01: 52.76%
22:16:04:Unit 01: 52.95%
22:16:05:Unit 00:Completed 50000 out of 500000 steps  (10%)
22:16:10:Unit 01: 53.13%
22:16:16:Unit 01: 53.31%
22:16:22:Unit 01: 53.48%
22:16:28:Unit 01: 53.67%
22:16:34:Unit 01: 53.84%
22:16:40:Unit 01: 54.02%
22:16:46:Unit 01: 54.20%
22:16:52:Unit 01: 54.38%
22:16:58:Unit 01: 54.56%
22:17:04:Unit 01: 54.74%
22:17:10:Unit 01: 54.92%
22:17:16:Unit 01: 55.11%
22:17:22:Unit 01: 55.28%
22:17:28:Unit 01: 55.46%
22:17:34:Unit 01: 55.65%
22:17:40:Unit 01: 55.82%
22:17:46:Unit 01: 56.00%
22:17:52:Unit 01: 56.18%
22:17:58:Unit 01: 56.36%
22:18:04:Unit 01: 56.54%
22:18:10:Unit 01: 56.73%
22:18:16:Unit 01: 56.91%
22:18:22:Unit 01: 57.08%
22:18:28:Unit 01: 57.27%
22:18:34:Unit 01: 57.45%
22:18:40:Unit 01: 57.63%
22:18:46:Unit 01: 57.81%
22:18:52:Unit 01: 57.99%
22:18:58:Unit 01: 58.17%
22:19:00:Unit 00:Completed 55000 out of 500000 steps  (11%)
22:19:04:Unit 01: 58.35%
22:19:10:Unit 01: 58.53%
22:19:16:Unit 01: 58.71%
22:19:22:Unit 01: 58.89%
22:19:28:Unit 01: 59.06%
22:19:34:Unit 01: 59.24%
22:19:40:Unit 01: 59.42%
22:19:46:Unit 01: 59.60%
22:19:52:Unit 01: 59.78%
22:19:58:Unit 01: 59.96%
22:20:04:Unit 01: 60.14%
22:20:10:Unit 01: 60.32%
22:20:16:Unit 01: 60.50%
22:20:22:Unit 01: 60.68%
22:20:28:Unit 01: 60.86%
22:20:34:Unit 01: 61.05%
22:20:40:Unit 01: 61.23%
22:20:46:Unit 01: 61.41%
22:20:52:Unit 01: 61.59%
22:20:58:Unit 01: 61.77%
22:21:04:Unit 01: 61.95%
22:21:10:Unit 01: 62.13%
22:21:16:Unit 01: 62.31%
22:21:22:Unit 01: 62.49%
22:21:28:Unit 01: 62.67%
22:21:34:Unit 01: 62.85%
22:21:40:Unit 01: 63.03%
22:21:46:Unit 01: 63.21%
22:21:52:Unit 01: 63.39%
22:21:54:Unit 00:Completed 60000 out of 500000 steps  (12%)
22:21:58:Unit 01: 63.57%
22:22:04:Unit 01: 63.75%
22:22:10:Unit 01: 63.93%
22:22:16:Unit 01: 64.11%
22:22:22:Unit 01: 64.29%
22:22:28:Unit 01: 64.47%
22:22:34:Unit 01: 64.65%
22:22:40:Unit 01: 64.83%
22:22:46:Unit 01: 65.02%
22:22:52:Unit 01: 65.20%
22:22:58:Unit 01: 65.38%
22:23:04:Unit 01: 65.55%
22:23:10:Unit 01: 65.73%
22:23:16:Unit 01: 65.91%
22:23:22:Unit 01: 66.09%
22:23:28:Unit 01: 66.27%
22:23:34:Unit 01: 66.45%
22:23:40:Unit 01: 66.63%
22:23:46:Unit 01: 66.81%
22:23:52:Unit 01: 66.99%
22:23:58:Unit 01: 67.17%
22:24:04:Unit 01: 67.35%
22:24:10:Unit 01: 67.53%
22:24:16:Unit 01: 67.71%
22:24:22:Unit 01: 67.89%
22:24:28:Unit 01: 68.07%
22:24:34:Unit 01: 68.24%
22:24:40:Unit 01: 68.42%
22:24:46:Unit 01: 68.60%
22:24:49:Unit 00:Completed 65000 out of 500000 steps  (13%)
22:24:52:Unit 01: 68.78%
22:24:58:Unit 01: 68.97%
22:25:04:Unit 01: 69.14%
22:25:10:Unit 01: 69.32%
22:25:16:Unit 01: 69.51%
22:25:22:Unit 01: 69.69%
22:25:28:Unit 01: 69.87%
22:25:34:Unit 01: 70.04%
22:25:40:Unit 01: 70.23%
22:25:46:Unit 01: 70.41%
22:25:52:Unit 01: 70.58%
22:25:58:Unit 01: 70.77%
22:26:04:Unit 01: 70.95%
22:26:10:Unit 01: 71.12%
22:26:16:Unit 01: 71.31%
22:26:22:Unit 01: 71.49%
22:26:28:Unit 01: 71.66%
22:26:34:Unit 01: 71.85%
22:26:40:Unit 01: 72.03%
22:26:46:Unit 01: 72.21%
22:26:52:Unit 01: 72.38%
22:26:58:Unit 01: 72.57%
22:27:04:Unit 01: 72.75%
22:27:10:Unit 01: 72.92%
22:27:16:Unit 01: 73.11%
22:27:22:Unit 01: 73.29%
22:27:28:Unit 01: 73.47%
22:27:34:Unit 01: 73.64%
22:27:40:Unit 01: 73.83%
22:27:44:Unit 00:Completed 70000 out of 500000 steps  (14%)
22:27:46:Unit 01: 74.01%
22:27:52:Unit 01: 74.18%
22:27:58:Unit 01: 74.37%
22:28:04:Unit 01: 74.55%
22:28:10:Unit 01: 74.72%
22:28:16:Unit 01: 74.90%
22:28:22:Unit 01: 75.09%
22:28:28:Unit 01: 75.27%
22:28:34:Unit 01: 75.44%
22:28:40:Unit 01: 75.63%
22:28:46:Unit 01: 75.81%
22:28:52:Unit 01: 75.98%
22:28:58:Unit 01: 76.17%
22:29:04:Unit 01: 76.34%
22:29:10:Unit 01: 76.53%
22:29:16:Unit 01: 76.70%
22:29:22:Unit 01: 76.89%
22:29:28:Unit 01: 77.06%
22:29:34:Unit 01: 77.24%
22:29:40:Unit 01: 77.43%
22:29:46:Unit 01: 77.60%
22:29:52:Unit 01: 77.79%
22:29:58:Unit 01: 77.96%
22:30:04:Unit 01: 78.15%
22:30:10:Unit 01: 78.33%
22:30:16:Unit 01: 78.50%
22:30:22:Unit 01: 78.69%
22:30:28:Unit 01: 78.87%
22:30:34:Unit 01: 79.05%
22:30:39:Unit 00:Completed 75000 out of 500000 steps  (15%)
22:30:40:Unit 01: 79.23%
22:30:46:Unit 01: 79.41%
22:30:52:Unit 01: 79.59%
22:30:58:Unit 01: 79.77%
22:31:04:Unit 01: 79.95%
22:31:10:Unit 01: 80.13%
22:31:16:Unit 01: 80.31%
22:31:22:Unit 01: 80.49%
22:31:28:Unit 01: 80.67%
22:31:34:Unit 01: 80.84%
22:31:40:Unit 01: 81.03%
22:31:46:Unit 01: 81.21%
22:31:52:Unit 01: 81.39%
22:31:58:Unit 01: 81.57%
22:32:04:Unit 01: 81.74%
22:32:10:Unit 01: 81.93%
22:32:16:Unit 01: 82.10%
22:32:22:Unit 01: 82.29%
22:32:28:Unit 01: 82.47%
22:32:34:Unit 01: 82.64%
22:32:40:Unit 01: 82.83%
22:32:46:Unit 01: 83.01%
22:32:52:Unit 01: 83.18%
22:32:58:Unit 01: 83.37%
22:33:04:Unit 01: 83.55%
22:33:10:Unit 01: 83.73%
22:33:16:Unit 01: 83.91%
22:33:22:Unit 01: 84.09%
22:33:28:Unit 01: 84.27%
22:33:34:Unit 01: 84.45%
22:33:34:Unit 00:Completed 80000 out of 500000 steps  (16%)
22:33:40:Unit 01: 84.63%
22:33:46:Unit 01: 84.81%
22:33:52:Unit 01: 84.99%
22:33:58:Unit 01: 85.17%
22:34:04:Unit 01: 85.35%
22:34:10:Unit 01: 85.53%
22:34:16:Unit 01: 85.71%
22:34:22:Unit 01: 85.89%
22:34:28:Unit 01: 86.07%
22:34:34:Unit 01: 86.24%
22:34:40:Unit 01: 86.43%
22:34:46:Unit 01: 86.61%
22:34:52:Unit 01: 86.79%
22:34:58:Unit 01: 86.97%
22:35:04:Unit 01: 87.15%
22:35:10:Unit 01: 87.32%
22:35:16:Unit 01: 87.51%
22:35:22:Unit 01: 87.68%
22:35:28:Unit 01: 87.87%
22:35:34:Unit 01: 88.05%
22:35:40:Unit 01: 88.22%
22:35:46:Unit 01: 88.41%
22:35:52:Unit 01: 88.59%
22:35:58:Unit 01: 88.77%
22:36:04:Unit 01: 88.95%
22:36:10:Unit 01: 89.13%
22:36:16:Unit 01: 89.31%
22:36:22:Unit 01: 89.49%
22:36:28:Unit 01: 89.67%
22:36:29:Unit 00:Completed 85000 out of 500000 steps  (17%)
22:36:34:Unit 01: 89.85%
22:36:40:Unit 01: 90.03%
22:36:46:Unit 01: 90.21%
22:36:52:Unit 01: 90.39%
22:36:58:Unit 01: 90.57%
22:37:04:Unit 01: 90.75%
22:37:10:Unit 01: 90.93%
22:37:16:Unit 01: 91.11%
22:37:22:Unit 01: 91.29%
22:37:28:Unit 01: 91.47%
22:37:34:Unit 01: 91.65%
22:37:40:Unit 01: 91.83%
22:37:46:Unit 01: 92.01%
22:37:52:Unit 01: 92.19%
22:37:58:Unit 01: 92.37%
22:38:04:Unit 01: 92.55%
22:38:10:Unit 01: 92.73%
22:38:16:Unit 01: 92.91%
22:38:22:Unit 01: 93.09%
22:38:28:Unit 01: 93.27%
22:38:34:Unit 01: 93.45%
22:38:40:Unit 01: 93.63%
22:38:46:Unit 01: 93.81%
22:38:52:Unit 01: 93.99%
22:38:58:Unit 01: 94.17%
22:39:04:Unit 01: 94.35%
22:39:10:Unit 01: 94.53%
22:39:16:Unit 01: 94.71%
22:39:22:Unit 01: 94.90%
22:39:23:Unit 00:Completed 90000 out of 500000 steps  (18%)
22:39:28:Unit 01: 95.07%
22:39:34:Unit 01: 95.25%
22:39:40:Unit 01: 95.44%
22:39:46:Unit 01: 95.61%
22:39:52:Unit 01: 95.79%
22:39:58:Unit 01: 95.98%
22:40:04:Unit 01: 96.15%
22:40:10:Unit 01: 96.34%
22:40:16:Unit 01: 96.51%
22:40:22:Unit 01: 96.70%
22:40:28:Unit 01: 96.88%
22:40:34:Unit 01: 97.05%
22:40:40:Unit 01: 97.23%
22:40:46:Unit 01: 97.40%
22:40:52:Unit 01: 97.59%
22:40:58:Unit 01: 97.76%
22:41:04:Unit 01: 97.94%
22:41:10:Unit 01: 98.13%
22:41:16:Unit 01: 98.30%
22:41:22:Unit 01: 98.48%
22:41:28:Unit 01: 98.66%
22:41:34:Unit 01: 98.84%
22:41:40:Unit 01: 99.02%
22:41:46:Unit 01: 99.20%
22:41:52:Unit 01: 99.38%
22:41:58:Unit 01: 99.56%
22:42:04:Unit 01: 99.74%
22:42:10:Unit 01: 99.92%
22:42:18:Unit 00:Completed 95000 out of 500000 steps  (19%)
22:42:20:Unit 01: Upload complete
22:42:20:Server responded WORK_ACK (400)
22:42:21:Cleaning up Unit 01
bruce
Posts: 20910
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: folding-2.pdc.kth.se

Post by bruce »

My time is very limited right now. Would somebody tabulate the various reports, sorting the data by V6 vs. V7 and by Donor so we can see what patterns emerge. That should be a lot easier than my proposed tests.
Napoleon
Posts: 887
Joined: Wed May 26, 2010 2:31 pm
Hardware configuration: Atom330 (overclocked):
Windows 7 Ultimate 64bit
Intel Atom330 dualcore (4 HyperThreads)
NVidia GT430, core_15 work
2x2GB Kingston KVR1333D3N9K2/4G 1333MHz memory kit
Asus AT3IONT-I Deluxe motherboard
Location: Finland

Re: folding-2.pdc.kth.se

Post by Napoleon »

k1wi wrote:I was pretty adamant to start with that it was a networking issue (sorry grandpa) but I am firmly sure it's a v7 + bigadv + distance problem now. Whether that's due to a client upload method or a server issue.
Apologies for wandering a bit off topic, but I don't think the upload speed issue is confined to folding-2.pdc.kth.se + v7 + bigadv only. Looks like I can reproduce this quite easily with v7 when uploading from Finland to Stanford, GPU3 & classic WUs both. If you consider it worthwhile , I suppose I could babysit my rig this weekend and set up e.g simultaneous uploads with v6 GPU3 client and v7 GPU3 slot, or some other test someone might devise. You provide the numbers, I'll do the painting. :wink:

Hard to find a specific pattern, but from what I've gathered, when this supposed throttling occurs, v7 upload speed is capped at ~30kBytes / s for everyone, right?
Win7 64bit, FAH v7, OC'd
2C/4T Atom330 3x667MHz - GT430 2x832.5MHz - ION iGPU 3x466.7MHz
NaCl - Core_15 - display
k1wi
Posts: 910
Joined: Tue Sep 22, 2009 10:48 pm

Re: folding-2.pdc.kth.se

Post by k1wi »

I did have in the back of my mind your results Napoleon. I suspect the issue is most obvious for bigadv because it is spread out across a long period of time (an hour at 30kB/s). I might have done my maths wrong when calculating the upload speed of my regular SMP work unit on v7, because it was such a small work unit.

I think the best testing at this point in time would be alternately running v6 and v7 (perhaps every other day, I think swapping every single work unit would be overkill) and just keeping a running log of upload duration, size and speed. That way if we see a pattern develop, time after time, it should be fairly decisive.

I'll go ahead logging all my work units (I still have the logs).
k1wi
Posts: 910
Joined: Tue Sep 22, 2009 10:48 pm

Re: folding-2.pdc.kth.se

Post by k1wi »

For the purposes of testing this I'm going to set my i7 to run two standard SMP clients (one v6 one v7) in -smp 4 mode, non-bigadv as soon as I get a Swedish bigadv work unit for v7. It appears that the issue is across all v7 work units. I might change this further and fire up my ATI HD4770 GPU...

Obviously living in New Zealand I'm on the other side of the world from all of the servers, so if someone from the US is able to replicate my tables using bigadv to CA and Sweden (I think bigadv is the only one which will allow this?), that would be ideal. Also if anyone in Europe was able to confirm my stats to Stanford, and anyone in the US was able to confirm that it operates at full speed would be great.

I note that at this stage all my v6 work units are to Sweden and all my v7 work units are to California, but I will update this table once I have got some Sweden data for v7 and some CA data for v6.

Below is an image of my current personal table (click to enlarge), if someone wants to add to it... Note both Alpha and Delta are on the same LAN accessing the same internet connection.

Image
Grandpa_01
Posts: 1122
Joined: Wed Mar 04, 2009 7:36 am
Hardware configuration: 3 - Supermicro H8QGi-F AMD MC 6174=144 cores 2.5Ghz, 96GB G.Skill DDR3 1333Mhz Ubuntu 10.10
2 - Asus P6X58D-E i7 980X 4.4Ghz 6GB DDR3 2000 A-Data 64GB SSD Ubuntu 10.10
1 - Asus Rampage Gene III 17 970 4.3Ghz DDR3 2000 2-500GB Segate 7200.11 0-Raid Ubuntu 10.10
1 - Asus G73JH Laptop i7 740QM 1.86Ghz ATI 5870M

Re: folding-2.pdc.kth.se

Post by Grandpa_01 »

Here is my latest 6901 sent to Sweden using Linux v6 a grand total of 6 min. and 9 sec. it is pretty obvious there is something wrong with the servers in Sweden when it comes to v7 and 6900 and 6901's. What more is needed fore somebody to look into this. I have made multiple post showing the difference and it has been confirmed by kiwi. Just simple deduction will suggest there might be a problem. :eo :ewink:

Code: Select all

[08:44:12] Completed 250000 out of 250000 steps  (100%)
[08:44:19] DynamicWrapper: Finished Work Unit: sleep=10000
[08:44:29] 
[08:44:29] Finished Work Unit:
[08:44:29] - Reading up to 52713120 from "work/wudata_01.trr": Read 52713120
[08:44:29] trr file hash check passed.
[08:44:29] - Reading up to 47030988 from "work/wudata_01.xtc": Read 47030988
[08:44:29] xtc file hash check passed.
[08:44:29] edr file hash check passed.
[08:44:29] logfile size: 196622
[08:44:29] Leaving Run
[08:44:32] - Writing 100110678 bytes of core data to disk...
[08:44:33]   ... Done.
[08:44:35] - Shutting down core
[08:44:35] 
[08:44:35] Folding@home Core Shutdown: FINISHED_UNIT
[08:44:36] CoreStatus = 64 (100)
[08:44:36] Sending work to server
[08:44:36] Project: 6901 (Run 17, Clone 6, Gen 36)


[08:44:36] + Attempting to send results [May 21 08:44:36 UTC]
[08:50:45] + Results successfully sent
[08:50:45] Thank you for your contribution to Folding@Home.
[08:50:45] + Number of Units Completed: 6
And here is the latest 6901 sent with Windows v7 also sent today 5 hours latter and took 48 min.

Code: Select all

13:25:57:FahCore running Unit 01 returned: FINISHED_UNIT (100)
13:25:58:Sending unit results: id:01 state:SEND project:6901 run:21 clone:4 gen:36 core:0xa5 unit:0x0000003452be746d4d603a91868fc780
13:25:58:Unit 01: Uploading 95.55MiB
13:25:58:Starting Unit 00
13:25:58:Connecting to 130.237.232.237:8080
13:25:58:Running core: C:/Users/Barbie/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/beta/Core_a5.fah/FahCore_a5.exe -dir 00 -suffix 01 -lifeline 3200 -version 701 -checkpoint 15 -np 8
13:25:58:Started core on PID 4304
13:25:58:FahCore 0xa5 started
13:25:58:Started thread 13 on PID 3200
13:25:58:Unit 00:
13:25:58:Unit 00:*------------------------------*
13:25:58:Unit 00:Folding@Home Gromacs SMP Core
13:25:58:Unit 00:Version 2.27 (Mar 12, 2010)
13:25:58:Unit 00:
13:25:58:Unit 00:Preparing to commence simulation
13:25:58:Unit 00:- Looking at optimizations...
13:25:58:Unit 00:- Created dyn
13:25:58:Unit 00:- Files status OK
13:26:02:Unit 00:- Expanded 24862800 -> 30796293 (decompressed 123.8 percent)
13:26:02:Unit 00:Called DecompressByteArray: compressed_data_size=24862800 data_size=30796293, decompressed_data_size=30796293 diff=0
13:26:02:Unit 00:- Digital signature verified
13:26:02:Unit 00:
13:26:02:Unit 00:Project: 6900 (Run 2, Clone 4, Gen 50)
13:26:02:Unit 00:
13:26:02:Unit 00:Assembly optimizations on if available.
13:26:02:Unit 00:Entering M.D.
13:26:04:Unit 01: 0.19%
13:26:08:Unit 00:Mapping NT from 8 to 8 
13:26:10:Unit 01: 0.40%
13:26:11:Unit 00:Completed 0 out of 250000 steps  (0%)
13:26:16:Unit 01: 0.61%
13:26:22:Unit 01: 0.83%
13:26:28:Unit 01: 1.04%
13:26:34:Unit 01: 1.25%
13:26:40:Unit 01: 1.46%
13:26:46:Unit 01: 1.68%
13:26:52:Unit 01: 1.88%
13:26:58:Unit 01: 2.10%
13:27:04:Unit 01: 2.31%
13:27:10:Unit 01: 2.52%
13:27:16:Unit 01: 2.73%
13:27:22:Unit 01: 2.94%
13:27:28:Unit 01: 3.15%
13:27:34:Unit 01: 3.36%
13:27:40:Unit 01: 3.58%
13:27:46:Unit 01: 3.79%
13:27:52:Unit 01: 4.00%
13:27:58:Unit 01: 4.21%
13:28:04:Unit 01: 4.42%
13:28:10:Unit 01: 4.64%
13:28:16:Unit 01: 4.85%
13:28:22:Unit 01: 5.06%
13:28:28:Unit 01: 5.27%
13:28:34:Unit 01: 5.48%
13:28:40:Unit 01: 5.69%
13:28:46:Unit 01: 5.90%
13:28:52:Unit 01: 6.12%
13:28:58:Unit 01: 6.33%
13:29:04:Unit 01: 6.54%
13:29:10:Unit 01: 6.75%
13:29:16:Unit 01: 6.96%
13:29:22:Unit 01: 7.17%
13:29:28:Unit 01: 7.38%
13:29:34:Unit 01: 7.60%
13:29:40:Unit 01: 7.81%
13:29:46:Unit 01: 8.02%
13:29:52:Unit 01: 8.23%
13:29:58:Unit 01: 8.44%
13:30:04:Unit 01: 8.65%
13:30:10:Unit 01: 8.86%
13:30:16:Unit 01: 9.07%
13:30:22:Unit 01: 9.28%
13:30:28:Unit 01: 9.50%
13:30:34:Unit 01: 9.71%
13:30:40:Unit 01: 9.92%
13:30:46:Unit 01: 10.13%
13:30:52:Unit 01: 10.34%
13:30:58:Unit 01: 10.55%
13:31:04:Unit 01: 10.76%
13:31:10:Unit 01: 10.93%
13:31:16:Unit 01: 11.14%
13:31:22:Unit 01: 11.36%
13:31:28:Unit 01: 11.57%
13:31:34:Unit 01: 11.78%
13:31:40:Unit 01: 11.99%
13:31:46:Unit 01: 12.20%
13:31:52:Unit 01: 12.42%
13:31:58:Unit 01: 12.63%
13:32:04:Unit 01: 12.84%
13:32:10:Unit 01: 13.05%
13:32:16:Unit 01: 13.26%
13:32:22:Unit 01: 13.47%
13:32:28:Unit 01: 13.68%
13:32:34:Unit 01: 13.90%
13:32:40:Unit 01: 14.11%
13:32:46:Unit 01: 14.32%
13:32:52:Unit 01: 14.53%
13:32:58:Unit 01: 14.74%
13:33:04:Unit 01: 14.95%
13:33:10:Unit 01: 15.16%
13:33:16:Unit 01: 15.37%
13:33:22:Unit 01: 15.58%
13:33:28:Unit 01: 15.80%
13:33:34:Unit 01: 16.01%
13:33:40:Unit 01: 16.22%
13:33:46:Unit 01: 16.43%
13:33:52:Unit 01: 16.64%
13:33:58:Unit 01: 16.86%
13:34:04:Unit 01: 17.06%
13:34:10:Unit 01: 17.27%
13:34:16:Unit 01: 17.49%
13:34:22:Unit 01: 17.70%
13:34:28:Unit 01: 17.91%
13:34:34:Unit 01: 18.11%
13:34:40:Unit 01: 18.33%
13:34:46:Unit 01: 18.54%
13:34:52:Unit 01: 18.75%
13:34:58:Unit 01: 18.96%
13:35:04:Unit 01: 19.17%
13:35:10:Unit 01: 19.38%
13:35:16:Unit 01: 19.59%
13:35:22:Unit 01: 19.81%
13:35:28:Unit 01: 20.02%
13:35:34:Unit 01: 20.23%
13:35:40:Unit 01: 20.44%
13:35:46:Unit 01: 20.65%
13:35:52:Unit 01: 20.86%
13:35:58:Unit 01: 21.07%
13:36:04:Unit 01: 21.28%
13:36:10:Unit 01: 21.50%
13:36:16:Unit 01: 21.70%
13:36:22:Unit 01: 21.92%
13:36:28:Unit 01: 22.13%
13:36:34:Unit 01: 22.34%
13:36:40:Unit 01: 22.55%
13:36:46:Unit 01: 22.76%
13:36:52:Unit 01: 22.97%
13:36:58:Unit 01: 23.18%
13:37:04:Unit 01: 23.39%
13:37:10:Unit 01: 23.60%
13:37:16:Unit 01: 23.81%
13:37:22:Unit 01: 24.02%
13:37:28:Unit 01: 24.23%
13:37:34:Unit 01: 24.44%
13:37:40:Unit 01: 24.65%
13:37:46:Unit 01: 24.86%
13:37:52:Unit 01: 25.07%
13:37:58:Unit 01: 25.28%
13:38:04:Unit 01: 25.49%
13:38:10:Unit 01: 25.70%
13:38:16:Unit 01: 25.91%
13:38:22:Unit 01: 26.12%
13:38:28:Unit 01: 26.34%
13:38:34:Unit 01: 26.54%
13:38:40:Unit 01: 26.75%
13:38:46:Unit 01: 26.96%
13:38:52:Unit 01: 27.17%
13:38:58:Unit 01: 27.38%
13:39:04:Unit 01: 27.60%
13:39:10:Unit 01: 27.80%
13:39:16:Unit 01: 28.01%
13:39:22:Unit 01: 28.23%
13:39:28:Unit 01: 28.43%
13:39:34:Unit 01: 28.63%
13:39:40:Unit 01: 28.85%
13:39:46:Unit 01: 29.06%
13:39:52:Unit 01: 29.27%
13:39:58:Unit 01: 29.48%
13:40:04:Unit 01: 29.69%
13:40:10:Unit 01: 29.90%
13:40:16:Unit 01: 30.11%
13:40:22:Unit 01: 30.32%
13:40:28:Unit 01: 30.53%
13:40:34:Unit 01: 30.75%
13:40:40:Unit 01: 30.96%
13:40:46:Unit 01: 31.17%
13:40:52:Unit 01: 31.39%
13:40:58:Unit 01: 31.60%
13:41:04:Unit 01: 31.81%
13:41:10:Unit 01: 32.02%
13:41:16:Unit 01: 32.23%
13:41:22:Unit 01: 32.44%
13:41:28:Unit 01: 32.65%
13:41:34:Unit 01: 32.87%
13:41:40:Unit 01: 33.08%
13:41:46:Unit 01: 33.29%
13:41:52:Unit 01: 33.50%
13:41:58:Unit 01: 33.71%
13:42:04:Unit 01: 33.92%
13:42:10:Unit 01: 34.13%
13:42:16:Unit 01: 34.35%
13:42:22:Unit 01: 34.56%
13:42:28:Unit 01: 34.77%
13:42:34:Unit 01: 34.98%
13:42:40:Unit 01: 35.19%
13:42:46:Unit 01: 35.40%
13:42:52:Unit 01: 35.61%
13:42:58:Unit 01: 35.83%
13:43:04:Unit 01: 36.04%
13:43:10:Unit 01: 36.25%
13:43:16:Unit 01: 36.46%
13:43:22:Unit 01: 36.67%
13:43:28:Unit 01: 36.88%
13:43:34:Unit 01: 37.09%
13:43:40:Unit 01: 37.30%
13:43:46:Unit 01: 37.52%
13:43:52:Unit 01: 37.73%
13:43:58:Unit 01: 37.94%
13:44:04:Unit 01: 38.15%
13:44:10:Unit 01: 38.36%
13:44:16:Unit 01: 38.57%
13:44:22:Unit 01: 38.78%
13:44:28:Unit 01: 39.00%
13:44:34:Unit 01: 39.21%
13:44:40:Unit 01: 39.42%
13:44:46:Unit 01: 39.63%
13:44:52:Unit 01: 39.84%
13:44:58:Unit 01: 40.06%
13:45:04:Unit 01: 40.26%
13:45:10:Unit 01: 40.48%
13:45:16:Unit 01: 40.69%
13:45:22:Unit 01: 40.90%
13:45:28:Unit 01: 41.12%
13:45:34:Unit 01: 41.33%
13:45:40:Unit 01: 41.54%
13:45:46:Unit 01: 41.75%
13:45:52:Unit 01: 41.96%
13:45:58:Unit 01: 42.17%
13:46:04:Unit 01: 42.38%
13:46:10:Unit 01: 42.60%
13:46:16:Unit 01: 42.81%
13:46:22:Unit 01: 43.02%
13:46:28:Unit 01: 43.23%
13:46:34:Unit 01: 43.44%
13:46:40:Unit 01: 43.65%
13:46:46:Unit 01: 43.87%
13:46:52:Unit 01: 44.08%
13:46:58:Unit 01: 44.29%
13:47:04:Unit 01: 44.50%
13:47:10:Unit 01: 44.70%
13:47:16:Unit 01: 44.92%
13:47:22:Unit 01: 45.13%
13:47:28:Unit 01: 45.34%
13:47:34:Unit 01: 45.55%
13:47:40:Unit 01: 45.77%
13:47:46:Unit 01: 45.98%
13:47:52:Unit 01: 46.18%
13:47:58:Unit 01: 46.40%
13:48:04:Unit 01: 46.61%
13:48:10:Unit 01: 46.82%
13:48:16:Unit 01: 47.03%
13:48:22:Unit 01: 47.25%
13:48:28:Unit 01: 47.46%
13:48:34:Unit 01: 47.66%
13:48:40:Unit 01: 47.88%
13:48:46:Unit 01: 48.09%
13:48:52:Unit 01: 48.30%
13:48:58:Unit 01: 48.51%
13:49:04:Unit 01: 48.72%
13:49:10:Unit 01: 48.94%
13:49:16:Unit 01: 49.14%
13:49:22:Unit 01: 49.36%
13:49:28:Unit 01: 49.57%
13:49:34:Unit 01: 49.78%
13:49:40:Unit 01: 49.99%
13:49:46:Unit 01: 50.20%
13:49:52:Unit 01: 50.41%
13:49:58:Unit 01: 50.62%
13:50:04:Unit 01: 50.83%
13:50:10:Unit 01: 51.04%
13:50:16:Unit 01: 51.25%
13:50:22:Unit 01: 51.47%
13:50:28:Unit 01: 51.68%
13:50:34:Unit 01: 51.89%
13:50:40:Unit 01: 52.10%
13:50:46:Unit 01: 52.31%
13:50:52:Unit 01: 52.52%
13:50:58:Unit 01: 52.73%
13:51:04:Unit 01: 52.94%
13:51:10:Unit 01: 53.14%
13:51:16:Unit 01: 53.36%
13:51:22:Unit 01: 53.56%
13:51:28:Unit 01: 53.77%
13:51:34:Unit 01: 53.98%
13:51:40:Unit 01: 54.19%
13:51:46:Unit 01: 54.40%
13:51:52:Unit 01: 54.61%
13:51:58:Unit 01: 54.82%
13:52:04:Unit 01: 55.03%
13:52:10:Unit 01: 55.24%
13:52:16:Unit 01: 55.45%
13:52:22:Unit 01: 55.66%
13:52:28:Unit 01: 55.87%
13:52:34:Unit 01: 56.09%
13:52:40:Unit 01: 56.29%
13:52:46:Unit 01: 56.51%
13:52:52:Unit 01: 56.72%
13:52:58:Unit 01: 56.93%
13:53:04:Unit 01: 57.14%
13:53:10:Unit 01: 57.35%
13:53:16:Unit 01: 57.56%
13:53:22:Unit 01: 57.77%
13:53:28:Unit 01: 57.98%
13:53:34:Unit 01: 58.19%
13:53:40:Unit 01: 58.40%
13:53:46:Unit 01: 58.61%
13:53:52:Unit 01: 58.82%
13:53:58:Unit 01: 59.03%
13:54:04:Unit 01: 59.23%
13:54:10:Unit 01: 59.45%
13:54:16:Unit 01: 59.66%
13:54:22:Unit 01: 59.86%
13:54:28:Unit 01: 60.08%
13:54:34:Unit 01: 60.28%
13:54:40:Unit 01: 60.49%
13:54:46:Unit 01: 60.70%
13:54:52:Unit 01: 60.91%
13:54:58:Unit 01: 61.12%
13:55:04:Unit 01: 61.33%
13:55:10:Unit 01: 61.50%
13:55:16:Unit 01: 61.71%
13:55:22:Unit 01: 61.91%
13:55:28:Unit 01: 62.12%
13:55:34:Unit 01: 62.32%
13:55:40:Unit 01: 62.53%
13:55:46:Unit 01: 62.73%
13:55:52:Unit 01: 62.93%
13:55:58:Unit 01: 63.14%
13:56:04:Unit 01: 63.35%
13:56:10:Unit 01: 63.56%
13:56:16:Unit 01: 63.78%
13:56:22:Unit 01: 63.99%
13:56:28:Unit 01: 64.20%
13:56:34:Unit 01: 64.41%
13:56:40:Unit 01: 64.62%
13:56:46:Unit 01: 64.83%
13:56:50:Unit 00:Completed 2500 out of 250000 steps  (1%)
13:56:52:Unit 01: 65.04%
13:56:58:Unit 01: 65.25%
13:57:04:Unit 01: 65.46%
13:57:10:Unit 01: 65.67%
13:57:16:Unit 01: 65.88%
13:57:22:Unit 01: 66.09%
13:57:28:Unit 01: 66.30%
13:57:34:Unit 01: 66.51%
13:57:40:Unit 01: 66.72%
13:57:46:Unit 01: 66.93%
13:57:52:Unit 01: 67.14%
13:57:58:Unit 01: 67.35%
13:58:04:Unit 01: 67.57%
13:58:10:Unit 01: 67.77%
13:58:16:Unit 01: 67.98%
13:58:22:Unit 01: 68.20%
13:58:28:Unit 01: 68.40%
13:58:34:Unit 01: 68.61%
13:58:40:Unit 01: 68.82%
13:58:46:Unit 01: 69.03%
13:58:52:Unit 01: 69.24%
13:58:58:Unit 01: 69.45%
13:59:04:Unit 01: 69.66%
13:59:10:Unit 01: 69.87%
13:59:16:Unit 01: 70.08%
13:59:22:Unit 01: 70.29%
13:59:28:Unit 01: 70.51%
13:59:34:Unit 01: 70.71%
13:59:40:Unit 01: 70.93%
13:59:46:Unit 01: 71.14%
13:59:52:Unit 01: 71.35%
13:59:58:Unit 01: 71.56%
14:00:04:Unit 01: 71.77%
14:00:10:Unit 01: 71.98%
14:00:16:Unit 01: 72.19%
14:00:22:Unit 01: 72.40%
14:00:28:Unit 01: 72.61%
14:00:34:Unit 01: 72.82%
14:00:40:Unit 01: 73.04%
14:00:46:Unit 01: 73.25%
14:00:52:Unit 01: 73.46%
14:00:58:Unit 01: 73.67%
14:01:04:Unit 01: 73.88%
14:01:10:Unit 01: 74.09%
14:01:16:Unit 01: 74.30%
14:01:22:Unit 01: 74.51%
14:01:28:Unit 01: 74.72%
14:01:34:Unit 01: 74.94%
14:01:40:Unit 01: 75.15%
14:01:46:Unit 01: 75.36%
14:01:52:Unit 01: 75.57%
14:01:58:Unit 01: 75.78%
14:02:04:Unit 01: 75.99%
14:02:10:Unit 01: 76.20%
14:02:16:Unit 01: 76.41%
14:02:22:Unit 01: 76.63%
14:02:28:Unit 01: 76.84%
14:02:34:Unit 01: 77.05%
14:02:40:Unit 01: 77.26%
14:02:46:Unit 01: 77.47%
14:02:52:Unit 01: 77.68%
14:02:58:Unit 01: 77.88%
14:03:04:Unit 01: 78.10%
14:03:10:Unit 01: 78.31%
14:03:16:Unit 01: 78.51%
14:03:22:Unit 01: 78.73%
14:03:28:Unit 01: 78.94%
14:03:34:Unit 01: 79.14%
14:03:40:Unit 01: 79.36%
14:03:46:Unit 01: 79.57%
14:03:52:Unit 01: 79.77%
14:03:58:Unit 01: 79.99%
14:04:04:Unit 01: 80.20%
14:04:10:Unit 01: 80.41%
14:04:16:Unit 01: 80.62%
14:04:22:Unit 01: 80.83%
14:04:28:Unit 01: 81.04%
14:04:34:Unit 01: 81.25%
14:04:40:Unit 01: 81.46%
14:04:46:Unit 01: 81.67%
14:04:52:Unit 01: 81.88%
14:04:58:Unit 01: 82.09%
14:05:04:Unit 01: 82.30%
14:05:10:Unit 01: 82.51%
14:05:16:Unit 01: 82.72%
14:05:22:Unit 01: 82.93%
14:05:28:Unit 01: 83.15%
14:05:34:Unit 01: 83.33%
14:05:40:Unit 01: 83.44%
14:05:46:Unit 01: 83.65%
14:05:52:Unit 01: 83.87%
14:05:58:Unit 01: 84.08%
14:06:04:Unit 01: 84.28%
14:06:10:Unit 01: 84.50%
14:06:16:Unit 01: 84.71%
14:06:22:Unit 01: 84.92%
14:06:28:Unit 01: 85.13%
14:06:34:Unit 01: 85.34%
14:06:40:Unit 01: 85.55%
14:06:46:Unit 01: 85.76%
14:06:52:Unit 01: 85.97%
14:06:58:Unit 01: 86.18%
14:07:04:Unit 01: 86.40%
14:07:10:Unit 01: 86.61%
14:07:16:Unit 01: 86.82%
14:07:22:Unit 01: 87.03%
14:07:28:Unit 01: 87.24%
14:07:34:Unit 01: 87.45%
14:07:40:Unit 01: 87.66%
14:07:46:Unit 01: 87.87%
14:07:52:Unit 01: 88.08%
14:07:58:Unit 01: 88.28%
14:08:04:Unit 01: 88.50%
14:08:10:Unit 01: 88.71%
14:08:16:Unit 01: 88.92%
14:08:22:Unit 01: 89.13%
14:08:28:Unit 01: 89.34%
14:08:34:Unit 01: 89.55%
14:08:40:Unit 01: 89.76%
14:08:46:Unit 01: 89.98%
14:08:52:Unit 01: 90.19%
14:08:58:Unit 01: 90.40%
14:09:04:Unit 01: 90.61%
14:09:10:Unit 01: 90.82%
14:09:16:Unit 01: 91.03%
14:09:22:Unit 01: 91.24%
14:09:28:Unit 01: 91.45%
14:09:34:Unit 01: 91.66%
14:09:40:Unit 01: 91.87%
14:09:46:Unit 01: 92.08%
14:09:52:Unit 01: 92.29%
14:09:58:Unit 01: 92.50%
14:10:04:Unit 01: 92.72%
14:10:10:Unit 01: 92.93%
14:10:16:Unit 01: 93.14%
14:10:22:Unit 01: 93.35%
14:10:28:Unit 01: 93.56%
14:10:34:Unit 01: 93.77%
14:10:40:Unit 01: 93.98%
14:10:46:Unit 01: 94.19%
14:10:52:Unit 01: 94.40%
14:10:58:Unit 01: 94.61%
14:11:04:Unit 01: 94.82%
14:11:10:Unit 01: 95.03%
14:11:16:Unit 01: 95.24%
14:11:22:Unit 01: 95.45%
14:11:28:Unit 01: 95.66%
14:11:34:Unit 01: 95.87%
14:11:40:Unit 01: 96.09%
14:11:46:Unit 01: 96.30%
14:11:52:Unit 01: 96.51%
14:11:58:Unit 01: 96.72%
14:12:04:Unit 01: 96.93%
14:12:10:Unit 01: 97.14%
14:12:16:Unit 01: 97.35%
14:12:22:Unit 01: 97.56%
14:12:28:Unit 01: 97.77%
14:12:34:Unit 01: 97.99%
14:12:40:Unit 01: 98.19%
14:12:46:Unit 01: 98.40%
14:12:52:Unit 01: 98.62%
14:12:58:Unit 01: 98.83%
14:13:04:Unit 01: 99.04%
14:13:10:Unit 01: 99.25%
14:13:16:Unit 01: 99.46%
14:13:22:Unit 01: 99.67%
14:13:28:Unit 01: 99.88%
14:13:34:Unit 01: Upload complete
14:13:34:Server responded WORK_ACK (400)
14:13:34:Final credit estimate, 76268.00 points
Image
2 - SM H8QGi-F AMD 6xxx=112 cores @ 3.2 & 3.9Ghz
5 - SM X9QRI-f+ Intel 4650 = 320 cores @ 3.15Ghz
2 - I7 980X 4.4Ghz 2-GTX680
1 - 2700k 4.4Ghz GTX680
Total = 464 cores folding
kasson
Pande Group Member
Posts: 1459
Joined: Thu Nov 29, 2007 9:37 pm

Re: folding-2.pdc.kth.se

Post by kasson »

Based on the data from k1wi, it looks as if v7 reports ~2x slower upload speed than v6 regardless of the work unit.
jcoffland
Site Admin
Posts: 1019
Joined: Fri Oct 10, 2008 6:42 pm
Location: Helsinki, Finland
Contact:

Re: #682 folding-2.pdc.kth.se: Noticeable V7 slowdown

Post by jcoffland »

I've been investigating this problem in more detail. The main difference between v6 and v7 client socket communication is that v7 uses non-block socket operations. This makes it easier to interrupt a transfer and shutdown gracefully.

However, we might be getting hit by the problem described here: http://support.microsoft.com/kb/823764

I'm going to decrease the block size that the v7 client tries to send at one time, as suggested in the above article, to see if that will solve the problem. From reading this thread it seems the problem occurs in both Windows and Linux. Is this indeed true? k1wi's data is the most conclusive but seems to be from Windows. It maybe that the issue described in the above article affects both Windows and Linux since they likely use similar implementations.

This is difficult for me to test so I'll have to ask you guys to test it out in the next release.
Cauldron Development LLC
http://cauldrondevelopment.com/
Grandpa_01
Posts: 1122
Joined: Wed Mar 04, 2009 7:36 am
Hardware configuration: 3 - Supermicro H8QGi-F AMD MC 6174=144 cores 2.5Ghz, 96GB G.Skill DDR3 1333Mhz Ubuntu 10.10
2 - Asus P6X58D-E i7 980X 4.4Ghz 6GB DDR3 2000 A-Data 64GB SSD Ubuntu 10.10
1 - Asus Rampage Gene III 17 970 4.3Ghz DDR3 2000 2-500GB Segate 7200.11 0-Raid Ubuntu 10.10
1 - Asus G73JH Laptop i7 740QM 1.86Ghz ATI 5870M

Re: #682 folding-2.pdc.kth.se: Noticeable V7 slowdown

Post by Grandpa_01 »

No it does not occur in Linux at least not on any of my machines but they are on V6 Will Linux V7 now get 6900 and 6901 WU's if it will I can test it .
k1wi
Posts: 910
Joined: Tue Sep 22, 2009 10:48 pm

Re: #682 folding-2.pdc.kth.se: Noticeable V7 slowdown

Post by k1wi »

Unfortunately I am offsite for the next couple of months so cannot do any extra playing around with clients (currently just remotely monitoring them).

My experiences with the clients were that distance is a factor, so it is hard for people 'close' to the server to replicate it and it doesn't matter so much for the uniproc work units (because they are so small anyway).

k1wi

p.s It is great to see a potential solution to this.
bruce
Posts: 20910
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: #682 folding-2.pdc.kth.se: Noticeable V7 slowdown

Post by bruce »

jcoffland wrote:I'm going to decrease the block size that the v7 client tries to send at one time, as suggested in the above article, to see if that will solve the problem. From reading this thread it seems the problem occurs in both Windows and Linux. Is this indeed true? k1wi's data is the most conclusive but seems to be from Windows. It maybe that the issue described in the above article affects both Windows and Linux since they likely use similar implementations.
I wouldn't expect that Windows and Linux would be the same without further qualifications. The entire stack was rewritten somewhere between WinXP and Vista. There have also been some changes to the Linux stack but I'm not knowledgeable enough to specify which nucleus reflected the changes.
Grandpa_01
Posts: 1122
Joined: Wed Mar 04, 2009 7:36 am
Hardware configuration: 3 - Supermicro H8QGi-F AMD MC 6174=144 cores 2.5Ghz, 96GB G.Skill DDR3 1333Mhz Ubuntu 10.10
2 - Asus P6X58D-E i7 980X 4.4Ghz 6GB DDR3 2000 A-Data 64GB SSD Ubuntu 10.10
1 - Asus Rampage Gene III 17 970 4.3Ghz DDR3 2000 2-500GB Segate 7200.11 0-Raid Ubuntu 10.10
1 - Asus G73JH Laptop i7 740QM 1.86Ghz ATI 5870M

Re: #682 folding-2.pdc.kth.se: Noticeable V7 slowdown

Post by Grandpa_01 »

I can now confirm that the problem is not present on Linux. I uploaded a 6900 and a 6901 today on Linux rigs running v7. It only took 6 min to upload the file to the server.

Code: Select all

18:02:31:Unit 01:Leaving Run
18:02:33:Unit 01:- Writing 100188157 bytes of core data to disk...
18:02:33:Unit 01:  ... Done.
18:02:42:Unit 01:- Shutting down core
18:02:42:Unit 01:
18:02:42:Unit 01:Folding@home Core Shutdown: FINISHED_UNIT
18:02:43:FahCore, running Unit 01, returned: FINISHED_UNIT (100)
18:02:43:Sending unit results: id:01 state:SEND project:6901 run:7 clone:6 gen:75 core:0xa5 unit:0x0000006952be746d4d5affab5f8dae11
18:02:43:Unit 01: Uploading 95.55MiB
18:02:43:Connecting to 130.237.232.237:8080
18:02:44:Starting Unit 00
18:02:44:Running core: /var/lib/fahclient/cores/www.stanford.edu/~pande/Linux/AMD64/Core_a5.fah/FahCore_a5 -dir 00 -suffix 01 -lifeline 1386 -version 701 -checkpoint 15 -np 12
18:02:44:Started core on PID 3186
18:02:44:FahCore 0xa5 started
18:02:44:Unit 00:
18:02:44:Unit 00:*------------------------------*
18:02:44:Unit 00:Folding@Home Gromacs SMP Core
18:02:44:Unit 00:Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
18:02:44:Unit 00:
18:02:44:Unit 00:Preparing to commence simulation
18:02:44:Unit 00:- Looking at optimizations...
18:02:44:Unit 00:- Created dyn
18:02:44:Unit 00:- Files status OK
18:02:45:Unit 00:- Expanded 24867286 -> 30796292 (decompressed 123.8 percent)
18:02:45:Unit 00:Called DecompressByteArray: compressed_data_size=24867286 data_size=30796292, decompressed_data_size=30796292 diff=0
18:02:45:Unit 00:- Digital signature verified
18:02:45:Unit 00:
18:02:45:Unit 00:Project: 6900 (Run 34, Clone 0, Gen 21)
18:02:45:Unit 00:
18:02:45:Unit 00:Assembly optimizations on if available.
18:02:45:Unit 00:Entering M.D.
18:02:49:Unit 01: 1.84%
18:02:52:Unit 00:Mapping NT from 12 to 12 
18:02:54:Unit 00:Completed 0 out of 250000 steps  (0%)
18:02:55:Unit 01: 4.79%
18:03:01:Unit 01: 7.40%
18:03:07:Unit 01: 10.10%
18:03:13:Unit 01: 12.16%
18:03:19:Unit 01: 14.07%
18:03:25:Unit 01: 15.46%
18:03:32:Unit 01: 17.08%
18:03:38:Unit 01: 18.96%
18:03:44:Unit 01: 20.51%
18:03:50:Unit 01: 22.07%
18:03:56:Unit 01: 23.62%
18:04:02:Unit 01: 25.17%
18:04:08:Unit 01: 26.54%
18:04:14:Unit 01: 28.25%
18:04:20:Unit 01: 29.82%
18:04:26:Unit 01: 31.37%
18:04:32:Unit 01: 32.93%
18:04:38:Unit 01: 34.18%
18:04:44:Unit 01: 36.04%
18:04:50:Unit 01: 37.58%
18:04:56:Unit 01: 39.14%
18:05:02:Unit 01: 40.70%
18:05:08:Unit 01: 42.25%
18:05:14:Unit 01: 43.80%
18:05:20:Unit 01: 45.09%
18:05:26:Unit 01: 46.76%
18:05:32:Unit 01: 48.45%
18:05:38:Unit 01: 50.00%
18:05:44:Unit 01: 51.55%
18:05:50:Unit 01: 53.09%
18:05:56:Unit 01: 54.66%
18:06:02:Unit 01: 56.06%
18:06:08:Unit 01: 57.75%
18:06:14:Unit 01: 59.30%
18:06:21:Unit 01: 60.78%
18:06:28:Unit 01: 62.62%
18:06:34:Unit 01: 64.47%
18:06:40:Unit 01: 66.02%
18:06:46:Unit 01: 67.58%
18:06:52:Unit 01: 69.13%
18:06:58:Unit 01: 70.67%
18:07:04:Unit 01: 72.23%
18:07:11:Unit 01: 73.71%
18:07:17:Unit 01: 75.56%
18:07:23:Unit 01: 77.11%
18:07:29:Unit 01: 78.61%
18:07:35:Unit 01: 80.22%
18:07:41:Unit 01: 81.62%
18:07:47:Unit 01: 83.32%
18:07:53:Unit 01: 84.85%
18:08:00:Unit 01: 86.29%
18:08:06:Unit 01: 87.95%
18:08:12:Unit 01: 89.75%
18:08:19:Unit 01: 91.27%
18:08:25:Unit 01: 93.09%
18:08:31:Unit 01: 94.64%
18:08:38:Unit 01: 96.09%
18:08:44:Unit 01: 98.00%
18:08:50:Unit 01: 99.55%
18:08:56:Unit 01: Upload complete
18:08:56:Server responded WORK_ACK (400)
18:08:56:Final credit estimate, 76890.00 points
18:08:56:Cleaning up Unit 01
18:22:37:Unit 00:Completed 2500 out of 250000 steps  (1%)
18:42:19:Unit 00:Completed 5000 out of 250000 steps  (2%)
19:02:02:Unit 00:Completed 7500 out of 250000 steps  (3%)
19:21:45:Unit 00:Completed 10000 out of 250000 steps  (4%)
19:41:29:Unit 
toTOW
Site Moderator
Posts: 6296
Joined: Sun Dec 02, 2007 10:38 am
Location: Bordeaux, France
Contact:

Re: #682 folding-2.pdc.kth.se: Noticeable V7 slowdown

Post by toTOW »

I didn't read the whole topic, but the problem looks very like the one I have with V7 client and ATI Core 16 server : it never uploads faster than 30 kB/sec ...

I'm pretty sure it's a v7 issue ...
Image

Folding@Home beta tester since 2002. Folding Forum moderator since July 2008.
bruce
Posts: 20910
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: #682 folding-2.pdc.kth.se: Noticeable V7 slowdown

Post by bruce »

toTOW wrote:I didn't read the whole topic, but the problem looks very like the one I have with V7 client and ATI Core 16 server : it never uploads faster than 30 kB/sec ...

I'm pretty sure it's a v7 issue ...
Which OS are you running?

I don't think you mean V7, but rather V7 on WinXP. Those who run Linux/MacOS/Vista+ don't report the same problem.

Based on the previous post by jcoffland, he's going to fix what's covered by the Microsoft ticket. From the perspective of that ticket, note that:

Code: Select all

APPLIES TO

    Microsoft Windows Server 2003, Enterprise Edition (32-bit x86)
    Microsoft Windows Server 2003, Standard Edition (32-bit x86)
    Microsoft Windows Server 2003, Web Edition
    Microsoft Windows XP Home Edition
    Microsoft Windows XP Professional
    Microsoft Windows 2000 Advanced Server
    Microsoft Windows 2000 Professional Edition
    Microsoft Windows 2000 Server
    Windows Server 2008 Datacenter without Hyper-V
    Windows Server 2008 Enterprise without Hyper-V
    Windows Server 2008 for Itanium-Based Systems
    Windows Server 2008 Standard without Hyper-V
    Windows Server 2008 Datacenter
    Windows Server 2008 Enterprise
    Windows Server 2008 Standard
    Windows Web Server 2008
Post Reply