large drop in PPD since coming back (Linux)

[JLloyd13]

I first started folding about two years ago, but stopped for a while after I went distro hopping (linux user here) and since coming back I've noticed a large drop in my average PPD using my AMD Phenom II X4 chip @3.3GHz. When I first started folding I was getting an average of about 7k out of it, but since coming back I've seen it level out at around 3k. I'm not sure why, the hardware is the same, SMP V7 both times, the only thing I can figure is the for some reason the Debian Wheezy I'd currently using is performing poorer then the Linux Mint 12 I started out on. That or I'm just doing something wrong. The only hardware change has actually been the addition of an SSD, so if anything it should be faster. 64bit SMP v7 both times. I've waited two weeks now for it to go up. Any help on trouble shooting this one out is welcome.

[JLloyd13]

oh, DE on mint was Gnome 3 back then and current DE on debian is Mate (gnome 2)

[Joe_H]

Please post your log, include the beginning section that shows the client version information and the system info. Enough of the log after that to show the configuration of the client is also needed. Part of the difference might be the different distributions, but probably it is related to different defaults used by the folding client that is current now as compared to the one you used in the past.

[JLloyd13]

Code: Select all

06:34:21:WU01:FS00:FahCore 0xa4 started
06:34:21:WU01:FS00:0xa4:
06:34:21:WU01:FS00:0xa4:*------------------------------*
06:34:21:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
06:34:21:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
06:34:21:WU01:FS00:0xa4:
06:34:21:WU01:FS00:0xa4:Preparing to commence simulation
06:34:21:WU01:FS00:0xa4:- Looking at optimizations...
06:34:21:WU01:FS00:0xa4:- Created dyn
06:34:21:WU01:FS00:0xa4:- Files status OK
06:34:21:WU01:FS00:0xa4:- Expanded 826917 -> 1397548 (decompressed 169.0 percent)
06:34:21:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=826917 data_size=1397548, decompressed_data_size=1397548 diff=0
06:34:21:WU01:FS00:0xa4:- Digital signature verified
06:34:21:WU01:FS00:0xa4:
06:34:21:WU01:FS00:0xa4:Project: 9016 (Run 123, Clone 5, Gen 12)
06:34:21:WU01:FS00:0xa4:
06:34:21:WU01:FS00:0xa4:Assembly optimizations on if available.
06:34:21:WU01:FS00:0xa4:Entering M.D.
06:34:27:WU00:FS00:Upload 33.43%
06:34:27:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
06:34:33:WU00:FS00:Upload 68.53%
06:34:40:WU00:FS00:Upload complete
06:34:40:WU00:FS00:Server responded WORK_ACK (400)
06:34:40:WU00:FS00:Final credit estimate, 1480.00 points
06:34:40:WU00:FS00:Cleaning up
06:38:47:WU01:FS00:0xa4:Completed 2500 out of 250000 steps  (1%)
06:43:25:WU01:FS00:0xa4:Completed 5000 out of 250000 steps  (2%)
06:47:53:WU01:FS00:0xa4:Completed 7500 out of 250000 steps  (3%)
06:52:25:WU01:FS00:0xa4:Completed 10000 out of 250000 steps  (4%)
06:57:04:WU01:FS00:0xa4:Completed 12500 out of 250000 steps  (5%)
07:01:34:WU01:FS00:0xa4:Completed 15000 out of 250000 steps  (6%)
07:06:02:WU01:FS00:0xa4:Completed 17500 out of 250000 steps  (7%)
07:10:38:WU01:FS00:0xa4:Completed 20000 out of 250000 steps  (8%)
07:15:11:WU01:FS00:0xa4:Completed 22500 out of 250000 steps  (9%)
07:19:42:WU01:FS00:0xa4:Completed 25000 out of 250000 steps  (10%)
07:24:17:WU01:FS00:0xa4:Completed 27500 out of 250000 steps  (11%)
07:28:55:WU01:FS00:0xa4:Completed 30000 out of 250000 steps  (12%)
07:33:27:WU01:FS00:0xa4:Completed 32500 out of 250000 steps  (13%)
07:38:05:WU01:FS00:0xa4:Completed 35000 out of 250000 steps  (14%)
07:42:45:WU01:FS00:0xa4:Completed 37500 out of 250000 steps  (15%)
07:47:20:WU01:FS00:0xa4:Completed 40000 out of 250000 steps  (16%)
07:51:59:WU01:FS00:0xa4:Completed 42500 out of 250000 steps  (17%)
07:56:36:WU01:FS00:0xa4:Completed 45000 out of 250000 steps  (18%)
08:01:18:WU01:FS00:0xa4:Completed 47500 out of 250000 steps  (19%)
08:05:52:WU01:FS00:0xa4:Completed 50000 out of 250000 steps  (20%)
08:10:35:WU01:FS00:0xa4:Completed 52500 out of 250000 steps  (21%)
08:15:16:WU01:FS00:0xa4:Completed 55000 out of 250000 steps  (22%)
08:19:56:WU01:FS00:0xa4:Completed 57500 out of 250000 steps  (23%)
08:24:41:WU01:FS00:0xa4:Completed 60000 out of 250000 steps  (24%)
08:29:19:WU01:FS00:0xa4:Completed 62500 out of 250000 steps  (25%)
08:34:01:WU01:FS00:0xa4:Completed 65000 out of 250000 steps  (26%)
08:38:37:WU01:FS00:0xa4:Completed 67500 out of 250000 steps  (27%)
08:43:18:WU01:FS00:0xa4:Completed 70000 out of 250000 steps  (28%)
08:47:51:WU01:FS00:0xa4:Completed 72500 out of 250000 steps  (29%)
08:52:19:WU01:FS00:0xa4:Completed 75000 out of 250000 steps  (30%)
08:56:50:WU01:FS00:0xa4:Completed 77500 out of 250000 steps  (31%)
09:01:17:WU01:FS00:0xa4:Completed 80000 out of 250000 steps  (32%)
09:05:44:WU01:FS00:0xa4:Completed 82500 out of 250000 steps  (33%)
09:10:22:WU01:FS00:0xa4:Completed 85000 out of 250000 steps  (34%)
09:14:55:WU01:FS00:0xa4:Completed 87500 out of 250000 steps  (35%)
09:19:31:WU01:FS00:0xa4:Completed 90000 out of 250000 steps  (36%)
09:24:04:WU01:FS00:0xa4:Completed 92500 out of 250000 steps  (37%)
09:28:40:WU01:FS00:0xa4:Completed 95000 out of 250000 steps  (38%)
09:33:08:WU01:FS00:0xa4:Completed 97500 out of 250000 steps  (39%)
09:37:40:WU01:FS00:0xa4:Completed 100000 out of 250000 steps  (40%)
09:42:15:WU01:FS00:0xa4:Completed 102500 out of 250000 steps  (41%)
09:46:58:WU01:FS00:0xa4:Completed 105000 out of 250000 steps  (42%)
09:51:33:WU01:FS00:0xa4:Completed 107500 out of 250000 steps  (43%)
09:56:08:WU01:FS00:0xa4:Completed 110000 out of 250000 steps  (44%)
10:00:51:WU01:FS00:0xa4:Completed 112500 out of 250000 steps  (45%)
10:05:29:WU01:FS00:0xa4:Completed 115000 out of 250000 steps  (46%)
10:10:11:WU01:FS00:0xa4:Completed 117500 out of 250000 steps  (47%)
10:14:47:WU01:FS00:0xa4:Completed 120000 out of 250000 steps  (48%)
10:19:21:WU01:FS00:0xa4:Completed 122500 out of 250000 steps  (49%)
10:23:59:WU01:FS00:0xa4:Completed 125000 out of 250000 steps  (50%)
10:28:40:WU01:FS00:0xa4:Completed 127500 out of 250000 steps  (51%)
10:33:14:WU01:FS00:0xa4:Completed 130000 out of 250000 steps  (52%)
10:37:54:WU01:FS00:0xa4:Completed 132500 out of 250000 steps  (53%)
10:42:39:WU01:FS00:0xa4:Completed 135000 out of 250000 steps  (54%)
10:47:16:WU01:FS00:0xa4:Completed 137500 out of 250000 steps  (55%)
10:51:53:WU01:FS00:0xa4:Completed 140000 out of 250000 steps  (56%)
******************************* Date: 2015-01-11 *******************************
10:56:32:WU01:FS00:0xa4:Completed 142500 out of 250000 steps  (57%)
11:01:11:WU01:FS00:0xa4:Completed 145000 out of 250000 steps  (58%)
11:05:39:WU01:FS00:0xa4:Completed 147500 out of 250000 steps  (59%)
11:10:08:WU01:FS00:0xa4:Completed 150000 out of 250000 steps  (60%)
11:14:39:WU01:FS00:0xa4:Completed 152500 out of 250000 steps  (61%)
11:19:09:WU01:FS00:0xa4:Completed 155000 out of 250000 steps  (62%)
11:23:46:WU01:FS00:0xa4:Completed 157500 out of 250000 steps  (63%)
11:28:33:WU01:FS00:0xa4:Completed 160000 out of 250000 steps  (64%)
11:33:15:WU01:FS00:0xa4:Completed 162500 out of 250000 steps  (65%)
11:38:04:WU01:FS00:0xa4:Completed 165000 out of 250000 steps  (66%)
11:42:46:WU01:FS00:0xa4:Completed 167500 out of 250000 steps  (67%)
11:47:21:WU01:FS00:0xa4:Completed 170000 out of 250000 steps  (68%)
11:51:54:WU01:FS00:0xa4:Completed 172500 out of 250000 steps  (69%)
11:56:34:WU01:FS00:0xa4:Completed 175000 out of 250000 steps  (70%)
12:01:10:WU01:FS00:0xa4:Completed 177500 out of 250000 steps  (71%)
12:05:45:WU01:FS00:0xa4:Completed 180000 out of 250000 steps  (72%)
12:10:19:WU01:FS00:0xa4:Completed 182500 out of 250000 steps  (73%)
12:14:54:WU01:FS00:0xa4:Completed 185000 out of 250000 steps  (74%)
12:19:23:WU01:FS00:0xa4:Completed 187500 out of 250000 steps  (75%)
12:23:51:WU01:FS00:0xa4:Completed 190000 out of 250000 steps  (76%)
12:28:29:WU01:FS00:0xa4:Completed 192500 out of 250000 steps  (77%)
12:32:59:WU01:FS00:0xa4:Completed 195000 out of 250000 steps  (78%)
12:37:29:WU01:FS00:0xa4:Completed 197500 out of 250000 steps  (79%)
12:42:01:WU01:FS00:0xa4:Completed 200000 out of 250000 steps  (80%)
12:46:32:WU01:FS00:0xa4:Completed 202500 out of 250000 steps  (81%)
12:51:07:WU01:FS00:0xa4:Completed 205000 out of 250000 steps  (82%)
12:55:43:WU01:FS00:0xa4:Completed 207500 out of 250000 steps  (83%)
13:00:17:WU01:FS00:0xa4:Completed 210000 out of 250000 steps  (84%)
13:04:57:WU01:FS00:0xa4:Completed 212500 out of 250000 steps  (85%)
13:09:44:WU01:FS00:0xa4:Completed 215000 out of 250000 steps  (86%)
13:14:33:WU01:FS00:0xa4:Completed 217500 out of 250000 steps  (87%)
13:19:16:WU01:FS00:0xa4:Completed 220000 out of 250000 steps  (88%)
13:23:50:WU01:FS00:0xa4:Completed 222500 out of 250000 steps  (89%)
13:28:32:WU01:FS00:0xa4:Completed 225000 out of 250000 steps  (90%)
13:33:11:WU01:FS00:0xa4:Completed 227500 out of 250000 steps  (91%)
13:37:50:WU01:FS00:0xa4:Completed 230000 out of 250000 steps  (92%)
13:42:28:WU01:FS00:0xa4:Completed 232500 out of 250000 steps  (93%)
13:47:02:WU01:FS00:0xa4:Completed 235000 out of 250000 steps  (94%)
13:51:36:WU01:FS00:0xa4:Completed 237500 out of 250000 steps  (95%)
13:56:10:WU01:FS00:0xa4:Completed 240000 out of 250000 steps  (96%)
14:00:54:WU01:FS00:0xa4:Completed 242500 out of 250000 steps  (97%)
14:05:30:WU01:FS00:0xa4:Completed 245000 out of 250000 steps  (98%)
14:10:05:WU01:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
14:10:06:WU00:FS00:Connecting to 171.67.108.200:8080
14:10:07:WU00:FS00:Assigned to work server 128.143.199.97
14:10:07:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:4 from 128.143.199.97
14:10:07:WU00:FS00:Connecting to 128.143.199.97:8080
14:10:11:WU00:FS00:Downloading 1.69MiB
14:10:15:WU00:FS00:Download complete
14:10:15:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:7504 run:10 clone:98 gen:59 core:0xa3 unit:0x00000055fbcb017d4e39c234b7067114
14:14:41:WU01:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
14:14:42:WU01:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
14:14:52:WU01:FS00:0xa4:
14:14:52:WU01:FS00:0xa4:Finished Work Unit:
14:14:52:WU01:FS00:0xa4:- Reading up to 811488 from "01/wudata_01.trr": Read 811488
14:14:52:WU01:FS00:0xa4:trr file hash check passed.
14:14:52:WU01:FS00:0xa4:- Reading up to 746028 from "01/wudata_01.xtc": Read 746028
14:14:52:WU01:FS00:0xa4:xtc file hash check passed.
14:14:52:WU01:FS00:0xa4:edr file hash check passed.
14:14:52:WU01:FS00:0xa4:logfile size: 24247
14:14:52:WU01:FS00:0xa4:Leaving Run
14:14:53:WU01:FS00:0xa4:- Writing 1584251 bytes of core data to disk...
14:14:54:WU01:FS00:0xa4:Done: 1583739 -> 1537551 (compressed to 97.0 percent)
14:14:54:WU01:FS00:0xa4:  ... Done.
14:15:03:WU01:FS00:0xa4:- Shutting down core
14:15:03:WU01:FS00:0xa4:
14:15:03:WU01:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
14:15:04:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
14:15:04:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:9016 run:123 clone:5 gen:12 core:0xa4 unit:0x00000010664f2de45491d6b65defd53a
14:15:04:WU01:FS00:Uploading 1.47MiB to 171.64.65.124
14:15:04:WU01:FS00:Connecting to 171.64.65.124:8080
14:15:05:WU00:FS00:Starting
14:15:05:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/Core_a3.fah/FahCore_a3 -dir 00 -suffix 01 -version 704 -lifeline 2552 -checkpoint 15 -np 4
14:15:05:WU00:FS00:Started FahCore on PID 6048
14:15:05:WU00:FS00:Core PID:6052
14:15:05:WU00:FS00:FahCore 0xa3 started
14:15:05:WU00:FS00:0xa3:
14:15:05:WU00:FS00:0xa3:*------------------------------*
14:15:05:WU00:FS00:0xa3:Folding@Home Gromacs SMP Core
14:15:05:WU00:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
14:15:05:WU00:FS00:0xa3:
14:15:05:WU00:FS00:0xa3:Preparing to commence simulation
14:15:05:WU00:FS00:0xa3:- Looking at optimizations...
14:15:05:WU00:FS00:0xa3:- Created dyn
14:15:05:WU00:FS00:0xa3:- Files status OK
14:15:05:WU00:FS00:0xa3:- Expanded 1767903 -> 2700840 (decompressed 152.7 percent)
14:15:05:WU00:FS00:0xa3:Called DecompressByteArray: compressed_data_size=1767903 data_size=2700840, decompressed_data_size=2700840 diff=0
14:15:05:WU00:FS00:0xa3:- Digital signature verified
14:15:05:WU00:FS00:0xa3:
14:15:05:WU00:FS00:0xa3:Project: 7504 (Run 10, Clone 98, Gen 59)
14:15:05:WU00:FS00:0xa3:
14:15:05:WU00:FS00:0xa3:Assembly optimizations on if available.
14:15:05:WU00:FS00:0xa3:Entering M.D.
14:15:10:WU01:FS00:Upload 76.70%
14:15:11:WU00:FS00:0xa3:Mapping NT from 4 to 4 
14:15:11:WU00:FS00:0xa3:Completed 0 out of 500000 steps  (0%)
14:15:12:WU01:FS00:Upload complete
14:15:12:WU01:FS00:Server responded WORK_ACK (400)
14:15:12:WU01:FS00:Final credit estimate, 905.00 points
14:15:12:WU01:FS00:Cleaning up
14:27:42:WU00:FS00:0xa3:Completed 5000 out of 500000 steps  (1%)
14:40:15:WU00:FS00:0xa3:Completed 10000 out of 500000 steps  (2%)
14:52:39:WU00:FS00:0xa3:Completed 15000 out of 500000 steps  (3%)
15:04:57:WU00:FS00:0xa3:Completed 20000 out of 500000 steps  (4%)
15:17:23:WU00:FS00:0xa3:Completed 25000 out of 500000 steps  (5%)
15:29:50:WU00:FS00:0xa3:Completed 30000 out of 500000 steps  (6%)
15:42:21:WU00:FS00:0xa3:Completed 35000 out of 500000 steps  (7%)
15:54:49:WU00:FS00:0xa3:Completed 40000 out of 500000 steps  (8%)
16:07:19:WU00:FS00:0xa3:Completed 45000 out of 500000 steps  (9%)
16:19:59:WU00:FS00:0xa3:Completed 50000 out of 500000 steps  (10%)
16:32:34:WU00:FS00:0xa3:Completed 55000 out of 500000 steps  (11%)
16:45:08:WU00:FS00:0xa3:Completed 60000 out of 500000 steps  (12%)
******************************* Date: 2015-01-11 *******************************
16:57:44:WU00:FS00:0xa3:Completed 65000 out of 500000 steps  (13%)
17:10:20:WU00:FS00:0xa3:Completed 70000 out of 500000 steps  (14%)
17:22:48:WU00:FS00:0xa3:Completed 75000 out of 500000 steps  (15%)
17:35:20:WU00:FS00:0xa3:Completed 80000 out of 500000 steps  (16%)
17:47:48:WU00:FS00:0xa3:Completed 85000 out of 500000 steps  (17%)
18:00:15:WU00:FS00:0xa3:Completed 90000 out of 500000 steps  (18%)
18:12:44:WU00:FS00:0xa3:Completed 95000 out of 500000 steps  (19%)
18:25:21:WU00:FS00:0xa3:Completed 100000 out of 500000 steps  (20%)
18:37:43:WU00:FS00:0xa3:Completed 105000 out of 500000 steps  (21%)
18:50:19:WU00:FS00:0xa3:Completed 110000 out of 500000 steps  (22%)
19:02:48:WU00:FS00:0xa3:Completed 115000 out of 500000 steps  (23%)
19:15:18:WU00:FS00:0xa3:Completed 120000 out of 500000 steps  (24%)
19:27:36:WU00:FS00:0xa3:Completed 125000 out of 500000 steps  (25%)
19:40:08:WU00:FS00:0xa3:Completed 130000 out of 500000 steps  (26%)
19:52:34:WU00:FS00:0xa3:Completed 135000 out of 500000 steps  (27%)
20:05:11:WU00:FS00:0xa3:Completed 140000 out of 500000 steps  (28%)
20:17:45:WU00:FS00:0xa3:Completed 145000 out of 500000 steps  (29%)
20:30:19:WU00:FS00:0xa3:Completed 150000 out of 500000 steps  (30%)
20:42:47:WU00:FS00:0xa3:Completed 155000 out of 500000 steps  (31%)
20:55:09:WU00:FS00:0xa3:Completed 160000 out of 500000 steps  (32%)
21:07:31:WU00:FS00:0xa3:Completed 165000 out of 500000 steps  (33%)
21:20:03:WU00:FS00:0xa3:Completed 170000 out of 500000 steps  (34%)
21:32:32:WU00:FS00:0xa3:Completed 175000 out of 500000 steps  (35%)
21:45:01:WU00:FS00:0xa3:Completed 180000 out of 500000 steps  (36%)
21:57:33:WU00:FS00:0xa3:Completed 185000 out of 500000 steps  (37%)
22:10:04:WU00:FS00:0xa3:Completed 190000 out of 500000 steps  (38%)
22:22:38:WU00:FS00:0xa3:Completed 195000 out of 500000 steps  (39%)
22:34:59:WU00:FS00:0xa3:Completed 200000 out of 500000 steps  (40%)
22:47:21:WU00:FS00:0xa3:Completed 205000 out of 500000 steps  (41%)
******************************* Date: 2015-01-11 *******************************
22:59:57:WU00:FS00:0xa3:Completed 210000 out of 500000 steps  (42%)
23:12:21:WU00:FS00:0xa3:Completed 215000 out of 500000 steps  (43%)
23:24:51:WU00:FS00:0xa3:Completed 220000 out of 500000 steps  (44%)
23:37:16:WU00:FS00:0xa3:Completed 225000 out of 500000 steps  (45%)
23:49:51:WU00:FS00:0xa3:Completed 230000 out of 500000 steps  (46%)
00:02:21:WU00:FS00:0xa3:Completed 235000 out of 500000 steps  (47%)
00:14:55:WU00:FS00:0xa3:Completed 240000 out of 500000 steps  (48%)
00:27:28:WU00:FS00:0xa3:Completed 245000 out of 500000 steps  (49%)
00:39:44:WU00:FS00:0xa3:Completed 250000 out of 500000 steps  (50%)
00:52:08:WU00:FS00:0xa3:Completed 255000 out of 500000 steps  (51%)
01:04:43:WU00:FS00:0xa3:Completed 260000 out of 500000 steps  (52%)
01:17:18:WU00:FS00:0xa3:Completed 265000 out of 500000 steps  (53%)
01:30:02:WU00:FS00:0xa3:Completed 270000 out of 500000 steps  (54%)
01:42:28:WU00:FS00:0xa3:Completed 275000 out of 500000 steps  (55%)
01:55:00:WU00:FS00:0xa3:Completed 280000 out of 500000 steps  (56%)
02:07:35:WU00:FS00:0xa3:Completed 285000 out of 500000 steps  (57%)
02:20:24:WU00:FS00:0xa3:Completed 290000 out of 500000 steps  (58%)
02:32:59:WU00:FS00:0xa3:Completed 295000 out of 500000 steps  (59%)
02:45:32:WU00:FS00:0xa3:Completed 300000 out of 500000 steps  (60%)
02:57:59:WU00:FS00:0xa3:Completed 305000 out of 500000 steps  (61%)
03:10:24:WU00:FS00:0xa3:Completed 310000 out of 500000 steps  (62%)
03:22:57:WU00:FS00:0xa3:Completed 315000 out of 500000 steps  (63%)
03:35:14:WU00:FS00:0xa3:Completed 320000 out of 500000 steps  (64%)
03:47:39:WU00:FS00:0xa3:Completed 325000 out of 500000 steps  (65%)
04:00:02:WU00:FS00:0xa3:Completed 330000 out of 500000 steps  (66%)
04:12:45:WU00:FS00:0xa3:Completed 335000 out of 500000 steps  (67%)
04:25:40:WU00:FS00:0xa3:Completed 340000 out of 500000 steps  (68%)
04:38:28:WU00:FS00:0xa3:Completed 345000 out of 500000 steps  (69%)
04:51:18:WU00:FS00:0xa3:Completed 350000 out of 500000 steps  (70%)
******************************* Date: 2015-01-12 *******************************
05:04:15:WU00:FS00:0xa3:Completed 355000 out of 500000 steps  (71%)
05:17:08:WU00:FS00:0xa3:Completed 360000 out of 500000 steps  (72%)
05:29:47:WU00:FS00:0xa3:Completed 365000 out of 500000 steps  (73%)
05:42:33:WU00:FS00:0xa3:Completed 370000 out of 500000 steps  (74%)
05:55:03:WU00:FS00:0xa3:Completed 375000 out of 500000 steps  (75%)
06:07:27:WU00:FS00:0xa3:Completed 380000 out of 500000 steps  (76%)
06:20:04:WU00:FS00:0xa3:Completed 385000 out of 500000 steps  (77%)
06:32:44:WU00:FS00:0xa3:Completed 390000 out of 500000 steps  (78%)
06:45:10:WU00:FS00:0xa3:Completed 395000 out of 500000 steps  (79%)
06:57:39:WU00:FS00:0xa3:Completed 400000 out of 500000 steps  (80%)
07:10:04:WU00:FS00:0xa3:Completed 405000 out of 500000 steps  (81%)
07:22:21:WU00:FS00:0xa3:Completed 410000 out of 500000 steps  (82%)
07:34:39:WU00:FS00:0xa3:Completed 415000 out of 500000 steps  (83%)
07:47:01:WU00:FS00:0xa3:Completed 420000 out of 500000 steps  (84%)
07:59:25:WU00:FS00:0xa3:Completed 425000 out of 500000 steps  (85%)
08:11:46:WU00:FS00:0xa3:Completed 430000 out of 500000 steps  (86%)
08:24:19:WU00:FS00:0xa3:Completed 435000 out of 500000 steps  (87%)
08:36:39:WU00:FS00:0xa3:Completed 440000 out of 500000 steps  (88%)
08:49:07:WU00:FS00:0xa3:Completed 445000 out of 500000 steps  (89%)
09:01:36:WU00:FS00:0xa3:Completed 450000 out of 500000 steps  (90%)
09:13:57:WU00:FS00:0xa3:Completed 455000 out of 500000 steps  (91%)
09:26:27:WU00:FS00:0xa3:Completed 460000 out of 500000 steps  (92%)
09:38:56:WU00:FS00:0xa3:Completed 465000 out of 500000 steps  (93%)
09:51:23:WU00:FS00:0xa3:Completed 470000 out of 500000 steps  (94%)
10:03:38:WU00:FS00:0xa3:Completed 475000 out of 500000 steps  (95%)
10:16:14:WU00:FS00:0xa3:Completed 480000 out of 500000 steps  (96%)
10:29:37:WU00:FS00:0xa3:Completed 485000 out of 500000 steps  (97%)
10:42:26:WU00:FS00:0xa3:Completed 490000 out of 500000 steps  (98%)
10:55:11:WU00:FS00:0xa3:Completed 495000 out of 500000 steps  (99%)
10:55:56:WARNING:WU01:FS00:Exception: Could not get IP address for assign4.stanford.edu: No address associated with hostname
10:55:56:WU01:FS00:Connecting to 171.67.108.200:8080
10:58:03:WARNING:WU01:FS00:Failed to get assignment from '171.67.108.200:8080': Failed to connect to 171.67.108.200:8080: Connection timed out
10:58:03:ERROR:WU01:FS00:Exception: Could not get an assignment
10:58:14:WU01:FS00:Connecting to 171.67.108.200:8080
11:00:22:WARNING:WU01:FS00:Failed to get assignment from '171.67.108.200:8080': Failed to connect to 171.67.108.200:8080: Connection timed out
11:00:22:WU01:FS00:Connecting to 171.67.108.204:80
11:00:23:WARNING:WU01:FS00:Failed to get assignment from '171.67.108.204:80': Empty work server assignment
11:00:23:ERROR:WU01:FS00:Exception: Could not get an assignment
11:01:03:WARNING:WU01:FS00:Exception: Could not get IP address for assign3.stanford.edu: No address associated with hostname
11:01:03:ERROR:WU01:FS00:Exception: Could not get an assignment
11:02:31:WU01:FS00:Connecting to 171.67.108.200:8080
11:02:32:WU01:FS00:Assigned to work server 171.64.65.124
11:02:32:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:4 from 171.64.65.124
11:02:32:WU01:FS00:Connecting to 171.64.65.124:8080
11:02:33:WU01:FS00:Downloading 808.82KiB
11:02:34:WU01:FS00:Download complete
11:02:34:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9007 run:1557 clone:0 gen:105 core:0xa4 unit:0x0000007c664f2de453d81ba645e58229
******************************* Date: 2015-01-12 *******************************
11:07:54:WU00:FS00:0xa3:Completed 500000 out of 500000 steps  (100%)
11:07:54:WU00:FS00:0xa3:DynamicWrapper: Finished Work Unit: sleep=10000
11:08:04:WU00:FS00:0xa3:
11:08:04:WU00:FS00:0xa3:Finished Work Unit:
11:08:04:WU00:FS00:0xa3:- Reading up to 5030784 from "00/wudata_01.trr": Read 5030784
11:08:04:WU00:FS00:0xa3:trr file hash check passed.
11:08:04:WU00:FS00:0xa3:- Reading up to 5366512 from "00/wudata_01.xtc": Read 5366512
11:08:04:WU00:FS00:0xa3:xtc file hash check passed.
11:08:04:WU00:FS00:0xa3:edr file hash check passed.
11:08:04:WU00:FS00:0xa3:logfile size: 326936
11:08:04:WU00:FS00:0xa3:Leaving Run
11:08:05:WU00:FS00:0xa3:- Writing 10756636 bytes of core data to disk...
11:08:08:WU00:FS00:0xa3:Done: 10756124 -> 10182266 (compressed to 94.6 percent)
11:08:08:WU00:FS00:0xa3:  ... Done.
11:08:38:WU00:FS00:0xa3:- Shutting down core
11:08:38:WU00:FS00:0xa3:
11:08:38:WU00:FS00:0xa3:Folding@home Core Shutdown: FINISHED_UNIT
11:08:41:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
11:08:41:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:7504 run:10 clone:98 gen:59 core:0xa3 unit:0x00000055fbcb017d4e39c234b7067114
11:08:41:WU00:FS00:Uploading 9.71MiB to 128.143.199.97
11:08:41:WU00:FS00:Connecting to 128.143.199.97:8080
11:08:41:WU01:FS00:Starting
11:08:41:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 01 -suffix 01 -version 704 -lifeline 2552 -checkpoint 15 -np 4
11:08:41:WU01:FS00:Started FahCore on PID 12625
11:08:41:WU01:FS00:Core PID:12629
11:08:41:WU01:FS00:FahCore 0xa4 started
11:08:42:WU01:FS00:0xa4:
11:08:42:WU01:FS00:0xa4:*------------------------------*
11:08:42:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
11:08:42:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
11:08:42:WU01:FS00:0xa4:
11:08:42:WU01:FS00:0xa4:Preparing to commence simulation
11:08:42:WU01:FS00:0xa4:- Looking at optimizations...
11:08:42:WU01:FS00:0xa4:- Created dyn
11:08:42:WU01:FS00:0xa4:- Files status OK
11:08:42:WU01:FS00:0xa4:- Expanded 827718 -> 1400900 (decompressed 169.2 percent)
11:08:42:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=827718 data_size=1400900, decompressed_data_size=1400900 diff=0
11:08:42:WU01:FS00:0xa4:- Digital signature verified
11:08:42:WU01:FS00:0xa4:
11:08:42:WU01:FS00:0xa4:Project: 9007 (Run 1557, Clone 0, Gen 105)
11:08:42:WU01:FS00:0xa4:
11:08:42:WU01:FS00:0xa4:Assembly optimizations on if available.
11:08:42:WU01:FS00:0xa4:Entering M.D.
11:08:47:WU00:FS00:Upload 13.52%
11:08:48:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
11:08:53:WU00:FS00:Upload 26.39%
11:08:59:WU00:FS00:Upload 39.26%
11:09:05:WU00:FS00:Upload 52.77%
11:09:11:WU00:FS00:Upload 66.29%
11:09:17:WU00:FS00:Upload 80.45%
11:09:23:WU00:FS00:Upload 93.32%
11:09:28:WU00:FS00:Upload complete
11:09:29:WU00:FS00:Server responded WORK_ACK (400)
11:09:29:WU00:FS00:Final credit estimate, 2715.00 points
11:09:29:WU00:FS00:Cleaning up
11:13:04:WU01:FS00:0xa4:Completed 2500 out of 250000 steps  (1%)
11:17:33:WU01:FS00:0xa4:Completed 5000 out of 250000 steps  (2%)
11:22:03:WU01:FS00:0xa4:Completed 7500 out of 250000 steps  (3%)
11:26:31:WU01:FS00:0xa4:Completed 10000 out of 250000 steps  (4%)
11:30:53:WU01:FS00:0xa4:Completed 12500 out of 250000 steps  (5%)
11:35:23:WU01:FS00:0xa4:Completed 15000 out of 250000 steps  (6%)
11:39:45:WU01:FS00:0xa4:Completed 17500 out of 250000 steps  (7%)
11:44:12:WU01:FS00:0xa4:Completed 20000 out of 250000 steps  (8%)
11:48:39:WU01:FS00:0xa4:Completed 22500 out of 250000 steps  (9%)
11:53:01:WU01:FS00:0xa4:Completed 25000 out of 250000 steps  (10%)
11:57:25:WU01:FS00:0xa4:Completed 27500 out of 250000 steps  (11%)
12:01:56:WU01:FS00:0xa4:Completed 30000 out of 250000 steps  (12%)
12:06:19:WU01:FS00:0xa4:Completed 32500 out of 250000 steps  (13%)
12:10:44:WU01:FS00:0xa4:Completed 35000 out of 250000 steps  (14%)
12:15:12:WU01:FS00:0xa4:Completed 37500 out of 250000 steps  (15%)
12:19:38:WU01:FS00:0xa4:Completed 40000 out of 250000 steps  (16%)
12:24:04:WU01:FS00:0xa4:Completed 42500 out of 250000 steps  (17%)
12:28:44:WU01:FS00:0xa4:Completed 45000 out of 250000 steps  (18%)
12:33:17:WU01:FS00:0xa4:Completed 47500 out of 250000 steps  (19%)
12:37:41:WU01:FS00:0xa4:Completed 50000 out of 250000 steps  (20%)
12:42:06:WU01:FS00:0xa4:Completed 52500 out of 250000 steps  (21%)
12:46:32:WU01:FS00:0xa4:Completed 55000 out of 250000 steps  (22%)
12:50:57:WU01:FS00:0xa4:Completed 57500 out of 250000 steps  (23%)
12:55:19:WU01:FS00:0xa4:Completed 60000 out of 250000 steps  (24%)
12:59:43:WU01:FS00:0xa4:Completed 62500 out of 250000 steps  (25%)
13:04:09:WU01:FS00:0xa4:Completed 65000 out of 250000 steps  (26%)
13:08:39:WU01:FS00:0xa4:Completed 67500 out of 250000 steps  (27%)
13:13:03:WU01:FS00:0xa4:Completed 70000 out of 250000 steps  (28%)
13:17:29:WU01:FS00:0xa4:Completed 72500 out of 250000 steps  (29%)
13:21:52:WU01:FS00:0xa4:Completed 75000 out of 250000 steps  (30%)
13:26:14:WU01:FS00:0xa4:Completed 77500 out of 250000 steps  (31%)
13:30:43:WU01:FS00:0xa4:Completed 80000 out of 250000 steps  (32%)
13:35:18:WU01:FS00:0xa4:Completed 82500 out of 250000 steps  (33%)
13:39:54:WU01:FS00:0xa4:Completed 85000 out of 250000 steps  (34%)
13:44:28:WU01:FS00:0xa4:Completed 87500 out of 250000 steps  (35%)
13:49:06:WU01:FS00:0xa4:Completed 90000 out of 250000 steps  (36%)
13:53:41:WU01:FS00:0xa4:Completed 92500 out of 250000 steps  (37%)
13:58:10:WU01:FS00:0xa4:Completed 95000 out of 250000 steps  (38%)
14:02:34:WU01:FS00:0xa4:Completed 97500 out of 250000 steps  (39%)
14:06:57:WU01:FS00:0xa4:Completed 100000 out of 250000 steps  (40%)
14:11:26:WU01:FS00:0xa4:Completed 102500 out of 250000 steps  (41%)
14:15:48:WU01:FS00:0xa4:Completed 105000 out of 250000 steps  (42%)
14:20:07:WU01:FS00:0xa4:Completed 107500 out of 250000 steps  (43%)
14:24:27:WU01:FS00:0xa4:Completed 110000 out of 250000 steps  (44%)
14:28:53:WU01:FS00:0xa4:Completed 112500 out of 250000 steps  (45%)
14:33:13:WU01:FS00:0xa4:Completed 115000 out of 250000 steps  (46%)
14:37:32:WU01:FS00:0xa4:Completed 117500 out of 250000 steps  (47%)
14:42:01:WU01:FS00:0xa4:Completed 120000 out of 250000 steps  (48%)
14:46:25:WU01:FS00:0xa4:Completed 122500 out of 250000 steps  (49%)
14:50:50:WU01:FS00:0xa4:Completed 125000 out of 250000 steps  (50%)
14:55:22:WU01:FS00:0xa4:Completed 127500 out of 250000 steps  (51%)
14:59:45:WU01:FS00:0xa4:Completed 130000 out of 250000 steps  (52%)
15:04:11:WU01:FS00:0xa4:Completed 132500 out of 250000 steps  (53%)
15:08:40:WU01:FS00:0xa4:Completed 135000 out of 250000 steps  (54%)
15:13:08:WU01:FS00:0xa4:Completed 137500 out of 250000 steps  (55%)
15:17:30:WU01:FS00:0xa4:Completed 140000 out of 250000 steps  (56%)
15:21:56:WU01:FS00:0xa4:Completed 142500 out of 250000 steps  (57%)
15:26:24:WU01:FS00:0xa4:Completed 145000 out of 250000 steps  (58%)
15:30:44:WU01:FS00:0xa4:Completed 147500 out of 250000 steps  (59%)
15:35:13:WU01:FS00:0xa4:Completed 150000 out of 250000 steps  (60%)
15:39:44:WU01:FS00:0xa4:Completed 152500 out of 250000 steps  (61%)
15:44:09:WU01:FS00:0xa4:Completed 155000 out of 250000 steps  (62%)
15:48:27:WU01:FS00:0xa4:Completed 157500 out of 250000 steps  (63%)
15:52:58:WU01:FS00:0xa4:Completed 160000 out of 250000 steps  (64%)
15:57:31:WU01:FS00:0xa4:Completed 162500 out of 250000 steps  (65%)
16:02:00:WU01:FS00:0xa4:Completed 165000 out of 250000 steps  (66%)
16:06:30:WU01:FS00:0xa4:Completed 167500 out of 250000 steps  (67%)
16:11:05:WU01:FS00:0xa4:Completed 170000 out of 250000 steps  (68%)
16:15:26:WU01:FS00:0xa4:Completed 172500 out of 250000 steps  (69%)
16:19:46:WU01:FS00:0xa4:Completed 175000 out of 250000 steps  (70%)
16:24:06:WU01:FS00:0xa4:Completed 177500 out of 250000 steps  (71%)
16:28:34:WU01:FS00:0xa4:Completed 180000 out of 250000 steps  (72%)
16:32:56:WU01:FS00:0xa4:Completed 182500 out of 250000 steps  (73%)
16:37:20:WU01:FS00:0xa4:Completed 185000 out of 250000 steps  (74%)
16:41:47:WU01:FS00:0xa4:Completed 187500 out of 250000 steps  (75%)
16:46:06:WU01:FS00:0xa4:Completed 190000 out of 250000 steps  (76%)
16:50:32:WU01:FS00:0xa4:Completed 192500 out of 250000 steps  (77%)
16:55:06:WU01:FS00:0xa4:Completed 195000 out of 250000 steps  (78%)
16:59:35:WU01:FS00:0xa4:Completed 197500 out of 250000 steps  (79%)
17:04:01:WU01:FS00:0xa4:Completed 200000 out of 250000 steps  (80%)
******************************* Date: 2015-01-12 *******************************
17:08:22:WU01:FS00:0xa4:Completed 202500 out of 250000 steps  (81%)
17:12:48:WU01:FS00:0xa4:Completed 205000 out of 250000 steps  (82%)
17:17:09:WU01:FS00:0xa4:Completed 207500 out of 250000 steps  (83%)
17:21:32:WU01:FS00:0xa4:Completed 210000 out of 250000 steps  (84%)
17:26:01:WU01:FS00:0xa4:Completed 212500 out of 250000 steps  (85%)
17:30:24:WU01:FS00:0xa4:Completed 215000 out of 250000 steps  (86%)
17:34:48:WU01:FS00:0xa4:Completed 217500 out of 250000 steps  (87%)
17:39:15:WU01:FS00:0xa4:Completed 220000 out of 250000 steps  (88%)
17:43:53:WU01:FS00:0xa4:Completed 222500 out of 250000 steps  (89%)
17:48:22:WU01:FS00:0xa4:Completed 225000 out of 250000 steps  (90%)
17:52:49:WU01:FS00:0xa4:Completed 227500 out of 250000 steps  (91%)
17:57:22:WU01:FS00:0xa4:Completed 230000 out of 250000 steps  (92%)
18:01:46:WU01:FS00:0xa4:Completed 232500 out of 250000 steps  (93%)
18:06:09:WU01:FS00:0xa4:Completed 235000 out of 250000 steps  (94%)
18:10:33:WU01:FS00:0xa4:Completed 237500 out of 250000 steps  (95%)
18:14:55:WU01:FS00:0xa4:Completed 240000 out of 250000 steps  (96%)
18:19:16:WU01:FS00:0xa4:Completed 242500 out of 250000 steps  (97%)
18:23:40:WU01:FS00:0xa4:Completed 245000 out of 250000 steps  (98%)
18:28:08:WU01:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
18:28:09:WU00:FS00:Connecting to 171.67.108.200:8080
18:28:10:WU00:FS00:Assigned to work server 171.64.65.124
18:28:10:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:4 from 171.64.65.124
18:28:10:WU00:FS00:Connecting to 171.64.65.124:8080
18:28:11:WU00:FS00:Downloading 807.35KiB
18:28:12:WU00:FS00:Download complete
18:28:12:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9016 run:670 clone:0 gen:13 core:0xa4 unit:0x00000011664f2de45491dc1b580a3545
18:32:30:WU01:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
18:32:31:WU01:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
18:32:41:WU01:FS00:0xa4:
18:32:41:WU01:FS00:0xa4:Finished Work Unit:
18:32:41:WU01:FS00:0xa4:- Reading up to 811800 from "01/wudata_01.trr": Read 811800
18:32:41:WU01:FS00:0xa4:trr file hash check passed.
18:32:41:WU01:FS00:0xa4:- Reading up to 746860 from "01/wudata_01.xtc": Read 746860
18:32:41:WU01:FS00:0xa4:xtc file hash check passed.
18:32:41:WU01:FS00:0xa4:edr file hash check passed.
18:32:41:WU01:FS00:0xa4:logfile size: 24591
18:32:41:WU01:FS00:0xa4:Leaving Run
18:32:44:WU01:FS00:0xa4:- Writing 1585739 bytes of core data to disk...
18:32:44:WU01:FS00:0xa4:Done: 1585227 -> 1539111 (compressed to 97.0 percent)
18:32:44:WU01:FS00:0xa4:  ... Done.
18:32:54:WU01:FS00:0xa4:- Shutting down core
18:32:54:WU01:FS00:0xa4:
18:32:54:WU01:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
18:32:55:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
18:32:55:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:9007 run:1557 clone:0 gen:105 core:0xa4 unit:0x0000007c664f2de453d81ba645e58229
18:32:55:WU01:FS00:Uploading 1.47MiB to 171.64.65.124
18:32:55:WU01:FS00:Connecting to 171.64.65.124:8080
18:32:55:WU00:FS00:Starting
18:32:55:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 00 -suffix 01 -version 704 -lifeline 2552 -checkpoint 15 -np 4
18:32:55:WU00:FS00:Started FahCore on PID 15115
18:32:55:WU00:FS00:Core PID:15119
18:32:55:WU00:FS00:FahCore 0xa4 started
18:32:56:WU00:FS00:0xa4:
18:32:56:WU00:FS00:0xa4:*------------------------------*
18:32:56:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
18:32:56:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
18:32:56:WU00:FS00:0xa4:
18:32:56:WU00:FS00:0xa4:Preparing to commence simulation
18:32:56:WU00:FS00:0xa4:- Looking at optimizations...
18:32:56:WU00:FS00:0xa4:- Created dyn
18:32:56:WU00:FS00:0xa4:- Files status OK
18:32:56:WU00:FS00:0xa4:- Expanded 826210 -> 1397548 (decompressed 169.1 percent)
18:32:56:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=826210 data_size=1397548, decompressed_data_size=1397548 diff=0
18:32:56:WU00:FS00:0xa4:- Digital signature verified
18:32:56:WU00:FS00:0xa4:
18:32:56:WU00:FS00:0xa4:Project: 9016 (Run 670, Clone 0, Gen 13)
18:32:56:WU00:FS00:0xa4:
18:32:56:WU00:FS00:0xa4:Assembly optimizations on if available.
18:32:56:WU00:FS00:0xa4:Entering M.D.
18:33:01:WU01:FS00:Upload 76.62%
18:33:02:WU00:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
18:33:03:WU01:FS00:Upload complete
18:33:03:WU01:FS00:Server responded WORK_ACK (400)
18:33:03:WU01:FS00:Final credit estimate, 924.00 points
18:33:03:WU01:FS00:Cleaning up
18:37:15:WU00:FS00:0xa4:Completed 2500 out of 250000 steps  (1%)
18:41:39:WU00:FS00:0xa4:Completed 5000 out of 250000 steps  (2%)
18:45:50:WU00:FS00:0xa4:Completed 7500 out of 250000 steps  (3%)
18:50:01:WU00:FS00:0xa4:Completed 10000 out of 250000 steps  (4%)
18:54:15:WU00:FS00:0xa4:Completed 12500 out of 250000 steps  (5%)
18:58:33:WU00:FS00:0xa4:Completed 15000 out of 250000 steps  (6%)
19:02:46:WU00:FS00:0xa4:Completed 17500 out of 250000 steps  (7%)
19:07:02:WU00:FS00:0xa4:Completed 20000 out of 250000 steps  (8%)
19:11:21:WU00:FS00:0xa4:Completed 22500 out of 250000 steps  (9%)
19:15:34:WU00:FS00:0xa4:Completed 25000 out of 250000 steps  (10%)
19:19:47:WU00:FS00:0xa4:Completed 27500 out of 250000 steps  (11%)
19:24:04:WU00:FS00:0xa4:Completed 30000 out of 250000 steps  (12%)
19:28:22:WU00:FS00:0xa4:Completed 32500 out of 250000 steps  (13%)
19:32:33:WU00:FS00:0xa4:Completed 35000 out of 250000 steps  (14%)
19:36:49:WU00:FS00:0xa4:Completed 37500 out of 250000 steps  (15%)
19:41:05:WU00:FS00:0xa4:Completed 40000 out of 250000 steps  (16%)
19:45:17:WU00:FS00:0xa4:Completed 42500 out of 250000 steps  (17%)
19:49:33:WU00:FS00:0xa4:Completed 45000 out of 250000 steps  (18%)
19:53:54:WU00:FS00:0xa4:Completed 47500 out of 250000 steps  (19%)
19:58:14:WU00:FS00:0xa4:Completed 50000 out of 250000 steps  (20%)
20:02:27:WU00:FS00:0xa4:Completed 52500 out of 250000 steps  (21%)
20:06:47:WU00:FS00:0xa4:Completed 55000 out of 250000 steps  (22%)
20:11:30:WU00:FS00:0xa4:Completed 57500 out of 250000 steps  (23%)
20:16:12:WU00:FS00:0xa4:Completed 60000 out of 250000 steps  (24%)
20:20:50:WU00:FS00:0xa4:Completed 62500 out of 250000 steps  (25%)
20:25:35:WU00:FS00:0xa4:Completed 65000 out of 250000 steps  (26%)
20:30:08:WU00:FS00:0xa4:Completed 67500 out of 250000 steps  (27%)
20:34:46:WU00:FS00:0xa4:Completed 70000 out of 250000 steps  (28%)
20:39:23:WU00:FS00:0xa4:Completed 72500 out of 250000 steps  (29%)
20:44:03:WU00:FS00:0xa4:Completed 75000 out of 250000 steps  (30%)
20:48:38:WU00:FS00:0xa4:Completed 77500 out of 250000 steps  (31%)
20:53:12:WU00:FS00:0xa4:Completed 80000 out of 250000 steps  (32%)
20:57:52:WU00:FS00:0xa4:Completed 82500 out of 250000 steps  (33%)
21:02:24:WU00:FS00:0xa4:Completed 85000 out of 250000 steps  (34%)
21:06:57:WU00:FS00:0xa4:Completed 87500 out of 250000 steps  (35%)
21:11:32:WU00:FS00:0xa4:Completed 90000 out of 250000 steps  (36%)
21:15:52:WU00:FS00:0xa4:Completed 92500 out of 250000 steps  (37%)
21:20:06:WU00:FS00:0xa4:Completed 95000 out of 250000 steps  (38%)
21:24:23:WU00:FS00:0xa4:Completed 97500 out of 250000 steps  (39%)
21:28:46:WU00:FS00:0xa4:Completed 100000 out of 250000 steps  (40%)
21:32:58:WU00:FS00:0xa4:Completed 102500 out of 250000 steps  (41%)
21:37:12:WU00:FS00:0xa4:Completed 105000 out of 250000 steps  (42%)
21:41:32:WU00:FS00:0xa4:Completed 107500 out of 250000 steps  (43%)
21:45:49:WU00:FS00:0xa4:Completed 110000 out of 250000 steps  (44%)
21:50:06:WU00:FS00:0xa4:Completed 112500 out of 250000 steps  (45%)
21:54:22:WU00:FS00:0xa4:Completed 115000 out of 250000 steps  (46%)
21:58:44:WU00:FS00:0xa4:Completed 117500 out of 250000 steps  (47%)
22:03:02:WU00:FS00:0xa4:Completed 120000 out of 250000 steps  (48%)
22:07:16:WU00:FS00:0xa4:Completed 122500 out of 250000 steps  (49%)
22:11:40:WU00:FS00:0xa4:Completed 125000 out of 250000 steps  (50%)
22:15:54:WU00:FS00:0xa4:Completed 127500 out of 250000 steps  (51%)
22:20:08:WU00:FS00:0xa4:Completed 130000 out of 250000 steps  (52%)
22:24:22:WU00:FS00:0xa4:Completed 132500 out of 250000 steps  (53%)
22:28:44:WU00:FS00:0xa4:Completed 135000 out of 250000 steps  (54%)
22:33:02:WU00:FS00:0xa4:Completed 137500 out of 250000 steps  (55%)
22:37:25:WU00:FS00:0xa4:Completed 140000 out of 250000 steps  (56%)
22:41:57:WU00:FS00:0xa4:Completed 142500 out of 250000 steps  (57%)
22:46:30:WU00:FS00:0xa4:Completed 145000 out of 250000 steps  (58%)
22:51:06:WU00:FS00:0xa4:Completed 147500 out of 250000 steps  (59%)
22:55:51:WU00:FS00:0xa4:Completed 150000 out of 250000 steps  (60%)
23:00:18:WU00:FS00:0xa4:Completed 152500 out of 250000 steps  (61%)
23:04:43:WU00:FS00:0xa4:Completed 155000 out of 250000 steps  (62%)
******************************* Date: 2015-01-12 *******************************
23:09:08:WU00:FS00:0xa4:Completed 157500 out of 250000 steps  (63%)
23:13:48:WU00:FS00:0xa4:Completed 160000 out of 250000 steps  (64%)
23:18:15:WU00:FS00:0xa4:Completed 162500 out of 250000 steps  (65%)
23:22:44:WU00:FS00:0xa4:Completed 165000 out of 250000 steps  (66%)
23:27:25:WU00:FS00:0xa4:Completed 167500 out of 250000 steps  (67%)
23:32:01:WU00:FS00:0xa4:Completed 170000 out of 250000 steps  (68%)
23:36:35:WU00:FS00:0xa4:Completed 172500 out of 250000 steps  (69%)
23:41:08:WU00:FS00:0xa4:Completed 175000 out of 250000 steps  (70%)
23:45:40:WU00:FS00:0xa4:Completed 177500 out of 250000 steps  (71%)
23:50:13:WU00:FS00:0xa4:Completed 180000 out of 250000 steps  (72%)
23:54:44:WU00:FS00:0xa4:Completed 182500 out of 250000 steps  (73%)
23:59:16:WU00:FS00:0xa4:Completed 185000 out of 250000 steps  (74%)
00:03:46:WU00:FS00:0xa4:Completed 187500 out of 250000 steps  (75%)
00:08:24:WU00:FS00:0xa4:Completed 190000 out of 250000 steps  (76%)
00:13:05:WU00:FS00:0xa4:Completed 192500 out of 250000 steps  (77%)
00:17:38:WU00:FS00:0xa4:Completed 195000 out of 250000 steps  (78%)
00:22:07:WU00:FS00:0xa4:Completed 197500 out of 250000 steps  (79%)
00:26:41:WU00:FS00:0xa4:Completed 200000 out of 250000 steps  (80%)
00:31:10:WU00:FS00:0xa4:Completed 202500 out of 250000 steps  (81%)
00:35:40:WU00:FS00:0xa4:Completed 205000 out of 250000 steps  (82%)
00:40:15:WU00:FS00:0xa4:Completed 207500 out of 250000 steps  (83%)
00:44:52:WU00:FS00:0xa4:Completed 210000 out of 250000 steps  (84%)
00:49:27:WU00:FS00:0xa4:Completed 212500 out of 250000 steps  (85%)
00:54:00:WU00:FS00:0xa4:Completed 215000 out of 250000 steps  (86%)
00:58:34:WU00:FS00:0xa4:Completed 217500 out of 250000 steps  (87%)
01:03:07:WU00:FS00:0xa4:Completed 220000 out of 250000 steps  (88%)
01:07:40:WU00:FS00:0xa4:Completed 222500 out of 250000 steps  (89%)
01:12:18:WU00:FS00:0xa4:Completed 225000 out of 250000 steps  (90%)
01:16:52:WU00:FS00:0xa4:Completed 227500 out of 250000 steps  (91%)
01:21:31:WU00:FS00:0xa4:Completed 230000 out of 250000 steps  (92%)
01:26:12:WU00:FS00:0xa4:Completed 232500 out of 250000 steps  (93%)
01:30:41:WU00:FS00:0xa4:Completed 235000 out of 250000 steps  (94%)
01:35:08:WU00:FS00:0xa4:Completed 237500 out of 250000 steps  (95%)
01:39:36:WU00:FS00:0xa4:Completed 240000 out of 250000 steps  (96%)
01:44:11:WU00:FS00:0xa4:Completed 242500 out of 250000 steps  (97%)
01:48:39:WU00:FS00:0xa4:Completed 245000 out of 250000 steps  (98%)
01:53:06:WU00:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
01:53:07:WU01:FS00:Connecting to 171.67.108.200:8080
01:53:08:WU01:FS00:Assigned to work server 171.64.65.124
01:53:08:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:4 from 171.64.65.124
01:53:08:WU01:FS00:Connecting to 171.64.65.124:8080
01:53:09:WU01:FS00:Downloading 860.68KiB
01:53:10:WU01:FS00:Download complete
01:53:10:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9008 run:524 clone:0 gen:58 core:0xa4 unit:0x0000004e664f2de453826c8b0d2da78c
01:57:44:WU00:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
01:57:44:WU00:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
01:57:54:WU00:FS00:0xa4:
01:57:54:WU00:FS00:0xa4:Finished Work Unit:
01:57:54:WU00:FS00:0xa4:- Reading up to 811488 from "00/wudata_01.trr": Read 811488
01:57:54:WU00:FS00:0xa4:trr file hash check passed.
01:57:54:WU00:FS00:0xa4:- Reading up to 746004 from "00/wudata_01.xtc": Read 746004
01:57:54:WU00:FS00:0xa4:xtc file hash check passed.
01:57:54:WU00:FS00:0xa4:edr file hash check passed.
01:57:54:WU00:FS00:0xa4:logfile size: 24546
01:57:54:WU00:FS00:0xa4:Leaving Run
01:57:58:WU00:FS00:0xa4:- Writing 1584526 bytes of core data to disk...
01:57:58:WU00:FS00:0xa4:Done: 1584014 -> 1538064 (compressed to 97.0 percent)
01:57:58:WU00:FS00:0xa4:  ... Done.
01:58:08:WU00:FS00:0xa4:- Shutting down core
01:58:08:WU00:FS00:0xa4:
01:58:08:WU00:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
01:58:09:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
01:58:09:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:9016 run:670 clone:0 gen:13 core:0xa4 unit:0x00000011664f2de45491dc1b580a3545
01:58:09:WU00:FS00:Uploading 1.47MiB to 171.64.65.124
01:58:09:WU00:FS00:Connecting to 171.64.65.124:8080
01:58:10:WU01:FS00:Starting
01:58:10:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 01 -suffix 01 -version 704 -lifeline 2552 -checkpoint 15 -np 4
01:58:10:WU01:FS00:Started FahCore on PID 17521
01:58:10:WU01:FS00:Core PID:17525
01:58:10:WU01:FS00:FahCore 0xa4 started
01:58:10:WU01:FS00:0xa4:
01:58:10:WU01:FS00:0xa4:*------------------------------*
01:58:10:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
01:58:10:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
01:58:10:WU01:FS00:0xa4:
01:58:10:WU01:FS00:0xa4:Preparing to commence simulation
01:58:10:WU01:FS00:0xa4:- Looking at optimizations...
01:58:10:WU01:FS00:0xa4:- Created dyn
01:58:10:WU01:FS00:0xa4:- Files status OK
01:58:10:WU01:FS00:0xa4:- Expanded 880824 -> 1463992 (decompressed 166.2 percent)
01:58:10:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=880824 data_size=1463992, decompressed_data_size=1463992 diff=0
01:58:10:WU01:FS00:0xa4:- Digital signature verified
01:58:10:WU01:FS00:0xa4:
01:58:10:WU01:FS00:0xa4:Project: 9008 (Run 524, Clone 0, Gen 58)
01:58:10:WU01:FS00:0xa4:
01:58:10:WU01:FS00:0xa4:Assembly optimizations on if available.
01:58:10:WU01:FS00:0xa4:Entering M.D.
01:58:15:WU00:FS00:Upload 76.67%
01:58:16:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
01:58:17:WU00:FS00:Upload complete
01:58:17:WU00:FS00:Server responded WORK_ACK (400)
01:58:17:WU00:FS00:Final credit estimate, 924.00 points
01:58:17:WU00:FS00:Cleaning up
02:02:47:WU01:FS00:0xa4:Completed 2500 out of 250000 steps  (1%)
02:07:24:WU01:FS00:0xa4:Completed 5000 out of 250000 steps  (2%)
02:12:04:WU01:FS00:0xa4:Completed 7500 out of 250000 steps  (3%)
02:16:40:WU01:FS00:0xa4:Completed 10000 out of 250000 steps  (4%)
02:21:14:WU01:FS00:0xa4:Completed 12500 out of 250000 steps  (5%)
02:25:58:WU01:FS00:0xa4:Completed 15000 out of 250000 steps  (6%)
02:30:37:WU01:FS00:0xa4:Completed 17500 out of 250000 steps  (7%)
02:35:12:WU01:FS00:0xa4:Completed 20000 out of 250000 steps  (8%)
02:39:50:WU01:FS00:0xa4:Completed 22500 out of 250000 steps  (9%)
02:44:29:WU01:FS00:0xa4:Completed 25000 out of 250000 steps  (10%)
02:49:11:WU01:FS00:0xa4:Completed 27500 out of 250000 steps  (11%)
02:53:55:WU01:FS00:0xa4:Completed 30000 out of 250000 steps  (12%)
02:58:44:WU01:FS00:0xa4:Completed 32500 out of 250000 steps  (13%)
03:03:27:WU01:FS00:0xa4:Completed 35000 out of 250000 steps  (14%)
03:08:09:WU01:FS00:0xa4:Completed 37500 out of 250000 steps  (15%)
03:12:56:WU01:FS00:0xa4:Completed 40000 out of 250000 steps  (16%)
03:17:41:WU01:FS00:0xa4:Completed 42500 out of 250000 steps  (17%)
03:22:20:WU01:FS00:0xa4:Completed 45000 out of 250000 steps  (18%)
03:27:02:WU01:FS00:0xa4:Completed 47500 out of 250000 steps  (19%)
03:31:36:WU01:FS00:0xa4:Completed 50000 out of 250000 steps  (20%)
03:36:12:WU01:FS00:0xa4:Completed 52500 out of 250000 steps  (21%)
03:40:56:WU01:FS00:0xa4:Completed 55000 out of 250000 steps  (22%)
03:45:35:WU01:FS00:0xa4:Completed 57500 out of 250000 steps  (23%)
03:50:18:WU01:FS00:0xa4:Completed 60000 out of 250000 steps  (24%)
03:55:00:WU01:FS00:0xa4:Completed 62500 out of 250000 steps  (25%)
03:59:38:WU01:FS00:0xa4:Completed 65000 out of 250000 steps  (26%)
04:04:18:WU01:FS00:0xa4:Completed 67500 out of 250000 steps  (27%)
04:09:07:WU01:FS00:0xa4:Completed 70000 out of 250000 steps  (28%)
04:14:03:WU01:FS00:0xa4:Completed 72500 out of 250000 steps  (29%)
04:18:55:WU01:FS00:0xa4:Completed 75000 out of 250000 steps  (30%)
04:23:56:WU01:FS00:0xa4:Completed 77500 out of 250000 steps  (31%)
04:28:55:WU01:FS00:0xa4:Completed 80000 out of 250000 steps  (32%)
04:33:54:WU01:FS00:0xa4:Completed 82500 out of 250000 steps  (33%)
04:38:47:WU01:FS00:0xa4:Completed 85000 out of 250000 steps  (34%)
04:43:39:WU01:FS00:0xa4:Completed 87500 out of 250000 steps  (35%)
04:48:19:WU01:FS00:0xa4:Completed 90000 out of 250000 steps  (36%)
04:53:06:WU01:FS00:0xa4:Completed 92500 out of 250000 steps  (37%)
04:57:56:WU01:FS00:0xa4:Completed 95000 out of 250000 steps  (38%)
05:02:47:WU01:FS00:0xa4:Completed 97500 out of 250000 steps  (39%)
05:07:35:WU01:FS00:0xa4:Completed 100000 out of 250000 steps  (40%)
******************************* Date: 2015-01-13 *******************************
05:12:28:WU01:FS00:0xa4:Completed 102500 out of 250000 steps  (41%)
05:17:17:WU01:FS00:0xa4:Completed 105000 out of 250000 steps  (42%)
05:22:06:WU01:FS00:0xa4:Completed 107500 out of 250000 steps  (43%)
05:26:58:WU01:FS00:0xa4:Completed 110000 out of 250000 steps  (44%)
05:31:44:WU01:FS00:0xa4:Completed 112500 out of 250000 steps  (45%)
05:36:33:WU01:FS00:0xa4:Completed 115000 out of 250000 steps  (46%)
05:41:29:WU01:FS00:0xa4:Completed 117500 out of 250000 steps  (47%)
05:46:17:WU01:FS00:0xa4:Completed 120000 out of 250000 steps  (48%)
05:51:03:WU01:FS00:0xa4:Completed 122500 out of 250000 steps  (49%)
05:55:50:WU01:FS00:0xa4:Completed 125000 out of 250000 steps  (50%)
06:00:34:WU01:FS00:0xa4:Completed 127500 out of 250000 steps  (51%)
06:05:13:WU01:FS00:0xa4:Completed 130000 out of 250000 steps  (52%)
06:09:57:WU01:FS00:0xa4:Completed 132500 out of 250000 steps  (53%)
06:14:46:WU01:FS00:0xa4:Completed 135000 out of 250000 steps  (54%)
06:19:37:WU01:FS00:0xa4:Completed 137500 out of 250000 steps  (55%)
06:24:24:WU01:FS00:0xa4:Completed 140000 out of 250000 steps  (56%)
06:29:14:WU01:FS00:0xa4:Completed 142500 out of 250000 steps  (57%)
06:33:55:WU01:FS00:0xa4:Completed 145000 out of 250000 steps  (58%)
06:38:31:WU01:FS00:0xa4:Completed 147500 out of 250000 steps  (59%)
06:43:18:WU01:FS00:0xa4:Completed 150000 out of 250000 steps  (60%)
06:47:59:WU01:FS00:0xa4:Completed 152500 out of 250000 steps  (61%)
06:52:45:WU01:FS00:0xa4:Completed 155000 out of 250000 steps  (62%)
06:57:45:WU01:FS00:0xa4:Completed 157500 out of 250000 steps  (63%)
07:02:40:WU01:FS00:0xa4:Completed 160000 out of 250000 steps  (64%)
07:07:31:WU01:FS00:0xa4:Completed 162500 out of 250000 steps  (65%)
07:12:33:WU01:FS00:0xa4:Completed 165000 out of 250000 steps  (66%)
07:17:33:WU01:FS00:0xa4:Completed 167500 out of 250000 steps  (67%)
07:22:24:WU01:FS00:0xa4:Completed 170000 out of 250000 steps  (68%)
07:27:24:WU01:FS00:0xa4:Completed 172500 out of 250000 steps  (69%)
07:32:10:WU01:FS00:0xa4:Completed 175000 out of 250000 steps  (70%)
07:36:59:WU01:FS00:0xa4:Completed 177500 out of 250000 steps  (71%)
07:41:52:WU01:FS00:0xa4:Completed 180000 out of 250000 steps  (72%)
07:46:38:WU01:FS00:0xa4:Completed 182500 out of 250000 steps  (73%)
07:51:24:WU01:FS00:0xa4:Completed 185000 out of 250000 steps  (74%)
07:56:17:WU01:FS00:0xa4:Completed 187500 out of 250000 steps  (75%)
08:01:10:WU01:FS00:0xa4:Completed 190000 out of 250000 steps  (76%)
08:06:01:WU01:FS00:0xa4:Completed 192500 out of 250000 steps  (77%)
08:10:57:WU01:FS00:0xa4:Completed 195000 out of 250000 steps  (78%)
08:15:44:WU01:FS00:0xa4:Completed 197500 out of 250000 steps  (79%)
08:20:31:WU01:FS00:0xa4:Completed 200000 out of 250000 steps  (80%)
08:25:20:WU01:FS00:0xa4:Completed 202500 out of 250000 steps  (81%)
08:30:06:WU01:FS00:0xa4:Completed 205000 out of 250000 steps  (82%)
08:34:58:WU01:FS00:0xa4:Completed 207500 out of 250000 steps  (83%)
08:39:51:WU01:FS00:0xa4:Completed 210000 out of 250000 steps  (84%)
08:44:39:WU01:FS00:0xa4:Completed 212500 out of 250000 steps  (85%)
08:49:22:WU01:FS00:0xa4:Completed 215000 out of 250000 steps  (86%)
08:54:06:WU01:FS00:0xa4:Completed 217500 out of 250000 steps  (87%)
08:58:57:WU01:FS00:0xa4:Completed 220000 out of 250000 steps  (88%)
09:03:42:WU01:FS00:0xa4:Completed 222500 out of 250000 steps  (89%)
09:08:27:WU01:FS00:0xa4:Completed 225000 out of 250000 steps  (90%)
09:13:20:WU01:FS00:0xa4:Completed 227500 out of 250000 steps  (91%)
09:18:05:WU01:FS00:0xa4:Completed 230000 out of 250000 steps  (92%)
09:22:49:WU01:FS00:0xa4:Completed 232500 out of 250000 steps  (93%)
09:27:40:WU01:FS00:0xa4:Completed 235000 out of 250000 steps  (94%)
09:32:14:WU01:FS00:0xa4:Completed 237500 out of 250000 steps  (95%)
09:36:46:WU01:FS00:0xa4:Completed 240000 out of 250000 steps  (96%)
09:41:22:WU01:FS00:0xa4:Completed 242500 out of 250000 steps  (97%)
09:45:52:WU01:FS00:0xa4:Completed 245000 out of 250000 steps  (98%)
09:50:25:WU01:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
09:50:31:WU00:FS00:Connecting to 171.67.108.200:8080
09:50:33:WU00:FS00:Assigned to work server 171.64.65.124
09:50:33:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:4 from 171.64.65.124
09:50:33:WU00:FS00:Connecting to 171.64.65.124:8080
09:50:35:WU00:FS00:Downloading 711.07KiB
09:50:35:WU00:FS00:Download complete
09:50:35:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9014 run:472 clone:10 gen:0 core:0xa4 unit:0x00000001664f2de454aeb06701eb2bc3
09:55:03:WU01:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
09:55:04:WU01:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
09:55:14:WU01:FS00:0xa4:
09:55:14:WU01:FS00:0xa4:Finished Work Unit:
09:55:14:WU01:FS00:0xa4:- Reading up to 871872 from "01/wudata_01.trr": Read 871872
09:55:14:WU01:FS00:0xa4:trr file hash check passed.
09:55:14:WU01:FS00:0xa4:- Reading up to 799756 from "01/wudata_01.xtc": Read 799756
09:55:14:WU01:FS00:0xa4:xtc file hash check passed.
09:55:14:WU01:FS00:0xa4:edr file hash check passed.
09:55:14:WU01:FS00:0xa4:logfile size: 24869
09:55:14:WU01:FS00:0xa4:Leaving Run
09:55:18:WU01:FS00:0xa4:- Writing 1698985 bytes of core data to disk...
09:55:19:WU01:FS00:0xa4:Done: 1698473 -> 1645844 (compressed to 96.9 percent)
09:55:19:WU01:FS00:0xa4:  ... Done.
09:55:29:WU01:FS00:0xa4:- Shutting down core
09:55:29:WU01:FS00:0xa4:
09:55:29:WU01:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
09:55:30:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
09:55:30:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:9008 run:524 clone:0 gen:58 core:0xa4 unit:0x0000004e664f2de453826c8b0d2da78c
09:55:30:WU01:FS00:Uploading 1.57MiB to 171.64.65.124
09:55:30:WU01:FS00:Connecting to 171.64.65.124:8080
09:55:30:WU00:FS00:Starting
09:55:30:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 00 -suffix 01 -version 704 -lifeline 2552 -checkpoint 15 -np 4
09:55:30:WU00:FS00:Started FahCore on PID 19927
09:55:30:WU00:FS00:Core PID:19931
09:55:30:WU00:FS00:FahCore 0xa4 started
09:55:31:WU00:FS00:0xa4:
09:55:31:WU00:FS00:0xa4:*------------------------------*
09:55:31:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
09:55:31:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
09:55:31:WU00:FS00:0xa4:
09:55:31:WU00:FS00:0xa4:Preparing to commence simulation
09:55:31:WU00:FS00:0xa4:- Looking at optimizations...
09:55:31:WU00:FS00:0xa4:- Created dyn
09:55:31:WU00:FS00:0xa4:- Files status OK
09:55:31:WU00:FS00:0xa4:- Expanded 727619 -> 1534204 (decompressed 210.8 percent)
09:55:31:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=727619 data_size=1534204, decompressed_data_size=1534204 diff=0
09:55:31:WU00:FS00:0xa4:- Digital signature verified
09:55:31:WU00:FS00:0xa4:
09:55:31:WU00:FS00:0xa4:Project: 9014 (Run 472, Clone 10, Gen 0)
09:55:31:WU00:FS00:0xa4:
09:55:31:WU00:FS00:0xa4:Assembly optimizations on if available.
09:55:31:WU00:FS00:0xa4:Entering M.D.
09:55:36:WU01:FS00:Upload 71.65%
09:55:37:WU00:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
09:55:39:WU01:FS00:Upload complete
09:55:39:WU01:FS00:Server responded WORK_ACK (400)
09:55:39:WU01:FS00:Final credit estimate, 930.00 points
09:55:39:WU01:FS00:Cleaning up
10:00:07:WU00:FS00:0xa4:Completed 2500 out of 250000 steps  (1%)
10:04:48:WU00:FS00:0xa4:Completed 5000 out of 250000 steps  (2%)
10:09:24:WU00:FS00:0xa4:Completed 7500 out of 250000 steps  (3%)
10:14:09:WU00:FS00:0xa4:Completed 10000 out of 250000 steps  (4%)
10:18:49:WU00:FS00:0xa4:Completed 12500 out of 250000 steps  (5%)
10:23:32:WU00:FS00:0xa4:Completed 15000 out of 250000 steps  (6%)
10:28:20:WU00:FS00:0xa4:Completed 17500 out of 250000 steps  (7%)
10:32:58:WU00:FS00:0xa4:Completed 20000 out of 250000 steps  (8%)
10:37:38:WU00:FS00:0xa4:Completed 22500 out of 250000 steps  (9%)
10:42:20:WU00:FS00:0xa4:Completed 25000 out of 250000 steps  (10%)
10:46:57:WU00:FS00:0xa4:Completed 27500 out of 250000 steps  (11%)
10:51:33:WU00:FS00:0xa4:Completed 30000 out of 250000 steps  (12%)
10:56:13:WU00:FS00:0xa4:Completed 32500 out of 250000 steps  (13%)
11:00:50:WU00:FS00:0xa4:Completed 35000 out of 250000 steps  (14%)
11:05:25:WU00:FS00:0xa4:Completed 37500 out of 250000 steps  (15%)
11:10:04:WU00:FS00:0xa4:Completed 40000 out of 250000 steps  (16%)
******************************* Date: 2015-01-13 *******************************
11:14:42:WU00:FS00:0xa4:Completed 42500 out of 250000 steps  (17%)
11:19:20:WU00:FS00:0xa4:Completed 45000 out of 250000 steps  (18%)
11:23:57:WU00:FS00:0xa4:Completed 47500 out of 250000 steps  (19%)
11:28:44:WU00:FS00:0xa4:Completed 50000 out of 250000 steps  (20%)

(I edited the log here to make it short enough to post)

17:04:43:WU00:FS00:0xa4:Completed 230000 out of 250000 steps  (92%)
17:09:19:WU00:FS00:0xa4:Completed 232500 out of 250000 steps  (93%)
17:14:01:WU00:FS00:0xa4:Completed 235000 out of 250000 steps  (94%)
******************************* Date: 2015-01-13 *******************************
17:18:36:WU00:FS00:0xa4:Completed 237500 out of 250000 steps  (95%)
17:23:10:WU00:FS00:0xa4:Completed 240000 out of 250000 steps  (96%)
17:27:49:WU00:FS00:0xa4:Completed 242500 out of 250000 steps  (97%)
17:32:24:WU00:FS00:0xa4:Completed 245000 out of 250000 steps  (98%)
17:37:00:WU00:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
17:37:01:WU01:FS00:Connecting to 171.67.108.200:8080
17:37:02:WU01:FS00:Assigned to work server 171.64.65.81
17:37:02:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:4 from 171.64.65.81
17:37:02:WU01:FS00:Connecting to 171.64.65.81:8080
17:37:02:WU01:FS00:Downloading 367.32KiB
17:37:03:WU01:FS00:Download complete
17:37:03:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:10450 run:182 clone:2 gen:45 core:0xa4 unit:0x000000370a3b1e75542ee05ae3b18a72
17:41:45:WU00:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
17:41:45:WU00:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
17:41:55:WU00:FS00:0xa4:
17:41:55:WU00:FS00:0xa4:Finished Work Unit:
17:41:55:WU00:FS00:0xa4:- Reading up to 915792 from "00/wudata_01.trr": Read 915792
17:41:55:WU00:FS00:0xa4:trr file hash check passed.
17:41:55:WU00:FS00:0xa4:- Reading up to 839280 from "00/wudata_01.xtc": Read 839280
17:41:55:WU00:FS00:0xa4:xtc file hash check passed.
17:41:55:WU00:FS00:0xa4:edr file hash check passed.
17:41:55:WU00:FS00:0xa4:logfile size: 24424
17:41:55:WU00:FS00:0xa4:Leaving Run
17:41:59:WU00:FS00:0xa4:- Writing 1781984 bytes of core data to disk...
17:42:00:WU00:FS00:0xa4:Done: 1781472 -> 1721769 (compressed to 96.6 percent)
17:42:00:WU00:FS00:0xa4:  ... Done.
17:42:10:WU00:FS00:0xa4:- Shutting down core
17:42:10:WU00:FS00:0xa4:
17:42:10:WU00:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
17:42:12:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
17:42:12:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:9014 run:472 clone:10 gen:0 core:0xa4 unit:0x00000001664f2de454aeb06701eb2bc3
17:42:12:WU00:FS00:Uploading 1.64MiB to 171.64.65.124
17:42:12:WU00:FS00:Connecting to 171.64.65.124:8080
17:42:12:WU01:FS00:Starting
17:42:12:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 01 -suffix 01 -version 704 -lifeline 2552 -checkpoint 15 -np 4
17:42:12:WU01:FS00:Started FahCore on PID 22520
17:42:12:WU01:FS00:Core PID:22524
17:42:12:WU01:FS00:FahCore 0xa4 started
17:42:12:WU01:FS00:0xa4:
17:42:12:WU01:FS00:0xa4:*------------------------------*
17:42:12:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
17:42:12:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
17:42:12:WU01:FS00:0xa4:
17:42:12:WU01:FS00:0xa4:Preparing to commence simulation
17:42:12:WU01:FS00:0xa4:- Looking at optimizations...
17:42:12:WU01:FS00:0xa4:- Created dyn
17:42:12:WU01:FS00:0xa4:- Files status OK
17:42:12:WU01:FS00:0xa4:- Expanded 375626 -> 690140 (decompressed 183.7 percent)
17:42:12:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=375626 data_size=690140, decompressed_data_size=690140 diff=0
17:42:12:WU01:FS00:0xa4:- Digital signature verified
17:42:12:WU01:FS00:0xa4:
17:42:12:WU01:FS00:0xa4:Project: 10450 (Run 182, Clone 2, Gen 45)
17:42:12:WU01:FS00:0xa4:
17:42:12:WU01:FS00:0xa4:Assembly optimizations on if available.
17:42:12:WU01:FS00:0xa4:Entering M.D.
17:42:18:WU00:FS00:Upload 83.71%
17:42:18:WU01:FS00:0xa4:Completed 0 out of 2000000 steps  (0%)
17:42:20:WU00:FS00:Upload complete
17:42:20:WU00:FS00:Server responded WORK_ACK (400)
17:42:20:WU00:FS00:Final credit estimate, 981.00 points
17:42:20:WU00:FS00:Cleaning up
17:49:45:WU01:FS00:0xa4:Completed 20000 out of 2000000 steps  (1%)
17:57:31:WU01:FS00:0xa4:Completed 40000 out of 2000000 steps  (2%)

[Joe_H]

Since you did not include the beginning section, I can not comment on the settings. However the TPF is fairly variable which points towards some background or foreground process competing with the folding client for CPU time. I would recommend using top or other CPU usage monitor to see if there are processes that regularly use a small percentage of the available CPU time. Something using a regular 10-20% of a CPU core can have a great impact on thread synchronization. If it is a process that you do need running, sometimes reducing the thread count by one for folding can actually have better throughput than having one additional thread continually interrupted.

[JLloyd13]

Code: Select all

*********************** Log Started 2015-01-14T11:38:56Z ***********************
11:38:56:************************* Folding@home Client *************************
11:38:56:    Website: http://folding.stanford.edu/
11:38:56:  Copyright: (c) 2009-2014 Stanford University
11:38:56:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
11:38:56:       Args: --child --lifeline 2456 /etc/fahclient/config.xml --run-as
11:38:56:             fahclient --pid-file=/var/run/fahclient.pid --daemon
11:38:56:     Config: /etc/fahclient/config.xml
11:38:56:******************************** Build ********************************
11:38:56:    Version: 7.4.4
11:38:56:       Date: Mar 4 2014
11:38:56:       Time: 12:02:38
11:38:56:    SVN Rev: 4130
11:38:56:     Branch: fah/trunk/client
11:38:56:   Compiler: GNU 4.4.7
11:38:56:    Options: -std=gnu++98 -O3 -funroll-loops -mfpmath=sse -ffast-math
11:38:56:             -fno-unsafe-math-optimizations -msse2
11:38:56:   Platform: linux2 3.2.0-1-amd64
11:38:56:       Bits: 64
11:38:56:       Mode: Release
11:38:56:******************************* System ********************************
11:38:56:        CPU: AMD Phenom(tm) II X4 B55 Processor
11:38:56:     CPU ID: AuthenticAMD Family 16 Model 5 Stepping 3
11:38:56:       CPUs: 4
11:38:56:     Memory: 7.56GiB
11:38:56:Free Memory: 7.38GiB
11:38:56:    Threads: POSIX_THREADS
11:38:56: OS Version: 3.16
11:38:56:Has Battery: false
11:38:56: On Battery: false
11:38:56: UTC Offset: -4
11:38:56:        PID: 2461
11:38:56:        CWD: /var/lib/fahclient
11:38:56:         OS: Linux 3.16.0-0.bpo.4-amd64 x86_64
11:38:56:    OS Arch: AMD64
11:38:56:       GPUs: 1
11:38:56:      GPU 0: UNSUPPORTED: RS880 [Radeon HD 4250]
11:38:56:       CUDA: Not detected
11:38:56:***********************************************************************
11:38:56:<config>
11:38:56:  <!-- Client Control -->
11:38:56:  <fold-anon v='true'/>
11:38:56:
11:38:56:  <!-- Folding Slot Configuration -->
11:38:56:  <gpu v='false'/>
11:38:56:
11:38:56:  <!-- Network -->
11:38:56:  <proxy v=':8080'/>
11:38:56:
11:38:56:  <!-- Slot Control -->
11:38:56:  <power v='full'/>
11:38:56:
11:38:56:  <!-- User Information -->
11:38:56:  <passkey v='********************************'/>
11:38:56:  <user v='JLloyd13'/>
11:38:56:
11:38:56:  <!-- Folding Slots -->
11:38:56:  <slot id='0' type='CPU'>
11:38:56:    <paused v='true'/>
11:38:56:  </slot>
11:38:56:</config>
11:38:56:Switching to user fahclient
11:38:56:Trying to access database...
11:38:56:Successfully acquired database lock
11:38:56:Enabled folding slot 00: PAUSED cpu:4 (by user)
******************************* Date: 2015-01-15 *******************************

This?

[JLloyd13]

I changed an update manager that was updating every 15 min to 1 day checking instead- still, f@h is using 400% of the cpu power (all four cores) almost all of the time, runnning top and fahcontrol might drop it down to 385% or something like that, not it's pretty much got the full run of the machine. still PPD levels out at 2500-3000.

After trying NaCl on my Chromebook I paused my local client here to give it a shot, and while I still can't figure out how to get NaCl to give me my PPD, I finished one WU in 18 minutes, which at 125 point per WU is 10K a day, closer (better actually) to what I think I should be getting- which is strange because I thought the normal client was better for 24/7 desktop machines.

[Jesse_V]

Mint 17 (Cinnamon) user here. I'm surprised in that drop, that seems unusual.

The normal client is indeed better on big machines, the NaCL one is better for folding on machines where access is only temporary or otherwise short-lived.

I would recommend using top or other CPU usage monitor to see if there are processes that regularly use a small percentage of the available CPU time.

htop is excellent and far better than top.

sudo apt-get install htop

[Joe_H]

This?

Yes, that is the beginning section of the log that was wanted. Looking at the settings I don't see anything out of the ordinary. Just is often useful to check in case something got set wrong along the way.

The figure of about 3000 PPD does match up with what I was able to calculate from the runs of the WU's shown in the log. Do you leave FAHControl open all of the time? There was a bug in an older version that sometimes caused it to continuously take enough CPU time to affect the running of SMP CPU cores, but I thought they had that fixed. Beyond that I am running out of ideas, maybe something will come to me overnight. Or someone else might have an idea to try besides what Jesse and I have posted.

[ChristianVirtual]

Not sure if relevant, but wasn't there some indication in the past about the negative impact of EXT4 compared to EXT3 ? And barrier enabled operation slowing down disk access ? Could that contribute ? What file system are you using ?

[billford]

Not sure if relevant, but wasn't there some indication in the past about the negative impact of EXT4 compared to EXT3 ? And barrier enabled operation slowing down disk access ? Could that contribute ? What file system are you using ?

I use EXT4 on my Linux machines and can see the effect of the barrier when a WU finishes, but it doesn't have more than a small effect (~1%) on PPD.

Interestingly it only occurs with smp, not the GPUs, which leads me to suspect it's something to do with the way the client writes to disc.

[Nathan_P]

EXT 4 was very problematic in the past - to the point where it was recommended to go EXT3 or SSD, I know that some of the larger teams have created install scripts or even made a whole OS install to get round the problem

[JLloyd13]

I'm using ext4 and an SSD. I leave it running 24/7 and while I occasionally use the computer, I didnt for almost two weeks when I started it up folding and the PPD listed by the client showed ~3k. It it possible that it is just displaying incorrently?

Also I left NaCl running overnight and so far it's on pace for about 10K per day based on my user stats

[Joe_H]

I don't think the displayed PPD is incorrect. I used elapsed times from the log you posted for the TPF figures to enter into a third-party points calculator, and was getting figures for PPD in the high 2000 to low 3000 range.

The ext4 filesystem issue mostly affects larger WU's with significant large sized work and results files. It might be part of the cause of the variability in frame times as each checkpoint is written. Setting the filesystem to turn barriers off will be very much the same as switching to the ext3 FS, and is one option to see if that change in FS defaults is the cause.