Joe_H wrote:How long has the client been attempting to send the WU? Also, please post more of your log showing at least the beginning of the log, beginning of the WU being processed and the completion.
Days now, I think its going to expire in another 2-3. Heres the whole log file from what's currently going on. I don't have the beginning or complettion of the work unit as I noticed it was still there after a few reboots.
Code: Select all
*********************** Log Started 2013-10-13T01:42:48Z ***********************
01:42:48:************************* Folding@home Client *************************
01:42:48: Website: http://folding.stanford.edu/
01:42:48: Copyright: (c) 2009-2013 Stanford University
01:42:48: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
01:42:48: Args:
01:42:48: Config: /home/hootis/config.xml
01:42:48:******************************** Build ********************************
01:42:48: Version: 7.3.6
01:42:48: Date: Feb 18 2013
01:42:48: Time: 07:24:08
01:42:48: SVN Rev: 3923
01:42:48: Branch: fah/trunk/client
01:42:48: Compiler: GNU 4.4.7
01:42:48: Options: -std=gnu++98 -O3 -funroll-loops -mfpmath=sse -ffast-math
01:42:48: -fno-unsafe-math-optimizations -msse2
01:42:48: Platform: linux2 3.2.0-1-amd64
01:42:48: Bits: 64
01:42:48: Mode: Release
01:42:48:******************************* System ********************************
01:42:48: CPU: AMD FX(tm)-8350 Eight-Core Processor
01:42:48: CPU ID: AuthenticAMD Family 21 Model 2 Stepping 0
01:42:48: CPUs: 8
01:42:48: Memory: 7.78GiB
01:42:48:Free Memory: 6.88GiB
01:42:48: Threads: POSIX_THREADS
01:42:48:Has Battery: false
01:42:48: On Battery: false
01:42:48: UTC offset: -4
01:42:48: PID: 2555
01:42:48: CWD: /home/hootis
01:42:48: OS: Linux 3.5.0-41-generic x86_64
01:42:48: OS Arch: AMD64
01:42:48: GPUs: 2
01:42:48: GPU 0: NVIDIA:2 GF110 [GeForce GTX 560 Ti]
01:42:48: GPU 1: NVIDIA:2 GF114 [GeForce GTX 560 Ti]
01:42:48: CUDA: 2.0
01:42:48:CUDA Driver: 5050
01:42:48:***********************************************************************
01:42:48:<config>
01:42:48: <!-- Folding Slot Configuration -->
01:42:48: <power v='full'/>
01:42:48:
01:42:48: <!-- Network -->
01:42:48: <proxy v=':8080'/>
01:42:48:
01:42:48: <!-- User Information -->
01:42:48: <passkey v='********************************'/>
01:42:48: <team v='176300'/>
01:42:48: <user v='hootis'/>
01:42:48:
01:42:48: <!-- Folding Slots -->
01:42:48: <slot id='1' type='GPU'>
01:42:48: <client-type v='beta'/>
01:42:48: </slot>
01:42:48: <slot id='2' type='GPU'>
01:42:48: <client-type v='beta'/>
01:42:48: </slot>
01:42:48: <slot id='3' type='CPU'>
01:42:48: <cpus v='6'/>
01:42:48: </slot>
01:42:48:</config>
01:42:48:Trying to access database...
01:42:48:Successfully acquired database lock
01:42:48:Enabled folding slot 01: READY gpu:0:GF110 [GeForce GTX 560 Ti]
01:42:48:Enabled folding slot 02: READY gpu:1:GF114 [GeForce GTX 560 Ti]
01:42:48:Enabled folding slot 03: READY cpu:6
01:42:48:WARNING:WU04:No longer matches Slot 2's configuration, migrating to FS01
01:42:48:WARNING:WU03:No longer matches Slot 1's configuration, migrating to FS02
01:42:49:WU04:FS01:Starting
01:42:49:WU04:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /home/hootis/cores/www.stanford.edu/~pande/Linux/AMD64/NVIDIA/Fermi/beta/Core_17.fah/FahCore_17 -dir 04 -suffix 01 -version 703 -lifeline 2555 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
01:42:49:WU04:FS01:Started FahCore on PID 2562
01:42:49:WU04:FS01:Core PID:2566
01:42:49:WU04:FS01:FahCore 0x17 started
01:42:49:WU03:FS02:Starting
01:42:49:WU03:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /home/hootis/cores/www.stanford.edu/~pande/Linux/AMD64/NVIDIA/Fermi/beta/Core_17.fah/FahCore_17 -dir 03 -suffix 01 -version 703 -lifeline 2555 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
01:42:49:WU03:FS02:Started FahCore on PID 2567
01:42:49:WU03:FS02:Core PID:2571
01:42:49:WU03:FS02:FahCore 0x17 started
01:42:49:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:900 clone:1 gen:55 core:0x17 unit:0x0000004f028c126651a6eeda3445c957
01:42:49:WU02:FS02:Uploading 51.36MiB to 171.64.65.69
01:42:49:WU02:FS02:Connecting to 171.64.65.69:8080
01:42:49:WU00:FS03:Starting
01:42:49:WU00:FS03:Running FahCore: /usr/bin/FAHCoreWrapper /home/hootis/cores/www.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 00 -suffix 01 -version 703 -lifeline 2555 -checkpoint 15 -np 6
01:42:49:WU00:FS03:Started FahCore on PID 2572
01:42:49:WU00:FS03:Core PID:2576
01:42:49:WU00:FS03:FahCore 0xa4 started
01:42:50:WU00:FS03:0xa4:
01:42:50:WU00:FS03:0xa4:*------------------------------*
01:42:50:WU00:FS03:0xa4:Folding@Home Gromacs GB Core
01:42:50:WU00:FS03:0xa4:Version 2.27 (Dec. 15, 2010)
01:42:50:WU00:FS03:0xa4:
01:42:50:WU00:FS03:0xa4:Preparing to commence simulation
01:42:50:WU00:FS03:0xa4:- Looking at optimizations...
01:42:50:WU00:FS03:0xa4:- Files status OK
01:42:50:WU00:FS03:0xa4:- Expanded 81947 -> 173488 (decompressed 211.7 percent)
01:42:50:WU00:FS03:0xa4:Called DecompressByteArray: compressed_data_size=81947 data_size=173488, decompressed_data_size=173488 diff=0
01:42:50:WU00:FS03:0xa4:- Digital signature verified
01:42:50:WU00:FS03:0xa4:
01:42:50:WU00:FS03:0xa4:Project: 6361 (Run 1, Clone 85, Gen 28)
01:42:50:WU00:FS03:0xa4:
01:42:50:WU00:FS03:0xa4:Assembly optimizations on if available.
01:42:50:WU00:FS03:0xa4:Entering M.D.
01:42:50:WU03:FS02:0x17:*********************** Log Started 2013-10-13T01:42:50Z ***********************
01:42:50:WU03:FS02:0x17:Project: 7811 (Run 0, Clone 373, Gen 415)
01:42:50:WU03:FS02:0x17:Unit: 0x000001bf0a3b1e8651db49823e02c846
01:42:50:WU03:FS02:0x17:CPU: 0x00000000000000000000000000000000
01:42:50:WU03:FS02:0x17:Machine: 1
01:42:50:WU03:FS02:0x17:Digital signatures verified
01:42:50:WU04:FS01:0x17:*********************** Log Started 2013-10-13T01:42:50Z ***********************
01:42:50:WU04:FS01:0x17:Project: 7810 (Run 0, Clone 560, Gen 314)
01:42:50:WU04:FS01:0x17:Unit: 0x0000014f0a3b1e8651d34bfe1cc35ed8
01:42:50:WU04:FS01:0x17:CPU: 0x00000000000000000000000000000000
01:42:50:WU04:FS01:0x17:Machine: 2
01:42:50:WU04:FS01:0x17:Digital signatures verified
01:42:50:WARNING:WU02:FS02:Exception: Failed to send results to work server: Transfer failed
01:42:50:WU02:FS02:Trying to send results to collection server
01:42:51:WU02:FS02:Uploading 51.36MiB to 171.65.103.160
01:42:51:WU02:FS02:Connecting to 171.65.103.160:8080
01:42:51:WU04:FS01:0x17: Found a checkpoint file
01:42:51:WU03:FS02:0x17: Found a checkpoint file
01:42:51:ERROR:WU02:FS02:Exception: Transfer failed
01:42:52:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:900 clone:1 gen:55 core:0x17 unit:0x0000004f028c126651a6eeda3445c957
01:42:52:WU02:FS02:Uploading 51.36MiB to 171.64.65.69
01:42:52:WU02:FS02:Connecting to 171.64.65.69:8080
01:42:52:WARNING:WU02:FS02:Exception: Failed to send results to work server: Transfer failed
01:42:52:WU02:FS02:Trying to send results to collection server
01:42:52:WU02:FS02:Uploading 51.36MiB to 171.65.103.160
01:42:52:WU02:FS02:Connecting to 171.65.103.160:8080
01:42:53:ERROR:WU02:FS02:Exception: Transfer failed
01:42:56:WU00:FS03:0xa4:Using Gromacs checkpoints
01:42:57:WU00:FS03:0xa4:Resuming from checkpoint
01:42:57:WU00:FS03:0xa4:Verified 00/wudata_01.log
01:42:57:WU00:FS03:0xa4:Verified 00/wudata_01.trr
01:42:57:WU00:FS03:0xa4:Verified 00/wudata_01.xtc
01:42:57:WU00:FS03:0xa4:Verified 00/wudata_01.edr
01:42:57:WU00:FS03:0xa4:Completed 1224820 out of 5000000 steps (24%)
01:43:12:WU03:FS02:0x17:Completed 800000 out of 2000000 steps (40%)
01:43:14:WU04:FS01:0x17:Completed 550000 out of 2000000 steps (27%)
01:43:37:WU00:FS03:0xa4:Completed 1250000 out of 5000000 steps (25%)
01:43:52:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:900 clone:1 gen:55 core:0x17 unit:0x0000004f028c126651a6eeda3445c957
01:43:52:WU02:FS02:Uploading 51.36MiB to 171.64.65.69
01:43:52:WU02:FS02:Connecting to 171.64.65.69:8080
01:43:52:WARNING:WU02:FS02:Exception: Failed to send results to work server: Transfer failed
01:43:52:WU02:FS02:Trying to send results to collection server
01:43:52:WU02:FS02:Uploading 51.36MiB to 171.65.103.160
01:43:52:WU02:FS02:Connecting to 171.65.103.160:8080
01:43:53:ERROR:WU02:FS02:Exception: Transfer failed
01:44:55:WU00:FS03:0xa4:Completed 1300000 out of 5000000 steps (26%)
01:45:29:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:900 clone:1 gen:55 core:0x17 unit:0x0000004f028c126651a6eeda3445c957
01:45:29:WU02:FS02:Uploading 51.36MiB to 171.64.65.69
01:45:29:WU02:FS02:Connecting to 171.64.65.69:8080
01:45:29:WARNING:WU02:FS02:Exception: Failed to send results to work server: Transfer failed
01:45:29:WU02:FS02:Trying to send results to collection server
01:45:30:WU02:FS02:Uploading 51.36MiB to 171.65.103.160
01:45:30:WU02:FS02:Connecting to 171.65.103.160:8080
01:45:30:ERROR:WU02:FS02:Exception: Transfer failed
01:45:32:WU04:FS01:0x17:Completed 560000 out of 2000000 steps (28%)
01:46:12:WU00:FS03:0xa4:Completed 1350000 out of 5000000 steps (27%)
01:46:55:WU03:FS02:0x17:Completed 820000 out of 2000000 steps (41%)
01:47:29:WU00:FS03:0xa4:Completed 1400000 out of 5000000 steps (28%)
01:48:06:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:900 clone:1 gen:55 core:0x17 unit:0x0000004f028c126651a6eeda3445c957
01:48:06:WU02:FS02:Uploading 51.36MiB to 171.64.65.69
01:48:06:WU02:FS02:Connecting to 171.64.65.69:8080
01:48:07:WARNING:WU02:FS02:Exception: Failed to send results to work server: Transfer failed
01:48:07:WU02:FS02:Trying to send results to collection server
01:48:07:WU02:FS02:Uploading 51.36MiB to 171.65.103.160
01:48:07:WU02:FS02:Connecting to 171.65.103.160:8080
01:48:07:ERROR:WU02:FS02:Exception: Transfer failed
01:48:47:WU00:FS03:0xa4:Completed 1450000 out of 5000000 steps (29%)
01:50:02:WU04:FS01:0x17:Completed 580000 out of 2000000 steps (29%)
01:50:06:WU00:FS03:0xa4:Completed 1500000 out of 5000000 steps (30%)
01:50:36:WU03:FS02:0x17:Completed 840000 out of 2000000 steps (42%)
01:51:24:WU00:FS03:0xa4:Completed 1550000 out of 5000000 steps (31%)
01:52:20:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:900 clone:1 gen:55 core:0x17 unit:0x0000004f028c126651a6eeda3445c957
01:52:21:WU02:FS02:Uploading 51.36MiB to 171.64.65.69
01:52:21:WU02:FS02:Connecting to 171.64.65.69:8080
01:52:21:WARNING:WU02:FS02:Exception: Failed to send results to work server: Transfer failed
01:52:21:WU02:FS02:Trying to send results to collection server
01:52:21:WU02:FS02:Uploading 51.36MiB to 171.65.103.160
01:52:21:WU02:FS02:Connecting to 171.65.103.160:8080
01:52:21:ERROR:WU02:FS02:Exception: Transfer failed
01:52:43:WU00:FS03:0xa4:Completed 1600000 out of 5000000 steps (32%)
01:54:01:WU00:FS03:0xa4:Completed 1650000 out of 5000000 steps (33%)
01:54:20:WU03:FS02:0x17:Completed 860000 out of 2000000 steps (43%)
01:54:33:WU04:FS01:0x17:Completed 600000 out of 2000000 steps (30%)
01:55:18:WU00:FS03:0xa4:Completed 1700000 out of 5000000 steps (34%)
01:56:35:WU00:FS03:0xa4:Completed 1750000 out of 5000000 steps (35%)
01:57:53:WU00:FS03:0xa4:Completed 1800000 out of 5000000 steps (36%)
01:58:00:WU03:FS02:0x17:Completed 880000 out of 2000000 steps (44%)
01:59:07:WU04:FS01:0x17:Completed 620000 out of 2000000 steps (31%)
01:59:10:WU00:FS03:0xa4:Completed 1850000 out of 5000000 steps (37%)
01:59:12:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:900 clone:1 gen:55 core:0x17 unit:0x0000004f028c126651a6eeda3445c957
01:59:12:WU02:FS02:Uploading 51.36MiB to 171.64.65.69
01:59:12:WU02:FS02:Connecting to 171.64.65.69:8080
01:59:12:WARNING:WU02:FS02:Exception: Failed to send results to work server: Transfer failed
01:59:12:WU02:FS02:Trying to send results to collection server
01:59:12:WU02:FS02:Uploading 51.36MiB to 171.65.103.160
01:59:12:WU02:FS02:Connecting to 171.65.103.160:8080
01:59:13:ERROR:WU02:FS02:Exception: Transfer failed
02:00:28:WU00:FS03:0xa4:Completed 1900000 out of 5000000 steps (38%)
02:01:41:WU03:FS02:0x17:Completed 900000 out of 2000000 steps (45%)
02:01:46:WU00:FS03:0xa4:Completed 1950000 out of 5000000 steps (39%)
02:03:03:WU00:FS03:0xa4:Completed 2000000 out of 5000000 steps (40%)
02:03:38:WU04:FS01:0x17:Completed 640000 out of 2000000 steps (32%)
02:04:21:WU00:FS03:0xa4:Completed 2050000 out of 5000000 steps (41%)
02:05:25:WU03:FS02:0x17:Completed 920000 out of 2000000 steps (46%)
02:05:38:WU00:FS03:0xa4:Completed 2100000 out of 5000000 steps (42%)
02:06:56:WU00:FS03:0xa4:Completed 2150000 out of 5000000 steps (43%)
02:08:11:WU04:FS01:0x17:Completed 660000 out of 2000000 steps (33%)
02:08:14:WU00:FS03:0xa4:Completed 2200000 out of 5000000 steps (44%)
02:09:06:WU03:FS02:0x17:Completed 940000 out of 2000000 steps (47%)
02:09:32:WU00:FS03:0xa4:Completed 2250000 out of 5000000 steps (45%)
02:10:17:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:900 clone:1 gen:55 core:0x17 unit:0x0000004f028c126651a6eeda3445c957
02:10:17:WU02:FS02:Uploading 51.36MiB to 171.64.65.69
02:10:17:WU02:FS02:Connecting to 171.64.65.69:8080
02:10:18:WARNING:WU02:FS02:Exception: Failed to send results to work server: Transfer failed
02:10:18:WU02:FS02:Trying to send results to collection server
02:10:18:WU02:FS02:Uploading 51.36MiB to 171.65.103.160
02:10:18:WU02:FS02:Connecting to 171.65.103.160:8080
02:10:18:ERROR:WU02:FS02:Exception: Transfer failed
02:10:49:WU00:FS03:0xa4:Completed 2300000 out of 5000000 steps (46%)
02:12:07:WU00:FS03:0xa4:Completed 2350000 out of 5000000 steps (47%)
02:12:42:WU04:FS01:0x17:Completed 680000 out of 2000000 steps (34%)
02:12:50:WU03:FS02:0x17:Completed 960000 out of 2000000 steps (48%)
02:13:30:WU00:FS03:0xa4:Completed 2400000 out of 5000000 steps (48%)
02:14:47:WU00:FS03:0xa4:Completed 2450000 out of 5000000 steps (49%)
02:16:04:WU00:FS03:0xa4:Completed 2500000 out of 5000000 steps (50%)
02:16:30:WU03:FS02:0x17:Completed 980000 out of 2000000 steps (49%)
02:17:12:WU04:FS01:0x17:Completed 700000 out of 2000000 steps (35%)
02:17:21:WU00:FS03:0xa4:Completed 2550000 out of 5000000 steps (51%)
02:18:38:WU00:FS03:0xa4:Completed 2600000 out of 5000000 steps (52%)
02:19:55:WU00:FS03:0xa4:Completed 2650000 out of 5000000 steps (53%)
02:20:11:WU03:FS02:0x17:Completed 1000000 out of 2000000 steps (50%)
02:21:12:WU00:FS03:0xa4:Completed 2700000 out of 5000000 steps (54%)
02:21:46:WU04:FS01:0x17:Completed 720000 out of 2000000 steps (36%)
02:22:30:WU00:FS03:0xa4:Completed 2750000 out of 5000000 steps (55%)
02:23:48:WU00:FS03:0xa4:Completed 2800000 out of 5000000 steps (56%)
02:23:55:WU03:FS02:0x17:Completed 1020000 out of 2000000 steps (51%)
02:25:06:WU00:FS03:0xa4:Completed 2850000 out of 5000000 steps (57%)
02:26:16:WU04:FS01:0x17:Completed 740000 out of 2000000 steps (37%)
02:26:24:WU00:FS03:0xa4:Completed 2900000 out of 5000000 steps (58%)
02:27:36:WU03:FS02:0x17:Completed 1040000 out of 2000000 steps (52%)
02:27:42:WU00:FS03:0xa4:Completed 2950000 out of 5000000 steps (59%)
02:28:14:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:900 clone:1 gen:55 core:0x17 unit:0x0000004f028c126651a6eeda3445c957
02:28:14:WU02:FS02:Uploading 51.36MiB to 171.64.65.69
02:28:14:WU02:FS02:Connecting to 171.64.65.69:8080
02:28:15:WARNING:WU02:FS02:Exception: Failed to send results to work server: Transfer failed
02:28:15:WU02:FS02:Trying to send results to collection server
02:28:15:WU02:FS02:Uploading 51.36MiB to 171.65.103.160
02:28:15:WU02:FS02:Connecting to 171.65.103.160:8080
02:28:15:ERROR:WU02:FS02:Exception: Transfer failed
02:29:00:WU00:FS03:0xa4:Completed 3000000 out of 5000000 steps (60%)
02:30:18:WU00:FS03:0xa4:Completed 3050000 out of 5000000 steps (61%)
02:30:50:WU04:FS01:0x17:Completed 760000 out of 2000000 steps (38%)
02:31:19:WU03:FS02:0x17:Completed 1060000 out of 2000000 steps (53%)
02:31:37:WU00:FS03:0xa4:Completed 3100000 out of 5000000 steps (62%)
02:32:56:WU00:FS03:0xa4:Completed 3150000 out of 5000000 steps (63%)
02:34:15:WU00:FS03:0xa4:Completed 3200000 out of 5000000 steps (64%)
02:35:00:WU03:FS02:0x17:Completed 1080000 out of 2000000 steps (54%)
02:35:20:WU04:FS01:0x17:Completed 780000 out of 2000000 steps (39%)
02:35:32:WU00:FS03:0xa4:Completed 3250000 out of 5000000 steps (65%)
02:36:49:WU00:FS03:0xa4:Completed 3300000 out of 5000000 steps (66%)
02:38:07:WU00:FS03:0xa4:Completed 3350000 out of 5000000 steps (67%)
02:38:41:WU03:FS02:0x17:Completed 1100000 out of 2000000 steps (55%)
02:39:25:WU00:FS03:0xa4:Completed 3400000 out of 5000000 steps (68%)
02:39:51:WU04:FS01:0x17:Completed 800000 out of 2000000 steps (40%)
02:40:43:WU00:FS03:0xa4:Completed 3450000 out of 5000000 steps (69%)
02:42:02:WU00:FS03:0xa4:Completed 3500000 out of 5000000 steps (70%)
02:42:24:WU03:FS02:0x17:Completed 1120000 out of 2000000 steps (56%)
02:43:20:WU00:FS03:0xa4:Completed 3550000 out of 5000000 steps (71%)
02:44:25:WU04:FS01:0x17:Completed 820000 out of 2000000 steps (41%)
02:44:38:WU00:FS03:0xa4:Completed 3600000 out of 5000000 steps (72%)
02:45:55:WU00:FS03:0xa4:Completed 3650000 out of 5000000 steps (73%)
02:46:05:WU03:FS02:0x17:Completed 1140000 out of 2000000 steps (57%)
02:47:12:WU00:FS03:0xa4:Completed 3700000 out of 5000000 steps (74%)
02:48:29:WU00:FS03:0xa4:Completed 3750000 out of 5000000 steps (75%)
02:48:55:WU04:FS01:0x17:Completed 840000 out of 2000000 steps (42%)
02:49:47:WU00:FS03:0xa4:Completed 3800000 out of 5000000 steps (76%)
02:49:49:WU03:FS02:0x17:Completed 1160000 out of 2000000 steps (58%)
02:51:04:WU00:FS03:0xa4:Completed 3850000 out of 5000000 steps (77%)
02:52:21:WU00:FS03:0xa4:Completed 3900000 out of 5000000 steps (78%)
02:53:29:WU04:FS01:0x17:Completed 860000 out of 2000000 steps (43%)
02:53:29:WU03:FS02:0x17:Completed 1180000 out of 2000000 steps (59%)
02:53:39:WU00:FS03:0xa4:Completed 3950000 out of 5000000 steps (79%)
02:54:57:WU00:FS03:0xa4:Completed 4000000 out of 5000000 steps (80%)
02:56:15:WU00:FS03:0xa4:Completed 4050000 out of 5000000 steps (81%)
02:57:10:WU03:FS02:0x17:Completed 1200000 out of 2000000 steps (60%)
02:57:16:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:900 clone:1 gen:55 core:0x17 unit:0x0000004f028c126651a6eeda3445c957
02:57:17:WU02:FS02:Uploading 51.36MiB to 171.64.65.69
02:57:17:WU02:FS02:Connecting to 171.64.65.69:8080
02:57:17:WARNING:WU02:FS02:Exception: Failed to send results to work server: Transfer failed
02:57:17:WU02:FS02:Trying to send results to collection server
02:57:17:WU02:FS02:Uploading 51.36MiB to 171.65.103.160
02:57:17:WU02:FS02:Connecting to 171.65.103.160:8080
02:57:17:ERROR:WU02:FS02:Exception: Transfer failed
02:57:33:WU00:FS03:0xa4:Completed 4100000 out of 5000000 steps (82%)
02:57:59:WU04:FS01:0x17:Completed 880000 out of 2000000 steps (44%)
02:58:50:WU00:FS03:0xa4:Completed 4150000 out of 5000000 steps (83%)
03:00:07:WU00:FS03:0xa4:Completed 4200000 out of 5000000 steps (84%)
03:00:54:WU03:FS02:0x17:Completed 1220000 out of 2000000 steps (61%)
03:01:24:WU00:FS03:0xa4:Completed 4250000 out of 5000000 steps (85%)
03:02:30:WU04:FS01:0x17:Completed 900000 out of 2000000 steps (45%)
03:02:42:WU00:FS03:0xa4:Completed 4300000 out of 5000000 steps (86%)
03:04:00:WU00:FS03:0xa4:Completed 4350000 out of 5000000 steps (87%)
03:05:08:WU03:FS02:0x17:Completed 1240000 out of 2000000 steps (62%)
03:05:16:WU00:FS03:0xa4:Completed 4400000 out of 5000000 steps (88%)
03:06:34:WU00:FS03:0xa4:Completed 4450000 out of 5000000 steps (89%)
03:07:04:WU04:FS01:0x17:Completed 920000 out of 2000000 steps (46%)
03:07:52:WU00:FS03:0xa4:Completed 4500000 out of 5000000 steps (90%)
03:08:23:WU03:FS02:0x17:Bad State detected... attempting to resume from last good checkpoint
03:09:09:WU00:FS03:0xa4:Completed 4550000 out of 5000000 steps (91%)
03:10:27:WU00:FS03:0xa4:Completed 4600000 out of 5000000 steps (92%)
03:11:34:WU04:FS01:0x17:Completed 940000 out of 2000000 steps (47%)
03:11:44:WU00:FS03:0xa4:Completed 4650000 out of 5000000 steps (93%)
03:12:03:WU03:FS02:0x17:Completed 1220000 out of 2000000 steps (61%)
03:13:02:WU00:FS03:0xa4:Completed 4700000 out of 5000000 steps (94%)
03:14:18:WU00:FS03:0xa4:Completed 4750000 out of 5000000 steps (95%)
03:15:37:WU00:FS03:0xa4:Completed 4800000 out of 5000000 steps (96%)
03:15:44:WU03:FS02:0x17:Completed 1240000 out of 2000000 steps (62%)
03:16:08:WU04:FS01:0x17:Completed 960000 out of 2000000 steps (48%)
03:16:55:WU00:FS03:0xa4:Completed 4850000 out of 5000000 steps (97%)
03:18:13:WU00:FS03:0xa4:Completed 4900000 out of 5000000 steps (98%)
03:18:14:WU01:FS03:Connecting to assign3.stanford.edu:8080
03:18:14:WU01:FS03:News: Welcome to Folding@Home
03:18:14:WU01:FS03:Assigned to work server 155.247.166.219
03:18:14:WU01:FS03:Requesting new work unit for slot 03: RUNNING cpu:6 from 155.247.166.219
03:18:14:WU01:FS03:Connecting to 155.247.166.219:8080
03:18:15:WU01:FS03:Downloading 71.02KiB
03:18:15:WU01:FS03:Download complete
03:18:15:WU01:FS03:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:6361 run:3 clone:187 gen:0 core:0xa4 unit:0x000000030002894b522e9156df38a84d
03:19:28:WU03:FS02:0x17:Completed 1260000 out of 2000000 steps (63%)
03:19:30:WU00:FS03:0xa4:Completed 4950000 out of 5000000 steps (99%)
03:20:38:WU04:FS01:0x17:Completed 980000 out of 2000000 steps (49%)
03:20:46:WU00:FS03:0xa4:Completed 5000000 out of 5000000 steps (100%)
03:20:46:WU00:FS03:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
03:20:56:WU00:FS03:0xa4:
03:20:56:WU00:FS03:0xa4:Finished Work Unit:
03:20:56:WU00:FS03:0xa4:- Reading up to 826584 from "00/wudata_01.trr": Read 826584
03:20:56:WU00:FS03:0xa4:trr file hash check passed.
03:20:56:WU00:FS03:0xa4:- Reading up to 63656 from "00/wudata_01.xtc": Read 63656
03:20:56:WU00:FS03:0xa4:xtc file hash check passed.
03:20:56:WU00:FS03:0xa4:edr file hash check passed.
03:20:56:WU00:FS03:0xa4:logfile size: 83818
03:20:56:WU00:FS03:0xa4:Leaving Run
03:21:00:WU00:FS03:0xa4:- Writing 1044690 bytes of core data to disk...
03:21:00:WU00:FS03:0xa4:Done: 1044178 -> 868136 (compressed to 83.1 percent)
03:21:00:WU00:FS03:0xa4: ... Done.
03:21:18:WU00:FS03:0xa4:- Shutting down core
03:21:18:WU00:FS03:0xa4:
03:21:18:WU00:FS03:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
03:21:19:WU00:FS03:FahCore returned: FINISHED_UNIT (100 = 0x64)
03:21:19:WU00:FS03:Sending unit results: id:00 state:SEND error:NO_ERROR project:6361 run:1 clone:85 gen:28 core:0xa4 unit:0x000000210002894b522e914195ead6e7
03:21:19:WU00:FS03:Uploading 848.29KiB to 155.247.166.219
03:21:19:WU00:FS03:Connecting to 155.247.166.219:8080
03:21:19:WU01:FS03:Starting
03:21:19:WU01:FS03:Running FahCore: /usr/bin/FAHCoreWrapper /home/hootis/cores/www.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 01 -suffix 01 -version 703 -lifeline 2555 -checkpoint 15 -np 6
03:21:19:WU01:FS03:Started FahCore on PID 2725
03:21:19:WU01:FS03:Core PID:2729
03:21:19:WU01:FS03:FahCore 0xa4 started
03:21:20:WU01:FS03:0xa4:
03:21:20:WU01:FS03:0xa4:*------------------------------*
03:21:20:WU01:FS03:0xa4:Folding@Home Gromacs GB Core
03:21:20:WU01:FS03:0xa4:Version 2.27 (Dec. 15, 2010)
03:21:20:WU01:FS03:0xa4:
03:21:20:WU01:FS03:0xa4:Preparing to commence simulation
03:21:20:WU01:FS03:0xa4:- Looking at optimizations...
03:21:20:WU01:FS03:0xa4:- Created dyn
03:21:20:WU01:FS03:0xa4:- Files status OK
03:21:20:WU01:FS03:0xa4:- Expanded 72212 -> 173488 (decompressed 240.2 percent)
03:21:20:WU01:FS03:0xa4:Called DecompressByteArray: compressed_data_size=72212 data_size=173488, decompressed_data_size=173488 diff=0
03:21:20:WU01:FS03:0xa4:- Digital signature verified
03:21:20:WU01:FS03:0xa4:
03:21:20:WU01:FS03:0xa4:Project: 6361 (Run 3, Clone 187, Gen 0)
03:21:20:WU01:FS03:0xa4:
03:21:20:WU01:FS03:0xa4:Assembly optimizations on if available.
03:21:20:WU01:FS03:0xa4:Entering M.D.
03:21:20:WU00:FS03:Upload complete
03:21:20:WU00:FS03:Server responded WORK_ACK (400)
03:21:20:WU00:FS03:Final credit estimate, 650.00 points
03:21:20:WU00:FS03:Cleaning up
03:21:25:WU01:FS03:0xa4:Completed 0 out of 5000000 steps (0%)
03:22:42:WU01:FS03:0xa4:Completed 50000 out of 5000000 steps (1%)
03:23:09:WU03:FS02:0x17:Completed 1280000 out of 2000000 steps (64%)
03:23:58:WU01:FS03:0xa4:Completed 100000 out of 5000000 steps (2%)
03:25:09:WU04:FS01:0x17:Completed 1000000 out of 2000000 steps (50%)
03:25:14:WU01:FS03:0xa4:Completed 150000 out of 5000000 steps (3%)
03:26:29:WU01:FS03:0xa4:Completed 200000 out of 5000000 steps (4%)
03:26:49:WU03:FS02:0x17:Completed 1300000 out of 2000000 steps (65%)
03:27:46:WU01:FS03:0xa4:Completed 250000 out of 5000000 steps (5%)
03:29:04:WU01:FS03:0xa4:Completed 300000 out of 5000000 steps (6%)
03:29:43:WU04:FS01:0x17:Completed 1020000 out of 2000000 steps (51%)
03:30:21:WU01:FS03:0xa4:Completed 350000 out of 5000000 steps (7%)
03:30:33:WU03:FS02:0x17:Completed 1320000 out of 2000000 steps (66%)
03:31:39:WU01:FS03:0xa4:Completed 400000 out of 5000000 steps (8%)
03:32:56:WU01:FS03:0xa4:Completed 450000 out of 5000000 steps (9%)
03:34:13:WU01:FS03:0xa4:Completed 500000 out of 5000000 steps (10%)
03:34:13:WU04:FS01:0x17:Completed 1040000 out of 2000000 steps (52%)
03:34:14:WU03:FS02:0x17:Completed 1340000 out of 2000000 steps (67%)
03:35:30:WU01:FS03:0xa4:Completed 550000 out of 5000000 steps (11%)
03:36:47:WU01:FS03:0xa4:Completed 600000 out of 5000000 steps (12%)
03:37:57:WU03:FS02:0x17:Completed 1360000 out of 2000000 steps (68%)
03:38:05:WU01:FS03:0xa4:Completed 650000 out of 5000000 steps (13%)
03:38:47:WU04:FS01:0x17:Completed 1060000 out of 2000000 steps (53%)
03:39:22:WU01:FS03:0xa4:Completed 700000 out of 5000000 steps (14%)
03:40:40:WU01:FS03:0xa4:Completed 750000 out of 5000000 steps (15%)
03:41:38:WU03:FS02:0x17:Completed 1380000 out of 2000000 steps (69%)
03:41:55:WU01:FS03:0xa4:Completed 800000 out of 5000000 steps (16%)
03:43:11:WU01:FS03:0xa4:Completed 850000 out of 5000000 steps (17%)
03:43:18:WU04:FS01:0x17:Completed 1080000 out of 2000000 steps (54%)
03:44:15:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:900 clone:1 gen:55 core:0x17 unit:0x0000004f028c126651a6eeda3445c957
03:44:15:WU02:FS02:Uploading 51.36MiB to 171.64.65.69
03:44:15:WU02:FS02:Connecting to 171.64.65.69:8080
03:44:16:WARNING:WU02:FS02:Exception: Failed to send results to work server: Transfer failed
03:44:16:WU02:FS02:Trying to send results to collection server
03:44:16:WU02:FS02:Uploading 51.36MiB to 171.65.103.160
03:44:16:WU02:FS02:Connecting to 171.65.103.160:8080
03:44:16:ERROR:WU02:FS02:Exception: Transfer failed
03:44:27:WU01:FS03:0xa4:Completed 900000 out of 5000000 steps (18%)
03:45:18:WU03:FS02:0x17:Completed 1400000 out of 2000000 steps (70%)
03:45:45:WU01:FS03:0xa4:Completed 950000 out of 5000000 steps (19%)
03:47:01:WU01:FS03:0xa4:Completed 1000000 out of 5000000 steps (20%)
03:47:48:WU04:FS01:0x17:Completed 1100000 out of 2000000 steps (55%)
03:48:18:WU01:FS03:0xa4:Completed 1050000 out of 5000000 steps (21%)
03:49:02:WU03:FS02:0x17:Completed 1420000 out of 2000000 steps (71%)
03:49:34:WU01:FS03:0xa4:Completed 1100000 out of 5000000 steps (22%)
03:50:50:WU01:FS03:0xa4:Completed 1150000 out of 5000000 steps (23%)
03:52:07:WU01:FS03:0xa4:Completed 1200000 out of 5000000 steps (24%)
03:52:22:WU04:FS01:0x17:Completed 1120000 out of 2000000 steps (56%)
03:52:43:WU03:FS02:0x17:Completed 1440000 out of 2000000 steps (72%)
03:53:24:WU01:FS03:0xa4:Completed 1250000 out of 5000000 steps (25%)
03:54:41:WU01:FS03:0xa4:Completed 1300000 out of 5000000 steps (26%)
03:55:58:WU01:FS03:0xa4:Completed 1350000 out of 5000000 steps (27%)
03:56:26:WU03:FS02:0x17:Completed 1460000 out of 2000000 steps (73%)
03:56:52:WU04:FS01:0x17:Completed 1140000 out of 2000000 steps (57%)
03:57:14:WU01:FS03:0xa4:Completed 1400000 out of 5000000 steps (28%)
03:58:31:WU01:FS03:0xa4:Completed 1450000 out of 5000000 steps (29%)
03:59:48:WU01:FS03:0xa4:Completed 1500000 out of 5000000 steps (30%)
04:00:07:WU03:FS02:0x17:Completed 1480000 out of 2000000 steps (74%)
04:01:05:WU01:FS03:0xa4:Completed 1550000 out of 5000000 steps (31%)
04:01:26:WU04:FS01:0x17:Completed 1160000 out of 2000000 steps (58%)
04:02:22:WU01:FS03:0xa4:Completed 1600000 out of 5000000 steps (32%)
04:03:40:WU01:FS03:0xa4:Completed 1650000 out of 5000000 steps (33%)
04:03:47:WU03:FS02:0x17:Completed 1500000 out of 2000000 steps (75%)
04:04:54:WU01:FS03:0xa4:Completed 1700000 out of 5000000 steps (34%)
04:05:56:WU04:FS01:0x17:Completed 1180000 out of 2000000 steps (59%)
04:06:11:WU01:FS03:0xa4:Completed 1750000 out of 5000000 steps (35%)
04:07:28:WU01:FS03:0xa4:Completed 1800000 out of 5000000 steps (36%)
04:07:31:WU03:FS02:0x17:Completed 1520000 out of 2000000 steps (76%)
04:08:46:WU01:FS03:0xa4:Completed 1850000 out of 5000000 steps (37%)
04:10:02:WU01:FS03:0xa4:Completed 1900000 out of 5000000 steps (38%)
04:10:27:WU04:FS01:0x17:Completed 1200000 out of 2000000 steps (60%)
04:11:12:WU03:FS02:0x17:Completed 1540000 out of 2000000 steps (77%)
04:11:19:WU01:FS03:0xa4:Completed 1950000 out of 5000000 steps (39%)
04:12:36:WU01:FS03:0xa4:Completed 2000000 out of 5000000 steps (40%)
04:13:53:WU01:FS03:0xa4:Completed 2050000 out of 5000000 steps (41%)
04:14:55:WU03:FS02:0x17:Completed 1560000 out of 2000000 steps (78%)
04:15:01:WU04:FS01:0x17:Completed 1220000 out of 2000000 steps (61%)
04:15:11:WU01:FS03:0xa4:Completed 2100000 out of 5000000 steps (42%)
04:16:27:WU01:FS03:0xa4:Completed 2150000 out of 5000000 steps (43%)
04:17:43:WU01:FS03:0xa4:Completed 2200000 out of 5000000 steps (44%)
04:18:36:WU03:FS02:0x17:Completed 1580000 out of 2000000 steps (79%)
04:19:00:WU01:FS03:0xa4:Completed 2250000 out of 5000000 steps (45%)
04:19:31:WU04:FS01:0x17:Completed 1240000 out of 2000000 steps (62%)
04:20:17:WU01:FS03:0xa4:Completed 2300000 out of 5000000 steps (46%)
04:21:34:WU01:FS03:0xa4:Completed 2350000 out of 5000000 steps (47%)
04:22:16:WU03:FS02:0x17:Completed 1600000 out of 2000000 steps (80%)
04:22:51:WU01:FS03:0xa4:Completed 2400000 out of 5000000 steps (48%)
04:24:05:WU04:FS01:0x17:Completed 1260000 out of 2000000 steps (63%)
04:24:08:WU01:FS03:0xa4:Completed 2450000 out of 5000000 steps (49%)
04:25:25:WU01:FS03:0xa4:Completed 2500000 out of 5000000 steps (50%)
04:26:00:WU03:FS02:0x17:Completed 1620000 out of 2000000 steps (81%)
04:26:42:WU01:FS03:0xa4:Completed 2550000 out of 5000000 steps (51%)
04:28:00:WU01:FS03:0xa4:Completed 2600000 out of 5000000 steps (52%)
04:28:36:WU04:FS01:0x17:Completed 1280000 out of 2000000 steps (64%)
04:29:16:WU01:FS03:0xa4:Completed 2650000 out of 5000000 steps (53%)
04:29:40:WU03:FS02:0x17:Completed 1640000 out of 2000000 steps (82%)
04:30:33:WU01:FS03:0xa4:Completed 2700000 out of 5000000 steps (54%)
04:31:50:WU01:FS03:0xa4:Completed 2750000 out of 5000000 steps (55%)
04:33:06:WU04:FS01:0x17:Completed 1300000 out of 2000000 steps (65%)
04:33:09:WU01:FS03:0xa4:Completed 2800000 out of 5000000 steps (56%)
04:33:24:WU03:FS02:0x17:Completed 1660000 out of 2000000 steps (83%)
04:34:26:WU01:FS03:0xa4:Completed 2850000 out of 5000000 steps (57%)
04:35:42:WU01:FS03:0xa4:Completed 2900000 out of 5000000 steps (58%)
04:36:59:WU01:FS03:0xa4:Completed 2950000 out of 5000000 steps (59%)
04:37:05:WU03:FS02:0x17:Completed 1680000 out of 2000000 steps (84%)
04:37:40:WU04:FS01:0x17:Completed 1320000 out of 2000000 steps (66%)
04:38:15:WU01:FS03:0xa4:Completed 3000000 out of 5000000 steps (60%)
04:39:32:WU01:FS03:0xa4:Completed 3050000 out of 5000000 steps (61%)
04:40:46:WU03:FS02:0x17:Completed 1700000 out of 2000000 steps (85%)
04:40:48:WU01:FS03:0xa4:Completed 3100000 out of 5000000 steps (62%)
04:42:06:WU01:FS03:0xa4:Completed 3150000 out of 5000000 steps (63%)
04:42:10:WU04:FS01:0x17:Completed 1340000 out of 2000000 steps (67%)
04:43:23:WU01:FS03:0xa4:Completed 3200000 out of 5000000 steps (64%)
04:44:29:WU03:FS02:0x17:Completed 1720000 out of 2000000 steps (86%)
04:44:39:WU01:FS03:0xa4:Completed 3250000 out of 5000000 steps (65%)
04:45:56:WU01:FS03:0xa4:Completed 3300000 out of 5000000 steps (66%)
04:46:44:WU04:FS01:0x17:Completed 1360000 out of 2000000 steps (68%)
04:47:13:WU01:FS03:0xa4:Completed 3350000 out of 5000000 steps (67%)
04:48:10:WU03:FS02:0x17:Completed 1740000 out of 2000000 steps (87%)
04:48:29:WU01:FS03:0xa4:Completed 3400000 out of 5000000 steps (68%)
04:49:45:WU01:FS03:0xa4:Completed 3450000 out of 5000000 steps (69%)
04:51:00:WU01:FS03:0xa4:Completed 3500000 out of 5000000 steps (70%)
04:51:14:WU04:FS01:0x17:Completed 1380000 out of 2000000 steps (69%)
04:51:54:WU03:FS02:0x17:Completed 1760000 out of 2000000 steps (88%)
04:52:16:WU01:FS03:0xa4:Completed 3550000 out of 5000000 steps (71%)
04:53:33:WU01:FS03:0xa4:Completed 3600000 out of 5000000 steps (72%)
04:54:50:WU01:FS03:0xa4:Completed 3650000 out of 5000000 steps (73%)
04:55:35:WU03:FS02:0x17:Completed 1780000 out of 2000000 steps (89%)
04:55:44:WU04:FS01:0x17:Completed 1400000 out of 2000000 steps (70%)
04:56:07:WU01:FS03:0xa4:Completed 3700000 out of 5000000 steps (74%)
04:57:24:WU01:FS03:0xa4:Completed 3750000 out of 5000000 steps (75%)
04:58:40:WU01:FS03:0xa4:Completed 3800000 out of 5000000 steps (76%)
04:59:15:WU03:FS02:0x17:Completed 1800000 out of 2000000 steps (90%)
04:59:58:WU01:FS03:0xa4:Completed 3850000 out of 5000000 steps (77%)
05:00:16:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:900 clone:1 gen:55 core:0x17 unit:0x0000004f028c126651a6eeda3445c957
05:00:16:WU02:FS02:Uploading 51.36MiB to 171.64.65.69
05:00:16:WU02:FS02:Connecting to 171.64.65.69:8080
05:00:17:WARNING:WU02:FS02:Exception: Failed to send results to work server: Transfer failed
05:00:17:WU02:FS02:Trying to send results to collection server
05:00:17:WU02:FS02:Uploading 51.36MiB to 171.65.103.160
05:00:17:WU02:FS02:Connecting to 171.65.103.160:8080
05:00:17:ERROR:WU02:FS02:Exception: Transfer failed
05:00:18:WU04:FS01:0x17:Completed 1420000 out of 2000000 steps (71%)
05:01:15:WU01:FS03:0xa4:Completed 3900000 out of 5000000 steps (78%)
05:02:31:WU01:FS03:0xa4:Completed 3950000 out of 5000000 steps (79%)
05:02:59:WU03:FS02:0x17:Completed 1820000 out of 2000000 steps (91%)
05:03:48:WU01:FS03:0xa4:Completed 4000000 out of 5000000 steps (80%)
05:04:48:WU04:FS01:0x17:Completed 1440000 out of 2000000 steps (72%)
05:05:04:WU01:FS03:0xa4:Completed 4050000 out of 5000000 steps (81%)
05:06:20:WU01:FS03:0xa4:Completed 4100000 out of 5000000 steps (82%)
05:06:39:WU03:FS02:0x17:Completed 1840000 out of 2000000 steps (92%)
05:07:36:WU01:FS03:0xa4:Completed 4150000 out of 5000000 steps (83%)
05:08:53:WU01:FS03:0xa4:Completed 4200000 out of 5000000 steps (84%)
05:09:23:WU04:FS01:0x17:Completed 1460000 out of 2000000 steps (73%)
05:10:10:WU01:FS03:0xa4:Completed 4250000 out of 5000000 steps (85%)
05:10:23:WU03:FS02:0x17:Completed 1860000 out of 2000000 steps (93%)
05:11:28:WU01:FS03:0xa4:Completed 4300000 out of 5000000 steps (86%)
05:12:44:WU01:FS03:0xa4:Completed 4350000 out of 5000000 steps (87%)
05:13:53:WU04:FS01:0x17:Completed 1480000 out of 2000000 steps (74%)
05:14:01:WU01:FS03:0xa4:Completed 4400000 out of 5000000 steps (88%)
05:14:03:WU03:FS02:0x17:Completed 1880000 out of 2000000 steps (94%)
05:15:17:WU01:FS03:0xa4:Completed 4450000 out of 5000000 steps (89%)
05:16:33:WU01:FS03:0xa4:Completed 4500000 out of 5000000 steps (90%)
05:17:44:WU03:FS02:0x17:Completed 1900000 out of 2000000 steps (95%)
05:17:49:WU01:FS03:0xa4:Completed 4550000 out of 5000000 steps (91%)
05:18:23:WU04:FS01:0x17:Completed 1500000 out of 2000000 steps (75%)
05:19:06:WU01:FS03:0xa4:Completed 4600000 out of 5000000 steps (92%)
05:20:22:WU01:FS03:0xa4:Completed 4650000 out of 5000000 steps (93%)
05:21:28:WU03:FS02:0x17:Completed 1920000 out of 2000000 steps (96%)
05:21:39:WU01:FS03:0xa4:Completed 4700000 out of 5000000 steps (94%)
05:22:55:WU01:FS03:0xa4:Completed 4750000 out of 5000000 steps (95%)
05:22:57:WU04:FS01:0x17:Completed 1520000 out of 2000000 steps (76%)
05:24:11:WU01:FS03:0xa4:Completed 4800000 out of 5000000 steps (96%)
05:25:08:WU03:FS02:0x17:Completed 1940000 out of 2000000 steps (97%)
05:25:27:WU01:FS03:0xa4:Completed 4850000 out of 5000000 steps (97%)
05:26:42:WU01:FS03:0xa4:Completed 4900000 out of 5000000 steps (98%)
05:26:43:WU00:FS03:Connecting to assign3.stanford.edu:8080
05:26:44:WU00:FS03:News: Welcome to Folding@Home
05:26:44:WU00:FS03:Assigned to work server 171.64.65.101
05:26:44:WU00:FS03:Requesting new work unit for slot 03: RUNNING cpu:6 from 171.64.65.101
05:26:44:WU00:FS03:Connecting to 171.64.65.101:8080
05:26:44:WU00:FS03:Downloading 533.54KiB
05:26:45:WU00:FS03:Download complete
05:26:45:WU00:FS03:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:7646 run:76 clone:2 gen:137 core:0xa4 unit:0x00000116664f2dcd4fa7fe069acb8886
05:27:28:WU04:FS01:0x17:Completed 1540000 out of 2000000 steps (77%)
05:27:59:WU01:FS03:0xa4:Completed 4950000 out of 5000000 steps (99%)
05:28:52:WU03:FS02:0x17:Completed 1960000 out of 2000000 steps (98%)
05:29:14:WU01:FS03:0xa4:Completed 5000000 out of 5000000 steps (100%)
05:29:14:WU01:FS03:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
05:29:24:WU01:FS03:0xa4:
05:29:24:WU01:FS03:0xa4:Finished Work Unit:
05:29:24:WU01:FS03:0xa4:- Reading up to 826584 from "01/wudata_01.trr": Read 826584
05:29:24:WU01:FS03:0xa4:trr file hash check passed.
05:29:24:WU01:FS03:0xa4:- Reading up to 60644 from "01/wudata_01.xtc": Read 60644
05:29:24:WU01:FS03:0xa4:xtc file hash check passed.
05:29:24:WU01:FS03:0xa4:edr file hash check passed.
05:29:24:WU01:FS03:0xa4:logfile size: 82670
05:29:24:WU01:FS03:0xa4:Leaving Run
05:29:25:WU01:FS03:0xa4:- Writing 1040530 bytes of core data to disk...
05:29:25:WU01:FS03:0xa4:Done: 1040018 -> 873747 (compressed to 84.0 percent)
05:29:25:WU01:FS03:0xa4: ... Done.
05:29:42:WU01:FS03:0xa4:- Shutting down core
05:29:42:WU01:FS03:0xa4:
05:29:42:WU01:FS03:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
05:29:43:WU01:FS03:FahCore returned: FINISHED_UNIT (100 = 0x64)
05:29:44:WU01:FS03:Sending unit results: id:01 state:SEND error:NO_ERROR project:6361 run:3 clone:187 gen:0 core:0xa4 unit:0x000000030002894b522e9156df38a84d
05:29:44:WU01:FS03:Uploading 853.77KiB to 155.247.166.219
05:29:44:WU01:FS03:Connecting to 155.247.166.219:8080
05:29:44:WU00:FS03:Starting
05:29:44:WU00:FS03:Running FahCore: /usr/bin/FAHCoreWrapper /home/hootis/cores/www.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 00 -suffix 01 -version 703 -lifeline 2555 -checkpoint 15 -np 6
05:29:44:WU00:FS03:Started FahCore on PID 2777
05:29:44:WU00:FS03:Core PID:2781
05:29:44:WU00:FS03:FahCore 0xa4 started
05:29:44:WU01:FS03:Upload complete
05:29:44:WU01:FS03:Server responded WORK_ACK (400)
05:29:44:WU01:FS03:Final credit estimate, 1508.00 points
05:29:44:WU00:FS03:0xa4:
05:29:44:WU00:FS03:0xa4:*------------------------------*
05:29:44:WU00:FS03:0xa4:Folding@Home Gromacs GB Core
05:29:44:WU00:FS03:0xa4:Version 2.27 (Dec. 15, 2010)
05:29:44:WU00:FS03:0xa4:
05:29:44:WU00:FS03:0xa4:Preparing to commence simulation
05:29:44:WU00:FS03:0xa4:- Looking at optimizations...
05:29:44:WU00:FS03:0xa4:- Created dyn
05:29:44:WU00:FS03:0xa4:- Files status OK
05:29:44:WU00:FS03:0xa4:- Expanded 545828 -> 843248 (decompressed 154.4 percent)
05:29:44:WU00:FS03:0xa4:Called DecompressByteArray: compressed_data_size=545828 data_size=843248, decompressed_data_size=843248 diff=0
05:29:44:WU00:FS03:0xa4:- Digital signature verified
05:29:44:WU00:FS03:0xa4:
05:29:44:WU00:FS03:0xa4:Project: 7646 (Run 76, Clone 2, Gen 137)
05:29:44:WU00:FS03:0xa4:
05:29:44:WU00:FS03:0xa4:Assembly optimizations on if available.
05:29:44:WU00:FS03:0xa4:Entering M.D.
05:29:44:WU01:FS03:Cleaning up
05:29:50:WU00:FS03:0xa4:Completed 0 out of 2500000 steps (0%)
05:32:01:WU04:FS01:0x17:Completed 1560000 out of 2000000 steps (78%)
05:32:33:WU03:FS02:0x17:Completed 1980000 out of 2000000 steps (99%)
05:33:40:WU00:FS03:0xa4:mdrun returned 255
05:33:40:WU00:FS03:0xa4:Going to send back what have done -- stepsTotalG=2500000
05:33:40:WU00:FS03:0xa4:Work fraction=58567.0273 steps=2500000.
05:33:44:WU00:FS03:0xa4:logfile size=12147 infoLength=12147 edr=25 trr=1
05:33:44:WU00:FS03:0xa4:logfile size: 12147 info=12147 bed=25 hdr=1
05:33:44:WU00:FS03:0xa4:- Writing 12685 bytes of core data to disk...
05:33:44:WU00:FS03:0xa4:Done: 12173 -> 4273 (compressed to 35.1 percent)
05:33:44:WU00:FS03:0xa4: ... Done.
05:34:05:WU00:FS03:0xa4:
05:34:05:WU00:FS03:0xa4:Folding@home Core Shutdown: UNSTABLE_MACHINE
05:34:06:WARNING:WU00:FS03:FahCore returned: UNSTABLE_MACHINE (122 = 0x7a)
05:34:06:WU00:FS03:Sending unit results: id:00 state:SEND error:FAULTY project:7646 run:76 clone:2 gen:137 core:0xa4 unit:0x00000116664f2dcd4fa7fe069acb8886
05:34:06:WU00:FS03:Uploading 4.67KiB to 171.64.65.101
05:34:06:WU00:FS03:Connecting to 171.64.65.101:8080
05:34:06:WU00:FS03:Upload complete
05:34:06:WU00:FS03:Server responded WORK_ACK (400)
05:34:06:WU00:FS03:Cleaning up
05:34:06:WU01:FS03:Connecting to assign3.stanford.edu:8080
05:34:07:WU01:FS03:News: Welcome to Folding@Home
05:34:07:WU01:FS03:Assigned to work server 171.64.65.99
05:34:07:WU01:FS03:Requesting new work unit for slot 03: READY cpu:6 from 171.64.65.99
05:34:07:WU01:FS03:Connecting to 171.64.65.99:8080
05:34:08:WU01:FS03:Downloading 1.98MiB
05:34:09:WU01:FS03:Download complete
05:34:09:WU01:FS03:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:7809 run:7 clone:25 gen:217 core:0xa4 unit:0x000001210a3b1e874e3113d30475f89c
05:34:09:WU01:FS03:Starting
05:34:09:WU01:FS03:Running FahCore: /usr/bin/FAHCoreWrapper /home/hootis/cores/www.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 01 -suffix 01 -version 703 -lifeline 2555 -checkpoint 15 -np 6
05:34:09:WU01:FS03:Started FahCore on PID 2792
05:34:09:WU01:FS03:Core PID:2796
05:34:09:WU01:FS03:FahCore 0xa4 started
05:34:10:WU01:FS03:0xa4:
05:34:10:WU01:FS03:0xa4:*------------------------------*
05:34:10:WU01:FS03:0xa4:Folding@Home Gromacs GB Core
05:34:10:WU01:FS03:0xa4:Version 2.27 (Dec. 15, 2010)
05:34:10:WU01:FS03:0xa4:
05:34:10:WU01:FS03:0xa4:Preparing to commence simulation
05:34:10:WU01:FS03:0xa4:- Looking at optimizations...
05:34:10:WU01:FS03:0xa4:- Created dyn
05:34:10:WU01:FS03:0xa4:- Files status OK
05:34:10:WU01:FS03:0xa4:- Expanded 2079546 -> 5386224 (decompressed 259.0 percent)
05:34:10:WU01:FS03:0xa4:Called DecompressByteArray: compressed_data_size=2079546 data_size=5386224, decompressed_data_size=5386224 diff=0
05:34:10:WU01:FS03:0xa4:- Digital signature verified
05:34:10:WU01:FS03:0xa4:
05:34:10:WU01:FS03:0xa4:Project: 7809 (Run 7, Clone 25, Gen 217)
05:34:10:WU01:FS03:0xa4:
05:34:10:WU01:FS03:0xa4:Assembly optimizations on if available.
05:34:10:WU01:FS03:0xa4:Entering M.D.
05:34:16:WU01:FS03:0xa4:Completed 0 out of 1500000 steps (0%)
05:36:14:WU03:FS02:0x17:Completed 2000000 out of 2000000 steps (100%)
05:36:15:WU00:FS02:Connecting to assign-GPU.stanford.edu:80
05:36:15:WU00:FS02:News: Welcome to Folding@Home
05:36:15:WU00:FS02:Assigned to work server 171.64.65.98
05:36:15:WU00:FS02:Requesting new work unit for slot 02: RUNNING gpu:1:GF114 [GeForce GTX 560 Ti] from 171.64.65.98
05:36:15:WU00:FS02:Connecting to 171.64.65.98:8080
05:36:16:WU00:FS02:Downloading 2.09MiB
05:36:17:WU03:FS02:0x17:Saving result file logfile_01.txt
05:36:17:WU03:FS02:0x17:Saving result file badStateCheckpoint_1942774630
05:36:17:WU00:FS02:Download complete
05:36:17:WU00:FS02:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:7810 run:0 clone:664 gen:276 core:0x17 unit:0x000001260a3b1e8651d34d2bd3218199
05:36:18:WU03:FS02:0x17:Saving result file badStateForceGroup0_1942774630Core.xml
05:36:19:WU03:FS02:0x17:Saving result file badStateForceGroup0_1942774630Ref.xml
05:36:20:WU03:FS02:0x17:Saving result file badStateForceGroup1_1942774630Core.xml
05:36:21:WU03:FS02:0x17:Saving result file badStateForceGroup1_1942774630Ref.xml
05:36:23:WU03:FS02:0x17:Saving result file badStateForceGroup2_1942774630Core.xml
05:36:24:WU03:FS02:0x17:Saving result file badStateForceGroup2_1942774630Ref.xml
05:36:25:WU03:FS02:0x17:Saving result file checkpointState.xml
05:36:26:WU03:FS02:0x17:Saving result file checkpt.crc
05:36:26:WU03:FS02:0x17:Saving result file log.txt
05:36:26:WU03:FS02:0x17:Saving result file positions.xtc
05:36:27:WU03:FS02:0x17:Folding@home Core Shutdown: FINISHED_UNIT
05:36:27:WU03:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
05:36:27:WU03:FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:7811 run:0 clone:373 gen:415 core:0x17 unit:0x000001bf0a3b1e8651db49823e02c846
05:36:27:WU03:FS02:Uploading 5.71MiB to 171.64.65.98
05:36:27:WU03:FS02:Connecting to 171.64.65.98:8080
05:36:27:WU00:FS02:Starting
05:36:27:WU00:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /home/hootis/cores/www.stanford.edu/~pande/Linux/AMD64/NVIDIA/Fermi/beta/Core_17.fah/FahCore_17 -dir 00 -suffix 01 -version 703 -lifeline 2555 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
05:36:27:WU00:FS02:Started FahCore on PID 2806
05:36:27:WU00:FS02:Core PID:2810
05:36:27:WU00:FS02:FahCore 0x17 started
05:36:28:WU00:FS02:0x17:*********************** Log Started 2013-10-13T05:36:27Z ***********************
05:36:28:WU00:FS02:0x17:Project: 7810 (Run 0, Clone 664, Gen 276)
05:36:28:WU00:FS02:0x17:Unit: 0x000001260a3b1e8651d34d2bd3218199
05:36:28:WU00:FS02:0x17:CPU: 0x00000000000000000000000000000000
05:36:28:WU00:FS02:0x17:Machine: 2
05:36:28:WU00:FS02:0x17:Reading tar file state.xml
05:36:28:WU00:FS02:0x17:Reading tar file system.xml
05:36:28:WU00:FS02:0x17:Reading tar file integrator.xml
05:36:28:WU00:FS02:0x17:Reading tar file core.xml
05:36:28:WU00:FS02:0x17:Digital signatures verified
05:36:32:WU04:FS01:0x17:Completed 1580000 out of 2000000 steps (79%)
05:36:33:WU03:FS02:Upload 96.37%
05:36:37:WU03:FS02:Upload complete
05:36:37:WU03:FS02:Server responded WORK_ACK (400)
05:36:37:WU03:FS02:Final credit estimate, 4271.00 points
05:36:37:WU03:FS02:Cleaning up
05:36:50:WU00:FS02:0x17:Completed 0 out of 2000000 steps (0%)
05:41:03:WU04:FS01:0x17:Completed 1600000 out of 2000000 steps (80%)
05:41:51:WU00:FS02:0x17:Completed 20000 out of 2000000 steps (1%)
05:43:54:WU01:FS03:0xa4:Completed 15000 out of 1500000 steps (1%)
05:45:37:WU04:FS01:0x17:Completed 1620000 out of 2000000 steps (81%)
05:46:49:WU00:FS02:0x17:Completed 40000 out of 2000000 steps (2%)
05:50:08:WU04:FS01:0x17:Completed 1640000 out of 2000000 steps (82%)
05:51:51:WU00:FS02:0x17:Completed 60000 out of 2000000 steps (3%)
05:53:31:WU01:FS03:0xa4:Completed 30000 out of 1500000 steps (2%)
05:54:43:WU04:FS01:0x17:Completed 1660000 out of 2000000 steps (83%)
05:56:48:WU00:FS02:0x17:Completed 80000 out of 2000000 steps (4%)
05:59:14:WU04:FS01:0x17:Completed 1680000 out of 2000000 steps (84%)
06:01:46:WU00:FS02:0x17:Completed 100000 out of 2000000 steps (5%)
06:03:32:WU01:FS03:0xa4:Completed 45000 out of 1500000 steps (3%)
06:03:45:WU04:FS01:0x17:Completed 1700000 out of 2000000 steps (85%)
Yea, bruce its not a problem just want to check rather than letting it timeout.
Things yet to materialize.