128.143.231.201 or Bigadv Collection server broken

Moderators: Site Moderators, FAHC Science Team

Grandpa_01
Posts: 1122
Joined: Wed Mar 04, 2009 7:36 am
Hardware configuration: 3 - Supermicro H8QGi-F AMD MC 6174=144 cores 2.5Ghz, 96GB G.Skill DDR3 1333Mhz Ubuntu 10.10
2 - Asus P6X58D-E i7 980X 4.4Ghz 6GB DDR3 2000 A-Data 64GB SSD Ubuntu 10.10
1 - Asus Rampage Gene III 17 970 4.3Ghz DDR3 2000 2-500GB Segate 7200.11 0-Raid Ubuntu 10.10
1 - Asus G73JH Laptop i7 740QM 1.86Ghz ATI 5870M

128.143.231.201 or Bigadv Collection server broken

Post by Grandpa_01 »

The last 3 bigadv WU's I have returned the message the server has reported a problem with this unit has come up after sending, and then I get reassigned the same WU to run again, This is on 2 different machines and others have reported the same thing happening to them. There were a lot of 0's in the bigadv folders updates on the 12 AM EOC updates. In both cases it is not possible that I had previousley been assighned the WU and crashed it because in both cases I had folded the previous WU in the series and the ones that are showing the problem were not even created until I fished the previous one. The problem is on the Stanford server end of things. :wink:

Code: Select all

[00:32:02] Completed 250000 out of 250000 steps  (100%)
[00:32:47] DynamicWrapper: Finished Work Unit: sleep=10000
[00:32:57] 
[00:32:57] Finished Work Unit:
[00:32:57] - Reading up to 64407792 from "work/wudata_07.trr": Read 64407792
[00:33:16] trr file hash check passed.
[00:33:16] - Reading up to 31749260 from "work/wudata_07.xtc": Read 31749260
[00:33:17] xtc file hash check passed.
[00:33:17] edr file hash check passed.
[00:33:17] logfile size: 190159
[00:33:17] Leaving Run
[00:33:20] - Writing 96508087 bytes of core data to disk...
[00:33:43] Done: 96507575 -> 91747659 (compressed to 6.0 percent)
[00:33:44]   ... Done.
[00:33:54] - Shutting down core
[00:33:54] 
[00:33:54] Folding@home Core Shutdown: FINISHED_UNIT
[00:33:56] CoreStatus = 64 (100)
[00:33:56] Unit 7 finished with 86 percent of time to deadline remaining.
[00:33:56] Updated performance fraction: 0.828753
[00:33:56] Sending work to server
[00:33:56] Project: 8102 (Run 0, Clone 18, Gen 65)


[00:33:56] + Attempting to send results [September 30 00:33:56 UTC]
[00:33:56] - Reading file work/wuresults_07.dat from core
[00:33:56]   (Read 91748171 bytes from disk)
[00:33:56] Connecting to http://128.143.231.201:8080/
[00:39:31] Posted data.
[00:39:31] Initial: 0000; - Uploaded at ~267 kB/s
[00:39:31] - Averaged speed for that direction ~260 kB/s
[00:39:31] - Server reports problem with unit.
[00:39:31] Trying to send all finished work units
[00:39:31] + No unsent completed units remaining.
[00:39:31] - Preparing to get new work unit...
[00:39:31] Cleaning up work directory
[00:39:31] + Attempting to get work packet
[00:39:31] Passkey found
[00:39:31] - Will indicate memory of 32234 MB
[00:39:31] - Connecting to assignment server
[00:39:31] Connecting to http://assign.stanford.edu:8080/
[00:39:31] Posted data.
[00:39:31] Initial: 8F80; - Successful: assigned to (128.143.231.201).
[00:39:31] + News From Folding@Home: Welcome to Folding@Home
[00:39:32] Loaded queue successfully.
[00:39:32] Sent data
[00:39:32] Connecting to http://128.143.231.201:8080/
[00:39:39] Posted data.
[00:39:39] Initial: 0000; - Receiving payload (expected size: 30336617)
[00:39:58] - Downloaded at ~1559 kB/s
[00:39:58] - Averaged speed for that direction ~1661 kB/s
[00:39:58] + Received work.
[00:39:58] Trying to send all finished work units
[00:39:58] + No unsent completed units remaining.
[00:39:58] + Closed connections
[00:39:58] 
[00:39:58] + Processing work unit
[00:39:58] Core required: FahCore_a5.exe
[00:39:58] Core found.
[00:39:58] Working on queue slot 08 [September 30 00:39:58 UTC]
[00:39:58] + Working ...
[00:39:58] - Calling './FahCore_a5.exe -dir work/ -nice 19 -suffix 08 -np 48 -checkpoint 15 -verbose -lifeline 4080 -version 634'

[00:39:58] 
[00:39:58] *------------------------------*
[00:39:58] Folding@Home Gromacs SMP Core
[00:39:58] Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
[00:39:58] 
[00:39:58] Preparing to commence simulation
[00:39:58] - Looking at optimizations...
[00:39:58] - Created dyn
[00:39:58] - Files status OK
[00:40:01] - Expanded 30336105 -> 33163648 (decompressed 109.3 percent)
[00:40:01] Called DecompressByteArray: compressed_data_size=30336105 data_size=33163648, decompressed_data_size=33163648 diff=0
[00:40:01] - Digital signature verified
[00:40:01] 
[00:40:01] Project: 8102 (Run 0, Clone 18, Gen 65)
[00:40:01] 
[00:40:01] Assembly optimizations on if available.
[00:40:01] Entering M.D.
[00:40:09] Mapping NT from 48 to 48 
[00:40:11] Completed 0 out of 250000 steps  (0%)

Code: Select all

[05:40:42] Completed 250000 out of 250000 steps  (100%)

Writing final coordinates.

 Average load imbalance: 0.6 %
 Part of the total run time spent waiting due to load imbalance: 0.2 %
 Steps where the load balancing was limited by -rdd, -rcon and/or -dds: X 0 % Y 0 %


	Parallel run - timing based on wallclock.

               NODE (s)   Real (s)      (%)
       Time:  49548.447  49548.447    100.0
                       13h45:48
               (Mnbf/s)   (GFlops)   (ns/day)  (hour/ns)
Performance:   2199.300    113.900      1.744     13.763

Thanx for Using GROMACS - Have a Nice Day

[05:42:26] DynamicWrapper: Finished Work Unit: sleep=10000
[05:42:36] 
[05:42:36] Finished Work Unit:
[05:42:37] - Reading up to 64407792 from "work/wudata_02.trr": Read 64407792
[05:43:53] trr file hash check passed.
[05:44:56] - Reading up to 31749936 from "work/wudata_02.xtc": Read 31749936
[05:44:56] xtc file hash check passed.
[05:44:56] edr file hash check passed.
[05:44:56] logfile size: 190273
[05:44:56] Leaving Run
[05:45:01] - Writing 96508877 bytes of core data to disk...
[05:45:23] Done: 96508365 -> 91766720 (compressed to 6.0 percent)
[05:45:24]   ... Done.
[05:45:36] - Shutting down core
[05:45:36] 
[05:45:36] Folding@home Core Shutdown: FINISHED_UNIT
[05:45:38] CoreStatus = 64 (100)
[05:45:38] Sending work to server
[05:45:38] Project: 8102 (Run 0, Clone 21, Gen 87)


[05:45:38] + Attempting to send results [September 30 05:45:38 UTC]
[05:51:15] - Server reports problem with unit.
[05:51:15] - Preparing to get new work unit...
[05:51:15] Cleaning up work directory
[05:51:17] + Attempting to get work packet
[05:51:17] Passkey found
[05:51:17] - Connecting to assignment server
[05:51:17] - Successful: assigned to (128.143.231.201).
[05:51:17] + News From Folding@Home: Welcome to Folding@Home
[05:51:17] Loaded queue successfully.
[05:51:44] + Closed connections
[05:51:44] 
[05:51:44] + Processing work unit
[05:51:44] Core required: FahCore_a5.exe
[05:51:44] Core found.
[05:51:44] Working on queue slot 03 [September 30 05:51:44 UTC]
[05:51:44] + Working ...
thekraken: The Kraken 0.7-pre15 (compiled Sat Jun 16 11:22:13 PDT 2012 by rick@rick-H8QG6)
thekraken: Processor affinity wrapper for Folding@Home
thekraken: The Kraken comes with ABSOLUTELY NO WARRANTY; licensed under GPLv2
thekraken: PID: 9843
thekraken: Logging to thekraken.log
[05:51:44] 
[05:51:44] *------------------------------*
[05:51:44] Folding@Home Gromacs SMP Core
[05:51:44] Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
[05:51:44] 
[05:51:44] Preparing to commence simulation
[05:51:44] - Looking at optimizations...
[05:51:44] - Created dyn
[05:51:44] - Files status OK
[05:51:47] - Expanded 30337264 -> 33163648 (decompressed 109.3 percent)
[05:51:47] Called DecompressByteArray: compressed_data_size=30337264 data_size=33163648, decompressed_data_size=33163648 diff=0
[05:51:47] - Digital signature verified
[05:51:47] 
[05:51:47] Project: 8102 (Run 0, Clone 21, Gen 87)
[05:51:47] 
[05:51:47] Assembly optimizations on if available.
[05:51:47] Entering M.D.
                         :-)  G  R  O  M  A  C  S  (-:

                   Groningen Machine for Chemical Simulation

                            :-)  VERSION 4.5.3  (-:

        Written by Emile Apol, Rossen Apostolov, Herman J.C. Berendsen,
      Aldert van Buuren, Pär Bjelkmar, Rudi van Drunen, Anton Feenstra, 
        Gerrit Groenhof, Peter Kasson, Per Larsson, Pieter Meulenhoff, 
           Teemu Murtola, Szilard Pall, Sander Pronk, Roland Schulz, 
                Michael Shirts, Alfons Sijbers, Peter Tieleman,

               Berk Hess, David van der Spoel, and Erik Lindahl.

       Copyright (c) 1991-2000, University of Groningen, The Netherlands.
            Copyright (c) 2001-2010, The GROMACS development team at
        Uppsala University & The Royal Institute of Technology, Sweden.
            check out http://www.gromacs.org for more information.


                               :-)  Gromacs  (-:

Reading file work/wudata_03.tpr, VERSION 4.5.5-dev-20120903-d64b9e3 (single precision)
[05:51:54] Mapping NT from 48 to 48 
Starting 48 threads
Making 2D domain decomposition 12 x 4 x 1
starting mdrun 'FP_membrane in water'
22000000 steps,  88000.0 ps (continuing from step 21750000,  87000.0 ps).
[05:51:59] Completed 0 out of 250000 steps  (0%)

NOTE: Turning on dynamic load balancing


Code: Select all

07:00:24] Completed 247500 out of 250000 steps  (99%)
[07:08:04] Completed 250000 out of 250000 steps  (100%)

Writing final coordinates.

 Average load imbalance: 0.4 %
 Part of the total run time spent waiting due to load imbalance: 0.1 %
 Steps where the load balancing was limited by -rdd, -rcon and/or -dds: X 0 % Y 0 %


	Parallel run - timing based on wallclock.

               NODE (s)   Real (s)      (%)
       Time:  42402.010  42402.010    100.0
                       11h46:42
               (Mnbf/s)   (GFlops)   (ns/day)  (hour/ns)
Performance:   2368.943    122.680      1.878     12.779

Thanx for Using GROMACS - Have a Nice Day

[07:09:09] DynamicWrapper: Finished Work Unit: sleep=10000
[07:09:19] 
[07:09:19] Finished Work Unit:
[07:09:19] - Reading up to 64407792 from "work/wudata_03.trr": Read 64407792
[07:09:20] trr file hash check passed.
[07:09:20] - Reading up to 31748100 from "work/wudata_03.xtc": Read 31748100
[07:09:20] xtc file hash check passed.
[07:09:20] edr file hash check passed.
[07:09:20] logfile size: 190846
[07:09:20] Leaving Run
[07:09:23] - Writing 96507614 bytes of core data to disk...
[07:09:45] Done: 96507102 -> 91777511 (compressed to 6.0 percent)
[07:09:45]   ... Done.
[07:09:57] - Shutting down core
[07:09:57] 
[07:09:57] Folding@home Core Shutdown: FINISHED_UNIT
[07:09:59] CoreStatus = 64 (100)
[07:09:59] Unit 3 finished with 86 percent of time to deadline remaining.
[07:09:59] Updated performance fraction: 0.842553
[07:09:59] Sending work to server
[07:09:59] Project: 8102 (Run 0, Clone 27, Gen 82)


[07:09:59] + Attempting to send results [September 30 07:09:59 UTC]
[07:09:59] - Reading file work/wuresults_03.dat from core
[07:09:59]   (Read 91778023 bytes from disk)
[07:09:59] Connecting to http://128.143.231.201:8080/
[07:15:35] Posted data.
[07:15:35] Initial: 0000; - Uploaded at ~266 kB/s
[07:15:35] - Averaged speed for that direction ~259 kB/s
[07:15:35] - Server reports problem with unit.
[07:15:35] Trying to send all finished work units
[07:15:35] + No unsent completed units remaining.
[07:15:35] - Preparing to get new work unit...
[07:15:35] Cleaning up work directory
[07:15:36] + Attempting to get work packet
[07:15:36] Passkey found
[07:15:36] - Will indicate memory of 32234 MB
[07:15:36] - Connecting to assignment server
[07:15:36] Connecting to http://assign.stanford.edu:8080/
[07:15:36] Posted data.
[07:15:36] Initial: 8F80; - Successful: assigned to (128.143.231.201).
[07:15:36] + News From Folding@Home: Welcome to Folding@Home
[07:15:37] Loaded queue successfully.
[07:15:37] Sent data
[07:15:37] Connecting to http://128.143.231.201:8080/
[07:15:43] Posted data.
[07:15:43] Initial: 0000; - Receiving payload (expected size: 30348695)
[07:16:05] - Downloaded at ~1347 kB/s
[07:16:05] - Averaged speed for that direction ~1583 kB/s
[07:16:05] + Received work.
[07:16:05] Trying to send all finished work units
[07:16:05] + No unsent completed units remaining.
[07:16:05] + Closed connections
[07:16:05] 
[07:16:05] + Processing work unit
[07:16:05] Core required: FahCore_a5.exe
[07:16:05] Core found.
[07:16:05] Working on queue slot 04 [September 30 07:16:05 UTC]
[07:16:05] + Working ...
[07:16:05] - Calling './FahCore_a5.exe -dir work/ -nice 19 -suffix 04 -np 48 -checkpoint 15 -verbose -lifeline 5440 -version 634'

thekraken: The Kraken 0.7-pre15 (compiled Sun Jun 17 18:12:50 PDT 2012 by rick1@rick1-H8QG6)
thekraken: Processor affinity wrapper for Folding@Home
thekraken: The Kraken comes with ABSOLUTELY NO WARRANTY; licensed under GPLv2
thekraken: PID: 6161
thekraken: Logging to thekraken.log
[07:16:05] 
[07:16:05] *------------------------------*
[07:16:05] Folding@Home Gromacs SMP Core
[07:16:05] Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
[07:16:05] 
[07:16:05] Preparing to commence simulation
[07:16:05] - Looking at optimizations...
[07:16:05] - Created dyn
[07:16:05] - Files status OK
[07:16:08] - Expanded 30348183 -> 33163648 (decompressed 109.2 percent)
[07:16:08] Called DecompressByteArray: compressed_data_size=30348183 data_size=33163648, decompressed_data_size=33163648 diff=0
[07:16:08] - Digital signature verified
[07:16:08] 
[07:16:08] Project: 8102 (Run 0, Clone 27, Gen 82)
[07:16:08] 
[07:16:08] Assembly optimizations on if available.
[07:16:08] Entering M.D.
                         :-)  G  R  O  M  A  C  S  (-:

                   Groningen Machine for Chemical Simulation

                            :-)  VERSION 4.5.3  (-:

        Written by Emile Apol, Rossen Apostolov, Herman J.C. Berendsen,
      Aldert van Buuren, Pär Bjelkmar, Rudi van Drunen, Anton Feenstra, 
        Gerrit Groenhof, Peter Kasson, Per Larsson, Pieter Meulenhoff, 
           Teemu Murtola, Szilard Pall, Sander Pronk, Roland Schulz, 
                Michael Shirts, Alfons Sijbers, Peter Tieleman,

               Berk Hess, David van der Spoel, and Erik Lindahl.

       Copyright (c) 1991-2000, University of Groningen, The Netherlands.
            Copyright (c) 2001-2010, The GROMACS development team at
        Uppsala University & The Royal Institute of Technology, Sweden.
            check out http://www.gromacs.org for more information.


                               :-)  Gromacs  (-:

Reading file work/wudata_04.tpr, VERSION 4.5.5-dev-20120903-d64b9e3 (single precision)
[07:16:15] Mapping NT from 48 to 48 
Starting 48 threads
Making 2D domain decomposition 12 x 4 x 1
starting mdrun 'FP_membrane in water'
20750000 steps,  83000.0 ps (continuing from step 20500000,  82000.0 ps).
[07:16:18] Completed 0 out of 250000 steps  (0%)

Last edited by Grandpa_01 on Sun Sep 30, 2012 7:21 am, edited 1 time in total.
Image
2 - SM H8QGi-F AMD 6xxx=112 cores @ 3.2 & 3.9Ghz
5 - SM X9QRI-f+ Intel 4650 = 320 cores @ 3.15Ghz
2 - I7 980X 4.4Ghz 2-GTX680
1 - 2700k 4.4Ghz GTX680
Total = 464 cores folding
bollix47
Posts: 2946
Joined: Sun Dec 02, 2007 5:04 am
Location: Canada

Re: Bigadv Collection and or Assighnment server is broken

Post by bollix47 »

I can confirm the dumping but because I'm using v7 I obviously didn't get the same WU again.

Code: Select all

project:8101 run:23 clone:6 gen:41

02:53:20:WU00:FS00:0xa5:Completed 237500 out of 250000 steps  (95%)
03:07:16:WU00:FS00:0xa5:Completed 240000 out of 250000 steps  (96%)
03:21:12:WU00:FS00:0xa5:Completed 242500 out of 250000 steps  (97%)
03:35:07:WU00:FS00:0xa5:Completed 245000 out of 250000 steps  (98%)
03:49:03:WU00:FS00:0xa5:Completed 247500 out of 250000 steps  (99%)
04:03:01:WU00:FS00:0xa5:Completed 250000 out of 250000 steps  (100%)
04:03:01:WU01:FS00:Connecting to assign3.stanford.edu:8080
04:03:01:WU01:FS00:News: Welcome to Folding@Home
04:03:01:WU01:FS00:Assigned to work server 128.143.231.201
04:03:01:WU01:FS00:Requesting new work unit for slot 00: RUNNING smp:64 from 128.143.231.201
04:03:01:WU01:FS00:Connecting to 128.143.231.201:8080
04:03:08:WU01:FS00:Downloading 28.91MiB
04:03:14:WU01:FS00:Download 38.27%
04:03:17:WU00:FS00:0xa5:DynamicWrapper: Finished Work Unit: sleep=10000
04:03:20:WU01:FS00:Download 80.65%
04:03:26:WU01:FS00:Download 94.92%
04:03:27:WU01:FS00:Download complete
04:03:27:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:OK project:8101 run:2 clone:11 gen:4 core:0xa5 unit:0x00000009088988e14f0e22c066b7bc72
04:03:27:WU00:FS00:0xa5:
04:03:27:WU00:FS00:0xa5:Finished Work Unit:
04:03:27:WU00:FS00:0xa5:- Reading up to 64340496 from "00/wudata_01.trr": Read 64340496
04:03:28:WU00:FS00:0xa5:trr file hash check passed.
04:03:28:WU00:FS00:0xa5:- Reading up to 31617836 from "00/wudata_01.xtc": Read 31617836
04:03:28:WU00:FS00:0xa5:xtc file hash check passed.
04:03:28:WU00:FS00:0xa5:edr file hash check passed.
04:03:28:WU00:FS00:0xa5:logfile size: 198203
04:03:28:WU00:FS00:0xa5:Leaving Run
04:03:31:WU00:FS00:0xa5:- Writing 96317411 bytes of core data to disk...
04:04:03:WU00:FS00:0xa5:Done: 96316899 -> 91544571 (compressed to 5.8 percent)
04:04:03:WU00:FS00:0xa5:  ... Done.
04:04:15:WU00:FS00:0xa5:- Shutting down core
04:04:15:WU00:FS00:0xa5:
04:04:15:WU00:FS00:0xa5:Folding@home Core Shutdown: FINISHED_UNIT
04:04:17:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
04:04:17:WU00:FS00:Sending unit results: id:00 state:SEND error:OK project:8101 run:23 clone:6 gen:41 core:0xa5 unit:0x00000046088988e14f9995559f9ba694
04:04:17:WU00:FS00:Uploading 87.30MiB to 128.143.231.201
04:04:17:WU00:FS00:Connecting to 128.143.231.201:8080
04:04:18:WU01:FS00:Starting
04:04:18:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/bollix/fah/cores/www.stanford.edu/~pande/Linux/AMD64/Core_a5.fah/FahCore_a5 -dir 01 -suffix 01 -version 701 -lifeline 2088 -checkpoint 15 -np 64
04:04:18:WU01:FS00:Started FahCore on PID 4767
04:04:18:WU01:FS00:Core PID:4771
04:04:18:WU01:FS00:FahCore 0xa5 started
04:04:18:WU01:FS00:0xa5:
04:04:18:WU01:FS00:0xa5:*------------------------------*
04:04:18:WU01:FS00:0xa5:Folding@Home Gromacs SMP Core
04:04:18:WU01:FS00:0xa5:Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
04:04:18:WU01:FS00:0xa5:
04:04:18:WU01:FS00:0xa5:Preparing to commence simulation
04:04:18:WU01:FS00:0xa5:- Looking at optimizations...
04:04:18:WU01:FS00:0xa5:- Created dyn
04:04:18:WU01:FS00:0xa5:- Files status OK
04:04:22:WU01:FS00:0xa5:- Expanded 30309666 -> 33158020 (decompressed 109.3 percent)
04:04:22:WU01:FS00:0xa5:Called DecompressByteArray: compressed_data_size=30309666 data_size=33158020, decompressed_data_size=33158020 diff=0
04:04:22:WU01:FS00:0xa5:- Digital signature verified
04:04:22:WU01:FS00:0xa5:
04:04:22:WU01:FS00:0xa5:Project: 8101 (Run 2, Clone 11, Gen 4)
04:04:22:WU01:FS00:0xa5:
04:04:23:WU01:FS00:0xa5:Assembly optimizations on if available.
04:04:23:WU01:FS00:0xa5:Entering M.D.
04:04:23:WU00:FS00:Upload 0.93%
04:04:29:WU00:FS00:Upload 1.79%
04:04:30:WU01:FS00:0xa5:Mapping NT from 64 to 64 
04:04:35:WU00:FS00:Upload 2.65%
04:04:36:WU01:FS00:0xa5:Completed 0 out of 250000 steps  (0%)
04:04:41:WU00:FS00:Upload 3.36%
04:04:47:WU00:FS00:Upload 4.22%

SNIP

04:16:39:WU00:FS00:Upload 98.51%
04:16:49:WU00:FS00:Upload 99.58%
04:16:56:WU00:FS00:Upload complete
04:16:56:WU00:FS00:Server responded WORK_QUIT (404)
04:16:56:WARNING:WU00:FS00:Server did not like results, dumping
04:16:56:WU00:FS00:Cleaning up
04:18:27:WU01:FS00:0xa5:Completed 2500 out of 250000 steps  (1%)
04:32:17:WU01:FS00:0xa5:Completed 5000 out of 250000 steps  (2%)
04:46:06:WU01:FS00:0xa5:Completed 7500 out of 250000 steps  (3%)
04:59:54:WU01:FS00:0xa5:Completed 10000 out of 250000 steps  (4%)
05:13:44:WU01:FS00:0xa5:Completed 12500 out of 250000 steps  (5%)
05:27:33:WU01:FS00:0xa5:Completed 15000 out of 250000 steps  (6%)
05:41:23:WU01:FS00:0xa5:Completed 17500 out of 250000 steps  (7%)
05:55:14:WU01:FS00:0xa5:Completed 20000 out of 250000 steps  (8%)
******************************** Date: 30/09/12 ********************************
06:09:04:WU01:FS00:0xa5:Completed 22500 out of 250000 steps  (9%)
06:18:02:Server connection id=8 on 0.0.0.0:36330 from 192.168.2.102
Amaruk
Posts: 254
Joined: Fri Jun 20, 2008 3:57 am
Location: Watching from the Woods

Re: Bigadv Collection and or Assighnment server is broken

Post by Amaruk »

bollix47 wrote:I can confirm the dumping but because I'm using v7 I obviously didn't get the same WU again.
Don't be surprised if project:8101 run:23 clone:6 gen:41 is the next WU assigned to that machine. :wink:

The issue is with the work server itself (128.143.231.201) refusing to accept it's own WUs. I'll be rolling over to non-bigadv SMP until this gets fixed...


Terminal:

Code: Select all

[09:19:45] Completed 250000 out of 250000 steps  (100%)

Writing final coordinates.

 Average load imbalance: 0.3 %
 Part of the total run time spent waiting due to load imbalance: 0.1 %
 Steps where the load balancing was limited by -rdd, -rcon and/or -dds: X 0 % Y 0 %


	Parallel run - timing based on wallclock.

               NODE (s)   Real (s)      (%)
       Time:  86862.971  86862.971    100.0
                       1d00h07:42
               (Mnbf/s)   (GFlops)   (ns/day)  (hour/ns)
Performance:   1251.515     66.085      0.995     24.129

Thanx for Using GROMACS - Have a Nice Day

[09:21:04] DynamicWrapper: Finished Work Unit: sleep=10000
[09:21:14] 
[09:21:14] Finished Work Unit:
[09:21:14] - Reading up to 64340496 from "work/wudata_05.trr": Read 64340496
[09:21:33] trr file hash check passed.
[09:21:33] - Reading up to 31560072 from "work/wudata_05.xtc": Read 31560072
[09:21:33] xtc file hash check passed.
[09:21:33] edr file hash check passed.
[09:21:33] logfile size: 192959
[09:21:33] Leaving Run
[09:21:38] - Writing 96254403 bytes of core data to disk...
[09:22:08] Done: 96253891 -> 91515445 (compressed to 5.8 percent)
[09:22:08]   ... Done.
[09:22:26] - Shutting down core
[09:22:26] 
[09:22:26] Folding@home Core Shutdown: FINISHED_UNIT
[09:22:29] CoreStatus = 64 (100)
[09:22:29] Unit 5 finished with 75 percent of time to deadline remaining.
[09:22:29] Updated performance fraction: 0.788996
[09:22:29] Sending work to server
[09:22:29] Project: 8101 (Run 13, Clone 0, Gen 94)


[09:22:29] + Attempting to send results [September 30 09:22:29 UTC]
[09:22:29] - Reading file work/wuresults_05.dat from core
[09:22:29]   (Read 91515957 bytes from disk)
[09:22:29] Connecting to http://128.143.231.201:8080/
[09:28:03] Posted data.
[09:28:03] Initial: 0000; - Uploaded at ~267 kB/s
[09:28:03] - Averaged speed for that direction ~261 kB/s
[09:28:03] - Server reports problem with unit.
[09:28:03] Trying to send all finished work units
[09:28:03] + No unsent completed units remaining.
[09:28:03] - Preparing to get new work unit...
[09:28:03] Cleaning up work directory
[09:28:05] + Attempting to get work packet
[09:28:05] Passkey found
[09:28:05] - Will indicate memory of 32233 MB
[09:28:05] - Connecting to assignment server
[09:28:05] Connecting to http://assign.stanford.edu:8080/
[09:28:05] Posted data.
[09:28:05] Initial: 8F80; - Successful: assigned to (128.143.231.201).
[09:28:05] + News From Folding@Home: Welcome to Folding@Home
[09:28:05] Loaded queue successfully.
[09:28:05] Sent data
[09:28:05] Connecting to http://128.143.231.201:8080/
^C[09:28:06] ***** Got an Activate signal (2)
[09:28:06] Killing all core threads

Folding@Home Client Shutdown.
heer@heer-folder:~/folding$ ./fah6 -configonly

Note: Please read the license agreement (fah6 -license). Further 
use of this software requires that you have read and accepted this agreement.

Folding@Home User Configuration

48 cores detected


--- Opening Log file [September 30 09:28:35 UTC] 


# Linux SMP Console Edition ###################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: /home/heer/folding
Executable: ./fah6
Arguments: -configonly -smp -verbosity 9 -bigadv 

[09:28:35] - Ask before connecting: No
[09:28:35] - User name: Amaruk (Team 50625)
[09:28:35] - User ID: 6648E8A9xxxxxxxx
[09:28:35] - Machine ID: 1
[09:28:35] 
[09:28:35] Configuring Folding@Home...

User name [Amaruk]? 
Team Number [50625]? 
Passkey [classified]? 
Ask before fetching/sending work (no/yes) [no]? 
Use proxy (yes/no) [no]? 
Acceptable size of work assignment and work result packets (bigger units
 may have large memory demands) -- 'small' is <5MB, 'normal' is <10MB, and
 'big' is >10MB (small/normal/big) [big]? 
Change advanced options (yes/no) [no]? yes
Core Priority (idle/low) [idle]? 
Disable highly optimized assembly code (no/yes) [no]? 
Interval, in minutes, between checkpoints (3-30) [15]? 
Memory, in MB, to indicate (32233 available) [32233]? 
Set -advmethods flag always, requesting new advanced
  scientific cores and/or work units if available (no/yes) [no]? 
Ignore any deadline information (mainly useful if
 system clock frequently has errors) (no/yes) [no]? 
Machine ID (1-16) [1]? 
The following options require you to restart the client before they take effect
Disable CPU affinity lock (no/yes) [no]? 
Additional client parameters. Use space to clear. [-smp -verbosity 9 -bigadv]? -smp -verbosity 9 -advmethods
IP address to bind core to (for viewer) []? 

[09:29:09] - Ask before connecting: No
[09:29:09] - User name: Amaruk (Team 50625)
[09:29:09] - User ID: 6648E8A9xxxxxxxx
[09:29:09] - Machine ID: 1
[09:29:09] 
[09:29:09] -configonly flag given, so exiting.
Terminated
heer@heer-folder:~/folding$ ./fah6

Note: Please read the license agreement (fah6 -license). Further 
use of this software requires that you have read and accepted this agreement.

48 cores detected


--- Opening Log file [September 30 09:29:12 UTC] 


# Linux SMP Console Edition ###################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: /home/heer/folding
Executable: ./fah6
Arguments: -smp -verbosity 9 -advmethods 

[09:29:12] - Ask before connecting: No
[09:29:12] - User name: Amaruk (Team 50625)
[09:29:12] - User ID: 6648E8A9xxxxxxxx
[09:29:12] - Machine ID: 1
[09:29:12] 
[09:29:12] Loaded queue successfully.
[09:29:12] - Preparing to get new work unit...
[09:29:12] Cleaning up work directory
[09:29:12] - Autosending finished units... [September 30 09:29:12 UTC]
[09:29:12] Trying to send all finished work units
[09:29:12] + No unsent completed units remaining.
[09:29:12] - Autosend completed
[09:29:12] + Attempting to get work packet
[09:29:12] Passkey found
[09:29:12] - Will indicate memory of 32233 MB
[09:29:12] - Connecting to assignment server
[09:29:12] Connecting to http://assign.stanford.edu:8080/
[09:29:12] Posted data.
[09:29:12] Initial: 8F80; - Successful: assigned to (128.143.199.96).
[09:29:12] + News From Folding@Home: Welcome to Folding@Home
[09:29:13] Loaded queue successfully.
[09:29:13] Sent data
[09:29:13] Connecting to http://128.143.199.96:8080/
[09:29:14] Posted data.
[09:29:14] Initial: 0000; - Receiving payload (expected size: 1766700)
[09:29:17] - Downloaded at ~575 kB/s
[09:29:17] - Averaged speed for that direction ~563 kB/s
[09:29:17] + Received work.
[09:29:17] + Closed connections
[09:29:17] 
[09:29:17] + Processing work unit
[09:29:17] Core required: FahCore_a3.exe
[09:29:17] Core found.
[09:29:17] Working on queue slot 06 [September 30 09:29:17 UTC]
[09:29:17] + Working ...
[09:29:17] - Calling './FahCore_a3.exe -dir work/ -nice 19 -suffix 06 -np 48 -checkpoint 15 -verbose -lifeline 9020 -version 634'

thekraken: The Kraken 0.7-pre15 (compiled Sat Sep  1 09:12:55 PDT 2012 by heer@heer-folder)
thekraken: Processor affinity wrapper for Folding@Home
thekraken: The Kraken comes with ABSOLUTELY NO WARRANTY; licensed under GPLv2
thekraken: PID: 9025
thekraken: Logging to thekraken.log
[09:29:17] 
[09:29:17] *------------------------------*
[09:29:17] Folding@Home Gromacs SMP Core
[09:29:17] Version 2.27 (Dec. 15, 2010)
[09:29:17] 
[09:29:17] Preparing to commence simulation
[09:29:17] - Looking at optimizations...
[09:29:17] - Created dyn
[09:29:17] - Files status OK
[09:29:18] - Expanded 1766188 -> 1949876 (decompressed 110.4 percent)
[09:29:18] Called DecompressByteArray: compressed_data_size=1766188 data_size=1949876, decompressed_data_size=1949876 diff=0
[09:29:18] - Digital signature verified
[09:29:18] 
[09:29:18] Project: 6995 (Run 0, Clone 190, Gen 16)
[09:29:18] 
[09:29:18] Assembly optimizations on if available.
[09:29:18] Entering M.D.
                         :-)  G  R  O  M  A  C  S  (-:

                   Groningen Machine for Chemical Simulation

                            :-)  VERSION 4.5.3  (-:

        Written by Emile Apol, Rossen Apostolov, Herman J.C. Berendsen,
      Aldert van Buuren, Pär Bjelkmar, Rudi van Drunen, Anton Feenstra, 
        Gerrit Groenhof, Peter Kasson, Per Larsson, Pieter Meulenhoff, 
           Teemu Murtola, Szilard Pall, Sander Pronk, Roland Schulz, 
                Michael Shirts, Alfons Sijbers, Peter Tieleman,

               Berk Hess, David van der Spoel, and Erik Lindahl.

       Copyright (c) 1991-2000, University of Groningen, The Netherlands.
            Copyright (c) 2001-2010, The GROMACS development team at
        Uppsala University & The Royal Institute of Technology, Sweden.
            check out http://www.gromacs.org for more information.


                               :-)  Gromacs  (-:

Reading file work/wudata_06.tpr, VERSION 4.5.3-dev-20101113-8af87 (single precision)
Starting 48 threads
[09:29:24] Mapping NT from 48 to 48 
Making 2D domain decomposition 6 x 8 x 1
starting mdrun 'Mutant_scan'
8500000 steps,  17000.0 ps (continuing from step 8000000,  16000.0 ps).
[09:29:25] Completed 0 out of 500000 steps  (0%)
[09:35:09] Completed 5000 out of 500000 steps  (1%)

Image
Ben_Lamb
Posts: 28
Joined: Sun Sep 30, 2012 10:41 am

Re: server did not like results

Post by Ben_Lamb »

Hi guys I am new to the forum and wondered if you can help me ? Just got a "Server did not like the results, dumping" message for an 8102 so am realy gutted. It is important to get to the bottom of these things as this sort of thing can put people off folding as it is a waste of time and electricity. Machine has never given me a problem and there is nothing wrong in the log.

Thanks Ben.

Code: Select all

08:44:16:WU00:FS00:0xa5:Completed 242500 out of 250000 steps  (97%)
09:00:00:WU00:FS00:0xa5:Completed 245000 out of 250000 steps  (98%)
09:15:45:WU00:FS00:0xa5:Completed 247500 out of 250000 steps  (99%)
******************************** Date: 30/09/12 ********************************
09:31:30:WU00:FS00:0xa5:Completed 250000 out of 250000 steps  (100%)
09:31:30:WU01:FS00:Connecting to assign3.stanford.edu:8080
09:31:31:WU01:FS00:News: Welcome to Folding@Home
09:31:31:WU01:FS00:Assigned to work server 128.143.231.201
09:31:31:WU01:FS00:Requesting new work unit for slot 00: RUNNING smp:32 from 128.143.231.201
09:31:31:WU01:FS00:Connecting to 128.143.231.201:8080
09:31:38:WU01:FS00:Downloading 28.91MiB
09:31:44:WU01:FS00:Download 9.95%
09:31:44:WU00:FS00:0xa5:DynamicWrapper: Finished Work Unit: sleep=10000
09:31:50:WU01:FS00:Download 22.05%
09:31:54:WU00:FS00:0xa5:
09:31:54:WU00:FS00:0xa5:Finished Work Unit:
09:31:54:WU00:FS00:0xa5:- Reading up to 64407792 from "00/wudata_01.trr": Read 64407792
09:31:55:WU00:FS00:0xa5:trr file hash check passed.
09:31:55:WU00:FS00:0xa5:- Reading up to 31686728 from "00/wudata_01.xtc": Read 31686728
09:31:55:WU00:FS00:0xa5:xtc file hash check passed.
09:31:55:WU00:FS00:0xa5:edr file hash check passed.
09:31:55:WU00:FS00:0xa5:logfile size: 194206
09:31:55:WU00:FS00:0xa5:Leaving Run
09:31:56:WU01:FS00:Download 34.38%
09:31:56:WU00:FS00:0xa5:- Writing 96449602 bytes of core data to disk...
09:32:02:WU01:FS00:Download 46.49%
09:32:08:WU01:FS00:Download 59.24%
09:32:14:WU01:FS00:Download 71.13%
09:32:16:WU00:FS00:0xa5:Done: 96449090 -> 91701271 (compressed to 6.0 percent)
09:32:16:WU00:FS00:0xa5:  ... Done.
09:32:20:WU01:FS00:Download 83.67%
09:32:26:WU01:FS00:Download 95.57%
09:32:28:WU01:FS00:Download complete
09:32:28:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:OK project:8101 run:3 clone:13 gen:3 core:0xa5 unit:0x00000005088988e14f0e2372d878f39e
09:33:18:WU00:FS00:0xa5:- Shutting down core
09:33:18:WU00:FS00:0xa5:
09:33:18:WU00:FS00:0xa5:Folding@home Core Shutdown: FINISHED_UNIT
09:33:26:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
09:33:26:WU00:FS00:Sending unit results: id:00 state:SEND error:OK project:8102 run:0 clone:9 gen:49 core:0xa5 unit:0x0000003a088988e15011d31bd6325da7
09:33:26:WU00:FS00:Uploading 87.45MiB to 128.143.231.201
09:33:26:WU00:FS00:Connecting to 128.143.231.201:8080
09:33:26:WU01:FS00:Starting
09:33:26:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/user/.FAHClient/cores/www.stanford.edu/~pande/Linux/AMD64/Core_a5.fah/FahCore_a5 -dir 01 -suffix 01 -version 701 -lifeline 2697 -checkpoint 15 -np 32
09:33:26:WU01:FS00:Started FahCore on PID 4166
09:33:26:WU01:FS00:Core PID:4170
09:33:26:WU01:FS00:FahCore 0xa5 started
09:33:26:WU01:FS00:0xa5:
09:33:26:WU01:FS00:0xa5:*------------------------------*
09:33:26:WU01:FS00:0xa5:Folding@Home Gromacs SMP Core
09:33:26:WU01:FS00:0xa5:Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
09:33:26:WU01:FS00:0xa5:
09:33:26:WU01:FS00:0xa5:Preparing to commence simulation
09:33:26:WU01:FS00:0xa5:- Looking at optimizations...
09:33:26:WU01:FS00:0xa5:- Created dyn
09:33:26:WU01:FS00:0xa5:- Files status OK
09:33:29:WU01:FS00:0xa5:- Expanded 30310652 -> 33158020 (decompressed 109.3 percent)
09:33:29:WU01:FS00:0xa5:Called DecompressByteArray: compressed_data_size=30310652 data_size=33158020, decompressed_data_size=33158020 diff=0
09:33:29:WU01:FS00:0xa5:- Digital signature verified
09:33:29:WU01:FS00:0xa5:
09:33:29:WU01:FS00:0xa5:Project: 8101 (Run 3, Clone 13, Gen 3)
09:33:29:WU01:FS00:0xa5:
09:33:29:WU01:FS00:0xa5:Assembly optimizations on if available.
09:33:29:WU01:FS00:0xa5:Entering M.D.
09:33:33:WU00:FS00:Upload 1.29%
09:33:36:WU01:FS00:0xa5:Mapping NT from 32 to 32 
09:33:39:WU00:FS00:Upload 2.36%
09:33:40:WU01:FS00:0xa5:Completed 0 out of 250000 steps  (0%)
09:33:45:WU00:FS00:Upload 3.22%
09:33:51:WU00:FS00:Upload 4.29%
09:33:57:WU00:FS00:Upload 5.15%
09:34:04:WU00:FS00:Upload 6.22%
09:34:10:WU00:FS00:Upload 7.08%
09:34:17:WU00:FS00:Upload 8.15%
09:34:24:WU00:FS00:Upload 9.22%
09:34:31:WU00:FS00:Upload 10.29%
09:34:38:WU00:FS00:Upload 11.36%
09:34:46:WU00:FS00:Upload 12.44%
09:34:52:WU00:FS00:Upload 13.58%
09:34:58:WU00:FS00:Upload 14.44%
09:35:05:WU00:FS00:Upload 15.51%
09:35:12:WU00:FS00:Upload 16.58%
09:35:18:WU00:FS00:Upload 17.65%
09:35:24:WU00:FS00:Upload 18.51%
09:35:30:WU00:FS00:Upload 19.37%
09:35:37:WU00:FS00:Upload 20.44%
09:35:44:WU00:FS00:Upload 21.51%
09:35:51:WU00:FS00:Upload 22.58%
09:35:57:WU00:FS00:Upload 23.44%
09:36:04:WU00:FS00:Upload 24.51%
09:36:10:WU00:FS00:Upload 25.58%
09:36:16:WU00:FS00:Upload 26.44%
09:36:22:WU00:FS00:Upload 27.30%
09:36:28:WU00:FS00:Upload 28.16%
09:36:34:WU00:FS00:Upload 29.23%
09:36:41:WU00:FS00:Upload 30.09%
09:36:47:WU00:FS00:Upload 31.23%
09:36:53:WU00:FS00:Upload 32.09%
09:37:00:WU00:FS00:Upload 33.16%
09:37:06:WU00:FS00:Upload 34.02%
09:37:13:WU00:FS00:Upload 35.09%
09:37:19:WU00:FS00:Upload 36.16%
09:37:26:WU00:FS00:Upload 37.02%
09:37:32:WU00:FS00:Upload 38.16%
09:37:38:WU00:FS00:Upload 39.02%
09:37:45:WU00:FS00:Upload 40.09%
09:37:51:WU00:FS00:Upload 40.95%
09:37:57:WU00:FS00:Upload 42.02%
09:38:03:WU00:FS00:Upload 42.81%
09:38:10:WU00:FS00:Upload 43.88%
09:38:17:WU00:FS00:Upload 44.95%
09:38:23:WU00:FS00:Upload 45.88%
09:38:30:WU00:FS00:Upload 46.95%
09:38:37:WU00:FS00:Upload 48.03%
09:38:44:WU00:FS00:Upload 49.10%
09:38:51:WU00:FS00:Upload 50.17%
09:38:57:WU00:FS00:Upload 51.24%
09:39:04:WU00:FS00:Upload 52.10%
09:39:10:WU00:FS00:Upload 53.17%
09:39:16:WU00:FS00:Upload 54.03%
09:39:22:WU00:FS00:Upload 54.96%
09:39:29:WU00:FS00:Upload 56.03%
09:39:36:WU00:FS00:Upload 57.10%
09:39:42:WU00:FS00:Upload 58.10%
09:39:48:WU00:FS00:Upload 59.03%
09:39:54:WU00:FS00:Upload 59.89%
09:40:01:WU00:FS00:Upload 60.96%
09:40:08:WU00:FS00:Upload 61.96%
09:40:14:WU00:FS00:Upload 62.89%
09:40:21:WU00:FS00:Upload 63.96%
09:40:27:WU00:FS00:Upload 65.03%
09:40:34:WU00:FS00:Upload 65.89%
09:40:40:WU00:FS00:Upload 66.96%
09:40:46:WU00:FS00:Upload 67.82%
09:40:53:WU00:FS00:Upload 68.89%
09:40:59:WU00:FS00:Upload 69.75%
09:41:06:WU00:FS00:Upload 70.89%
09:41:12:WU00:FS00:Upload 71.97%
09:41:18:WU00:FS00:Upload 72.82%
09:41:24:WU00:FS00:Upload 73.68%
09:41:31:WU00:FS00:Upload 74.68%
09:41:37:WU00:FS00:Upload 75.75%
09:41:44:WU00:FS00:Upload 76.61%
09:41:50:WU00:FS00:Upload 77.68%
09:41:56:WU00:FS00:Upload 78.54%
09:42:03:WU00:FS00:Upload 79.61%
09:42:09:WU00:FS00:Upload 80.47%
09:42:15:WU00:FS00:Upload 81.54%
09:42:21:WU00:FS00:Upload 82.40%
09:42:28:WU00:FS00:Upload 83.47%
09:42:35:WU00:FS00:Upload 84.54%
09:42:41:WU00:FS00:Upload 85.62%
09:42:47:WU00:FS00:Upload 86.47%
09:42:53:WU00:FS00:Upload 87.33%
09:43:00:WU00:FS00:Upload 88.40%
09:43:06:WU00:FS00:Upload 89.40%
09:43:12:WU00:FS00:Upload 90.26%
09:43:18:WU00:FS00:Upload 91.19%
09:43:24:WU00:FS00:Upload 92.05%
09:43:31:WU00:FS00:Upload 93.12%
09:43:38:WU00:FS00:Upload 94.19%
09:43:44:WU00:FS00:Upload 95.26%
09:43:51:WU00:FS00:Upload 96.12%
09:43:57:WU00:FS00:Upload 97.19%
09:44:03:WU00:FS00:Upload 98.05%
09:44:09:WU00:FS00:Upload 98.98%
09:44:16:WU00:FS00:Upload 100.00%
09:44:18:WU00:FS00:Upload complete
09:44:18:WU00:FS00:Server responded WORK_QUIT (404)
09:44:18:WARNING:WU00:FS00:Server did not like results, dumping
09:44:18:WU00:FS00:Cleaning up
09:54:17:WU01:FS00:0xa5:Completed 2500 out of 250000 steps  (1%)
10:14:43:WU01:FS00:0xa5:Completed 5000 out of 250000 steps  (2%)
10:36:35:WU01:FS00:0xa5:Completed 7500 out of 250000 steps  (3%)
P5-133XL
Posts: 2948
Joined: Sun Dec 02, 2007 4:36 am
Hardware configuration: Machine #1:

Intel Q9450; 2x2GB=8GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460; Windows Server 2008 X64 (SP1).

Machine #2:

Intel Q6600; 2x2GB=4GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460 video card; Windows 7 X64.

Machine 3:

Dell Dimension 8400, 3.2GHz P4 4x512GB Ram, Video card GTX 460, Windows 7 X32

I am currently folding just on the 5x GTX 460's for aprox. 70K PPD
Location: Salem. OR USA

Re: server did not like results

Post by P5-133XL »

see: viewtopic.php?f=18&t=22566
Image
Ben_Lamb
Posts: 28
Joined: Sun Sep 30, 2012 10:41 am

Re: server did not like results

Post by Ben_Lamb »

P5-133XL wrote:see: viewtopic.php?f=18&t=22566
Ok thanks for that - what is the best course of action to take as my machine has just downloaded an 8101 from the same server so I presume this will be going the same way ?
Ben_Lamb
Posts: 28
Joined: Sun Sep 30, 2012 10:41 am

Re: Bigadv Collection and or Assighnment server is broken

Post by Ben_Lamb »

I am getting the same problem with this server - what is the best course of action now ? Delete the unit and switch to SMP ?

Code: Select all

*********************** Log Started 2012-09-29T09:26:10Z ***********************
09:26:10:************************* Folding@home Client *************************
09:26:10:    Website: http://folding.stanford.edu/
09:26:10:  Copyright: (c) 2009-2012 Stanford University
09:26:10:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
09:26:10:       Args: --lifeline 2683 --command-port=36330
09:26:10:     Config: /home/user/.FAHClient/config.xml
09:26:10:******************************** Build ********************************
09:26:10:    Version: 7.1.52
09:26:10:       Date: Mar 20 2012
09:26:10:       Time: 13:19:11
09:26:10:    SVN Rev: 3515
09:26:10:     Branch: fah/trunk/client
09:26:10:   Compiler: GNU 4.6.2
09:26:10:    Options: -std=gnu++98 -O3 -funroll-loops -mfpmath=sse -ffast-math
09:26:10:             -fno-unsafe-math-optimizations -msse2
09:26:10:   Platform: linux2 3.2.0-1-amd64
09:26:10:       Bits: 64
09:26:10:       Mode: Release
09:26:10:******************************* System ********************************
09:26:10:        CPU: 
09:26:10:     CPU ID: GenuineIntel Family 6 Model 45 Stepping 2
09:26:10:       CPUs: 32
09:26:10:     Memory: 31.41GiB
09:26:10:Free Memory: 30.31GiB
09:26:10:    Threads: POSIX_THREADS
09:26:10: On Battery: false
09:26:10: UTC offset: 1
09:26:10:        PID: 2697
09:26:10:        CWD: /home/user/.FAHClient
09:26:10:         OS: Linux 3.2.0-29-generic x86_64
09:26:10:    OS Arch: AMD64
09:26:10:       GPUs: 1
09:26:10:      GPU 0: ATI:4 Cedar PRO [Radeon HD 5450]
09:26:10:       CUDA: Not detected
09:26:10:***********************************************************************
09:26:10:<config>
09:26:10:  <!-- FahCore Control -->
09:26:10:  <core-priority v='low'/>
09:26:10:
09:26:10:  <!-- Network -->
09:26:10:  <proxy v=':8080'/>
09:26:10:
09:26:10:  <!-- Remote Command Server -->
09:26:10:  <command-allow v='127.0.0.1,192.168.1.0/24'/>
09:26:10:  <command-allow-no-pass v='127.0.0.1,192.168.1.0/24'/>
09:26:10:  <password v='***'/>
09:26:10:
09:26:10:  <!-- User Information -->
09:26:10:  <passkey v='********************************'/>
09:26:10:  <team v='35947'/>
09:26:10:  <user v='Ben_Lamb'/>
09:26:10:
09:26:10:  <!-- Folding Slots -->
09:26:10:  <slot id='0' type='SMP'>
09:26:10:    <client-type v='bigadv'/>
09:26:10:    <cpus v='-1'/>
09:26:10:    <max-packet-size v='big'/>
09:26:10:    <next-unit-percentage v='100'/>
09:26:10:  </slot>
09:26:10:</config>
09:26:10:Trying to access database...
09:26:10:Successfully acquired database lock
09:26:10:Enabled folding slot 00: READY smp:32
09:26:10:WU00:FS00:Starting
09:26:10:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/user/.FAHClient/cores/www.stanford.edu/~pande/Linux/AMD64/Core_a5.fah/FahCore_a5 -dir 00 -suffix 01 -version 701 -lifeline 2697 -checkpoint 15 -np 32
09:26:10:WU00:FS00:Started FahCore on PID 2705
09:26:10:WU00:FS00:Core PID:2709
09:26:10:WU00:FS00:FahCore 0xa5 started
09:26:10:Server connection id=1 on 0.0.0.0:36330 from 127.0.0.1
09:26:10:WU00:FS00:0xa5:
09:26:10:WU00:FS00:0xa5:*------------------------------*
09:26:10:WU00:FS00:0xa5:Folding@Home Gromacs SMP Core
09:26:10:WU00:FS00:0xa5:Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
09:26:10:WU00:FS00:0xa5:
09:26:10:WU00:FS00:0xa5:Preparing to commence simulation
09:26:10:WU00:FS00:0xa5:- Looking at optimizations...
09:26:10:WU00:FS00:0xa5:- Files status OK
09:26:13:WU00:FS00:0xa5:- Expanded 30343310 -> 33163648 (decompressed 109.2 percent)
09:26:13:WU00:FS00:0xa5:Called DecompressByteArray: compressed_data_size=30343310 data_size=33163648, decompressed_data_size=33163648 diff=0
09:26:13:WU00:FS00:0xa5:- Digital signature verified
09:26:13:WU00:FS00:0xa5:
09:26:13:WU00:FS00:0xa5:Project: 8102 (Run 0, Clone 9, Gen 49)
09:26:13:WU00:FS00:0xa5:
09:26:13:WU00:FS00:0xa5:Assembly optimizations on if available.
09:26:13:WU00:FS00:0xa5:Entering M.D.
09:26:19:WU00:FS00:0xa5:Using Gromacs checkpoints
09:26:22:WU00:FS00:0xa5:Mapping NT from 32 to 32 
09:26:53:WU00:FS00:0xa5:Resuming from checkpoint
09:26:55:WU00:FS00:0xa5:Verified 00/wudata_01.log
09:26:55:WU00:FS00:0xa5:Verified 00/wudata_01.trr
09:26:55:WU00:FS00:0xa5:Verified 00/wudata_01.xtc
09:26:55:WU00:FS00:0xa5:Verified 00/wudata_01.edr
09:26:56:WU00:FS00:0xa5:Completed 21430 out of 250000 steps  (8%)
09:33:46:WU00:FS00:0xa5:Completed 22500 out of 250000 steps  (9%)
09:49:29:WU00:FS00:0xa5:Completed 25000 out of 250000 steps  (10%)
10:05:13:WU00:FS00:0xa5:Completed 27500 out of 250000 steps  (11%)
10:20:57:WU00:FS00:0xa5:Completed 30000 out of 250000 steps  (12%)
10:36:40:WU00:FS00:0xa5:Completed 32500 out of 250000 steps  (13%)
10:52:25:WU00:FS00:0xa5:Completed 35000 out of 250000 steps  (14%)
11:10:38:WU00:FS00:0xa5:Completed 37500 out of 250000 steps  (15%)
11:28:16:WU00:FS00:0xa5:Completed 40000 out of 250000 steps  (16%)
11:45:39:WU00:FS00:0xa5:Completed 42500 out of 250000 steps  (17%)
12:02:08:WU00:FS00:0xa5:Completed 45000 out of 250000 steps  (18%)
12:17:51:WU00:FS00:0xa5:Completed 47500 out of 250000 steps  (19%)
12:33:34:WU00:FS00:0xa5:Completed 50000 out of 250000 steps  (20%)
12:49:18:WU00:FS00:0xa5:Completed 52500 out of 250000 steps  (21%)
13:05:02:WU00:FS00:0xa5:Completed 55000 out of 250000 steps  (22%)
13:20:45:WU00:FS00:0xa5:Completed 57500 out of 250000 steps  (23%)
13:36:28:WU00:FS00:0xa5:Completed 60000 out of 250000 steps  (24%)
13:52:11:WU00:FS00:0xa5:Completed 62500 out of 250000 steps  (25%)
14:07:55:WU00:FS00:0xa5:Completed 65000 out of 250000 steps  (26%)
14:23:38:WU00:FS00:0xa5:Completed 67500 out of 250000 steps  (27%)
14:39:21:WU00:FS00:0xa5:Completed 70000 out of 250000 steps  (28%)
14:55:05:WU00:FS00:0xa5:Completed 72500 out of 250000 steps  (29%)
15:10:48:WU00:FS00:0xa5:Completed 75000 out of 250000 steps  (30%)
******************************** Date: 29/09/12 ********************************
15:26:31:WU00:FS00:0xa5:Completed 77500 out of 250000 steps  (31%)
15:42:19:WU00:FS00:0xa5:Completed 80000 out of 250000 steps  (32%)
15:58:02:WU00:FS00:0xa5:Completed 82500 out of 250000 steps  (33%)
16:13:45:WU00:FS00:0xa5:Completed 85000 out of 250000 steps  (34%)
16:29:27:WU00:FS00:0xa5:Completed 87500 out of 250000 steps  (35%)
16:45:10:WU00:FS00:0xa5:Completed 90000 out of 250000 steps  (36%)
17:00:52:WU00:FS00:0xa5:Completed 92500 out of 250000 steps  (37%)
17:16:34:WU00:FS00:0xa5:Completed 95000 out of 250000 steps  (38%)
17:32:17:WU00:FS00:0xa5:Completed 97500 out of 250000 steps  (39%)
17:48:00:WU00:FS00:0xa5:Completed 100000 out of 250000 steps  (40%)
18:03:43:WU00:FS00:0xa5:Completed 102500 out of 250000 steps  (41%)
18:19:25:WU00:FS00:0xa5:Completed 105000 out of 250000 steps  (42%)
18:35:08:WU00:FS00:0xa5:Completed 107500 out of 250000 steps  (43%)
18:50:50:WU00:FS00:0xa5:Completed 110000 out of 250000 steps  (44%)
19:06:34:WU00:FS00:0xa5:Completed 112500 out of 250000 steps  (45%)
19:22:17:WU00:FS00:0xa5:Completed 115000 out of 250000 steps  (46%)
19:38:01:WU00:FS00:0xa5:Completed 117500 out of 250000 steps  (47%)
19:53:45:WU00:FS00:0xa5:Completed 120000 out of 250000 steps  (48%)
20:09:28:WU00:FS00:0xa5:Completed 122500 out of 250000 steps  (49%)
20:25:12:WU00:FS00:0xa5:Completed 125000 out of 250000 steps  (50%)
20:40:55:WU00:FS00:0xa5:Completed 127500 out of 250000 steps  (51%)
20:56:39:WU00:FS00:0xa5:Completed 130000 out of 250000 steps  (52%)
21:12:25:WU00:FS00:0xa5:Completed 132500 out of 250000 steps  (53%)
******************************** Date: 29/09/12 ********************************
21:28:08:WU00:FS00:0xa5:Completed 135000 out of 250000 steps  (54%)
21:43:52:WU00:FS00:0xa5:Completed 137500 out of 250000 steps  (55%)
21:59:36:WU00:FS00:0xa5:Completed 140000 out of 250000 steps  (56%)
22:15:20:WU00:FS00:0xa5:Completed 142500 out of 250000 steps  (57%)
22:31:03:WU00:FS00:0xa5:Completed 145000 out of 250000 steps  (58%)
22:46:46:WU00:FS00:0xa5:Completed 147500 out of 250000 steps  (59%)
23:02:28:WU00:FS00:0xa5:Completed 150000 out of 250000 steps  (60%)
23:18:10:WU00:FS00:0xa5:Completed 152500 out of 250000 steps  (61%)
23:33:53:WU00:FS00:0xa5:Completed 155000 out of 250000 steps  (62%)
23:49:35:WU00:FS00:0xa5:Completed 157500 out of 250000 steps  (63%)
00:05:17:WU00:FS00:0xa5:Completed 160000 out of 250000 steps  (64%)
00:21:00:WU00:FS00:0xa5:Completed 162500 out of 250000 steps  (65%)
00:36:42:WU00:FS00:0xa5:Completed 165000 out of 250000 steps  (66%)
00:52:24:WU00:FS00:0xa5:Completed 167500 out of 250000 steps  (67%)
01:08:07:WU00:FS00:0xa5:Completed 170000 out of 250000 steps  (68%)
01:23:50:WU00:FS00:0xa5:Completed 172500 out of 250000 steps  (69%)
01:39:33:WU00:FS00:0xa5:Completed 175000 out of 250000 steps  (70%)
01:55:16:WU00:FS00:0xa5:Completed 177500 out of 250000 steps  (71%)
02:10:58:WU00:FS00:0xa5:Completed 180000 out of 250000 steps  (72%)
02:26:42:WU00:FS00:0xa5:Completed 182500 out of 250000 steps  (73%)
02:42:29:WU00:FS00:0xa5:Completed 185000 out of 250000 steps  (74%)
02:58:13:WU00:FS00:0xa5:Completed 187500 out of 250000 steps  (75%)
03:13:56:WU00:FS00:0xa5:Completed 190000 out of 250000 steps  (76%)
******************************** Date: 30/09/12 ********************************
03:29:40:WU00:FS00:0xa5:Completed 192500 out of 250000 steps  (77%)
03:45:24:WU00:FS00:0xa5:Completed 195000 out of 250000 steps  (78%)
04:01:08:WU00:FS00:0xa5:Completed 197500 out of 250000 steps  (79%)
04:16:51:WU00:FS00:0xa5:Completed 200000 out of 250000 steps  (80%)
04:32:35:WU00:FS00:0xa5:Completed 202500 out of 250000 steps  (81%)
04:48:19:WU00:FS00:0xa5:Completed 205000 out of 250000 steps  (82%)
05:04:02:WU00:FS00:0xa5:Completed 207500 out of 250000 steps  (83%)
05:19:45:WU00:FS00:0xa5:Completed 210000 out of 250000 steps  (84%)
05:35:27:WU00:FS00:0xa5:Completed 212500 out of 250000 steps  (85%)
05:51:10:WU00:FS00:0xa5:Completed 215000 out of 250000 steps  (86%)
06:06:53:WU00:FS00:0xa5:Completed 217500 out of 250000 steps  (87%)
06:22:37:WU00:FS00:0xa5:Completed 220000 out of 250000 steps  (88%)
06:38:22:WU00:FS00:0xa5:Completed 222500 out of 250000 steps  (89%)
06:54:05:WU00:FS00:0xa5:Completed 225000 out of 250000 steps  (90%)
07:09:48:WU00:FS00:0xa5:Completed 227500 out of 250000 steps  (91%)
07:25:33:WU00:FS00:0xa5:Completed 230000 out of 250000 steps  (92%)
07:41:17:WU00:FS00:0xa5:Completed 232500 out of 250000 steps  (93%)
07:57:04:WU00:FS00:0xa5:Completed 235000 out of 250000 steps  (94%)
08:12:48:WU00:FS00:0xa5:Completed 237500 out of 250000 steps  (95%)
08:28:33:WU00:FS00:0xa5:Completed 240000 out of 250000 steps  (96%)
08:44:16:WU00:FS00:0xa5:Completed 242500 out of 250000 steps  (97%)
09:00:00:WU00:FS00:0xa5:Completed 245000 out of 250000 steps  (98%)
09:15:45:WU00:FS00:0xa5:Completed 247500 out of 250000 steps  (99%)
******************************** Date: 30/09/12 ********************************
09:31:30:WU00:FS00:0xa5:Completed 250000 out of 250000 steps  (100%)
09:31:30:WU01:FS00:Connecting to assign3.stanford.edu:8080
09:31:31:WU01:FS00:News: Welcome to Folding@Home
09:31:31:WU01:FS00:Assigned to work server 128.143.231.201
09:31:31:WU01:FS00:Requesting new work unit for slot 00: RUNNING smp:32 from 128.143.231.201
09:31:31:WU01:FS00:Connecting to 128.143.231.201:8080
09:31:38:WU01:FS00:Downloading 28.91MiB
09:31:44:WU01:FS00:Download 9.95%
09:31:44:WU00:FS00:0xa5:DynamicWrapper: Finished Work Unit: sleep=10000
09:31:50:WU01:FS00:Download 22.05%
09:31:54:WU00:FS00:0xa5:
09:31:54:WU00:FS00:0xa5:Finished Work Unit:
09:31:54:WU00:FS00:0xa5:- Reading up to 64407792 from "00/wudata_01.trr": Read 64407792
09:31:55:WU00:FS00:0xa5:trr file hash check passed.
09:31:55:WU00:FS00:0xa5:- Reading up to 31686728 from "00/wudata_01.xtc": Read 31686728
09:31:55:WU00:FS00:0xa5:xtc file hash check passed.
09:31:55:WU00:FS00:0xa5:edr file hash check passed.
09:31:55:WU00:FS00:0xa5:logfile size: 194206
09:31:55:WU00:FS00:0xa5:Leaving Run
09:31:56:WU01:FS00:Download 34.38%
09:31:56:WU00:FS00:0xa5:- Writing 96449602 bytes of core data to disk...
09:32:02:WU01:FS00:Download 46.49%
09:32:08:WU01:FS00:Download 59.24%
09:32:14:WU01:FS00:Download 71.13%
09:32:16:WU00:FS00:0xa5:Done: 96449090 -> 91701271 (compressed to 6.0 percent)
09:32:16:WU00:FS00:0xa5:  ... Done.
09:32:20:WU01:FS00:Download 83.67%
09:32:26:WU01:FS00:Download 95.57%
09:32:28:WU01:FS00:Download complete
09:32:28:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:OK project:8101 run:3 clone:13 gen:3 core:0xa5 unit:0x00000005088988e14f0e2372d878f39e
09:33:18:WU00:FS00:0xa5:- Shutting down core
09:33:18:WU00:FS00:0xa5:
09:33:18:WU00:FS00:0xa5:Folding@home Core Shutdown: FINISHED_UNIT
09:33:26:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
09:33:26:WU00:FS00:Sending unit results: id:00 state:SEND error:OK project:8102 run:0 clone:9 gen:49 core:0xa5 unit:0x0000003a088988e15011d31bd6325da7
09:33:26:WU00:FS00:Uploading 87.45MiB to 128.143.231.201
09:33:26:WU00:FS00:Connecting to 128.143.231.201:8080
09:33:26:WU01:FS00:Starting
09:33:26:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /home/user/.FAHClient/cores/www.stanford.edu/~pande/Linux/AMD64/Core_a5.fah/FahCore_a5 -dir 01 -suffix 01 -version 701 -lifeline 2697 -checkpoint 15 -np 32
09:33:26:WU01:FS00:Started FahCore on PID 4166
09:33:26:WU01:FS00:Core PID:4170
09:33:26:WU01:FS00:FahCore 0xa5 started
09:33:26:WU01:FS00:0xa5:
09:33:26:WU01:FS00:0xa5:*------------------------------*
09:33:26:WU01:FS00:0xa5:Folding@Home Gromacs SMP Core
09:33:26:WU01:FS00:0xa5:Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
09:33:26:WU01:FS00:0xa5:
09:33:26:WU01:FS00:0xa5:Preparing to commence simulation
09:33:26:WU01:FS00:0xa5:- Looking at optimizations...
09:33:26:WU01:FS00:0xa5:- Created dyn
09:33:26:WU01:FS00:0xa5:- Files status OK
09:33:29:WU01:FS00:0xa5:- Expanded 30310652 -> 33158020 (decompressed 109.3 percent)
09:33:29:WU01:FS00:0xa5:Called DecompressByteArray: compressed_data_size=30310652 data_size=33158020, decompressed_data_size=33158020 diff=0
09:33:29:WU01:FS00:0xa5:- Digital signature verified
09:33:29:WU01:FS00:0xa5:
09:33:29:WU01:FS00:0xa5:Project: 8101 (Run 3, Clone 13, Gen 3)
09:33:29:WU01:FS00:0xa5:
09:33:29:WU01:FS00:0xa5:Assembly optimizations on if available.
09:33:29:WU01:FS00:0xa5:Entering M.D.
09:33:33:WU00:FS00:Upload 1.29%
09:33:36:WU01:FS00:0xa5:Mapping NT from 32 to 32 
09:33:39:WU00:FS00:Upload 2.36%
09:33:40:WU01:FS00:0xa5:Completed 0 out of 250000 steps  (0%)
09:33:45:WU00:FS00:Upload 3.22%
09:33:51:WU00:FS00:Upload 4.29%
09:33:57:WU00:FS00:Upload 5.15%
09:34:04:WU00:FS00:Upload 6.22%
09:34:10:WU00:FS00:Upload 7.08%
09:34:17:WU00:FS00:Upload 8.15%
09:34:24:WU00:FS00:Upload 9.22%
09:34:31:WU00:FS00:Upload 10.29%
09:34:38:WU00:FS00:Upload 11.36%
09:34:46:WU00:FS00:Upload 12.44%
09:34:52:WU00:FS00:Upload 13.58%
09:34:58:WU00:FS00:Upload 14.44%
09:35:05:WU00:FS00:Upload 15.51%
09:35:12:WU00:FS00:Upload 16.58%
09:35:18:WU00:FS00:Upload 17.65%
09:35:24:WU00:FS00:Upload 18.51%
09:35:30:WU00:FS00:Upload 19.37%
09:35:37:WU00:FS00:Upload 20.44%
09:35:44:WU00:FS00:Upload 21.51%
09:35:51:WU00:FS00:Upload 22.58%
09:35:57:WU00:FS00:Upload 23.44%
09:36:04:WU00:FS00:Upload 24.51%
09:36:10:WU00:FS00:Upload 25.58%
09:36:16:WU00:FS00:Upload 26.44%
09:36:22:WU00:FS00:Upload 27.30%
09:36:28:WU00:FS00:Upload 28.16%
09:36:34:WU00:FS00:Upload 29.23%
09:36:41:WU00:FS00:Upload 30.09%
09:36:47:WU00:FS00:Upload 31.23%
09:36:53:WU00:FS00:Upload 32.09%
09:37:00:WU00:FS00:Upload 33.16%
09:37:06:WU00:FS00:Upload 34.02%
09:37:13:WU00:FS00:Upload 35.09%
09:37:19:WU00:FS00:Upload 36.16%
09:37:26:WU00:FS00:Upload 37.02%
09:37:32:WU00:FS00:Upload 38.16%
09:37:38:WU00:FS00:Upload 39.02%
09:37:45:WU00:FS00:Upload 40.09%
09:37:51:WU00:FS00:Upload 40.95%
09:37:57:WU00:FS00:Upload 42.02%
09:38:03:WU00:FS00:Upload 42.81%
09:38:10:WU00:FS00:Upload 43.88%
09:38:17:WU00:FS00:Upload 44.95%
09:38:23:WU00:FS00:Upload 45.88%
09:38:30:WU00:FS00:Upload 46.95%
09:38:37:WU00:FS00:Upload 48.03%
09:38:44:WU00:FS00:Upload 49.10%
09:38:51:WU00:FS00:Upload 50.17%
09:38:57:WU00:FS00:Upload 51.24%
09:39:04:WU00:FS00:Upload 52.10%
09:39:10:WU00:FS00:Upload 53.17%
09:39:16:WU00:FS00:Upload 54.03%
09:39:22:WU00:FS00:Upload 54.96%
09:39:29:WU00:FS00:Upload 56.03%
09:39:36:WU00:FS00:Upload 57.10%
09:39:42:WU00:FS00:Upload 58.10%
09:39:48:WU00:FS00:Upload 59.03%
09:39:54:WU00:FS00:Upload 59.89%
09:40:01:WU00:FS00:Upload 60.96%
09:40:08:WU00:FS00:Upload 61.96%
09:40:14:WU00:FS00:Upload 62.89%
09:40:21:WU00:FS00:Upload 63.96%
09:40:27:WU00:FS00:Upload 65.03%
09:40:34:WU00:FS00:Upload 65.89%
09:40:40:WU00:FS00:Upload 66.96%
09:40:46:WU00:FS00:Upload 67.82%
09:40:53:WU00:FS00:Upload 68.89%
09:40:59:WU00:FS00:Upload 69.75%
09:41:06:WU00:FS00:Upload 70.89%
09:41:12:WU00:FS00:Upload 71.97%
09:41:18:WU00:FS00:Upload 72.82%
09:41:24:WU00:FS00:Upload 73.68%
09:41:31:WU00:FS00:Upload 74.68%
09:41:37:WU00:FS00:Upload 75.75%
09:41:44:WU00:FS00:Upload 76.61%
09:41:50:WU00:FS00:Upload 77.68%
09:41:56:WU00:FS00:Upload 78.54%
09:42:03:WU00:FS00:Upload 79.61%
09:42:09:WU00:FS00:Upload 80.47%
09:42:15:WU00:FS00:Upload 81.54%
09:42:21:WU00:FS00:Upload 82.40%
09:42:28:WU00:FS00:Upload 83.47%
09:42:35:WU00:FS00:Upload 84.54%
09:42:41:WU00:FS00:Upload 85.62%
09:42:47:WU00:FS00:Upload 86.47%
09:42:53:WU00:FS00:Upload 87.33%
09:43:00:WU00:FS00:Upload 88.40%
09:43:06:WU00:FS00:Upload 89.40%
09:43:12:WU00:FS00:Upload 90.26%
09:43:18:WU00:FS00:Upload 91.19%
09:43:24:WU00:FS00:Upload 92.05%
09:43:31:WU00:FS00:Upload 93.12%
09:43:38:WU00:FS00:Upload 94.19%
09:43:44:WU00:FS00:Upload 95.26%
09:43:51:WU00:FS00:Upload 96.12%
09:43:57:WU00:FS00:Upload 97.19%
09:44:03:WU00:FS00:Upload 98.05%
09:44:09:WU00:FS00:Upload 98.98%
09:44:16:WU00:FS00:Upload 100.00%
09:44:18:WU00:FS00:Upload complete
09:44:18:WU00:FS00:Server responded WORK_QUIT (404)
09:44:18:WARNING:WU00:FS00:Server did not like results, dumping
09:44:18:WU00:FS00:Cleaning up
09:54:17:WU01:FS00:0xa5:Completed 2500 out of 250000 steps  (1%)
10:14:43:WU01:FS00:0xa5:Completed 5000 out of 250000 steps  (2%)
10:36:35:WU01:FS00:0xa5:Completed 7500 out of 250000 steps  (3%)
10:59:40:WU01:FS00:0xa5:Completed 10000 out of 250000 steps  (4%)
bollix47
Posts: 2946
Joined: Sun Dec 02, 2007 5:04 am
Location: Canada

Re: Bigadv Collection and or Assighnment server is broken

Post by bollix47 »

Hi Ben ... welcome to the folding support forum.

I too have an 8101 running after a failure and will let it run in the hope that the problem is resolved today but have changed my config to remove the bigadv flag for the time being. It won't be uploading until late tonight so I'll run regular SMP after that and if the 8101 upload was successful I'll change it back to bigadv in the morning.
kasson
Pande Group Member
Posts: 1459
Joined: Thu Nov 29, 2007 9:37 pm

Re: Bigadv Collection and or Assighnment server is broken

Post by kasson »

Yes--I see something weird going on. Nothing has changed with the work server, but I think some of the people at Stanford may have changed the assignment server without telling me. I'm investigating.
Ben_Lamb
Posts: 28
Joined: Sun Sep 30, 2012 10:41 am

Re: Bigadv Collection and or Assighnment server is broken

Post by Ben_Lamb »

bollix47 wrote:Hi Ben ... welcome to the folding support forum.

I too have an 8101 running after a failure and will let it run in the hope that the problem is resolved today but have changed my config to remove the bigadv flag for the time being. It won't be uploading until late tonight so I'll run regular SMP after that and if the 8101 upload was successful I'll change it back to bigadv in the morning.
Ok thanks will be doing the same - was gutted to lose that juicy 8102 !
Amaruk
Posts: 254
Joined: Fri Jun 20, 2008 3:57 am
Location: Watching from the Woods

Re: Bigadv Collection and or Assighnment server is broken

Post by Amaruk »

Ben_Lamb wrote:I am getting the same problem with this server - what is the best course of action now ? Delete the unit and switch to SMP ?
Running 6.34 here. Since I have some free time to babysit, I'm backing up the FAH directory at 98-99% and waiting to see if the results go through.
If that fails, I kill the client and reconfigure for -advmethods.
If this is fixed soon enough, I can restore the backup to try sending it again... (IF the server will accept it)

Theoretically you should be able to do the same by backing up V7's files, but I've never tried it.


Am rather curious as to how the assignment server would cause a work server to dump projects...
Image
mflanaga
Posts: 10
Joined: Mon Jun 06, 2011 4:35 pm

Re: Bigadv Collection and or Assighnment server is broken

Post by mflanaga »

Just adding to what's already an apparent server issue, Lost an 8101 due to "server reports problem with unit" error message after the wu seemed to complete successfully. This machine has been running -bigadv for a while on a very stable basis. (Run 2, Clone 2, Gen 77)
tear
Posts: 254
Joined: Sun Dec 02, 2007 4:08 am
Hardware configuration: None
Location: Rocky Mountains

Re: Bigadv Collection and or Assighnment server is broken

Post by tear »

Having issue w/returning WUs across all BA machines as well.

Code: Select all

Server reports problem with unit.
Server: 128.143.231.201 (returns were made to port 8080 if that's of any significance)
One man's ceiling is another man's floor.
Image
kromberg
Posts: 35
Joined: Sat Nov 07, 2009 4:36 pm

Re: Bigadv Collection and or Assighnment server is broken

Post by kromberg »

I have two BA machines reporting the same error: "Server reports problem with unit.".... Now 3 machines...
Grandpa_01
Posts: 1122
Joined: Wed Mar 04, 2009 7:36 am
Hardware configuration: 3 - Supermicro H8QGi-F AMD MC 6174=144 cores 2.5Ghz, 96GB G.Skill DDR3 1333Mhz Ubuntu 10.10
2 - Asus P6X58D-E i7 980X 4.4Ghz 6GB DDR3 2000 A-Data 64GB SSD Ubuntu 10.10
1 - Asus Rampage Gene III 17 970 4.3Ghz DDR3 2000 2-500GB Segate 7200.11 0-Raid Ubuntu 10.10
1 - Asus G73JH Laptop i7 740QM 1.86Ghz ATI 5870M

Re: Bigadv Collection and or Assighnment server is broken

Post by Grandpa_01 »

kasson wrote:Yes--I see something weird going on. Nothing has changed with the work server, but I think some of the people at Stanford may have changed the assignment server without telling me. I'm investigating.
It appears to be fixed now completed 8102 0. 18, 65 for the second time and the server accepted it this time, I am guessing the 4 it rejected and reassigned are pretty much a lost cause. O-Well some days are bad

PS just curious but did we lose a bunch of completed WU's I see it is starting over at( Run X, Clone X, Gen 0 ) Generation 0 I am thinking is a bad thing
Last edited by Grandpa_01 on Sun Sep 30, 2012 2:45 pm, edited 2 times in total.
Image
2 - SM H8QGi-F AMD 6xxx=112 cores @ 3.2 & 3.9Ghz
5 - SM X9QRI-f+ Intel 4650 = 320 cores @ 3.15Ghz
2 - I7 980X 4.4Ghz 2-GTX680
1 - 2700k 4.4Ghz GTX680
Total = 464 cores folding
Post Reply