No request for new WU after last completion

[A_Remnant]

Hello folding folks

The CPU and GPU slots have been working fine since I began folding a couple of weeks ago. I have paused and restarted a few times in the past and the program picked up right where it left off with no problems.

Yesterday the CPU slot, after a pause and restart, completed the WU but did not request a new WU and has been doing nothing after upload and cleanup. I have paused-unpaused, hit finish and fold for the slot with no change.

The GPU slot is still folding away.

Is there something else I should do.......or is there no WU ready for download at the moment?

Code: Select all

20:12:19:WU01:FS00:0xa4:Completed 240000 out of 250000 steps  (96%)20:13:47:WU01:FS00:0xa4:Completed 242500 out of 250000 steps  (97%)
20:15:16:WU01:FS00:0xa4:Completed 245000 out of 250000 steps  (98%)
20:15:16:WU00:FS00:Connecting to 171.67.108.45:8080
20:15:17:WU00:FS00:Assigned to work server 128.143.199.97
20:15:17:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:7 from 128.143.199.97
20:15:17:WU00:FS00:Connecting to 128.143.199.97:8080
20:15:19:WU00:FS00:Downloading 1.89MiB
20:15:25:WU00:FS00:Download 16.54%
20:15:31:WU00:FS00:Download 43.00%
20:15:37:WU00:FS00:Download 69.46%
20:15:43:WU00:FS00:Download 95.92%
20:15:44:WU00:FS00:Download complete
20:15:44:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:7526 run:8 clone:8 gen:490 core:0xa4 unit:0x000004d3fbcb017d5563d1f122ff939d
20:16:44:WU01:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
20:18:12:WU01:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
20:18:12:WU01:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
20:18:22:WU01:FS00:0xa4:
20:18:22:WU01:FS00:0xa4:Finished Work Unit:
20:18:22:WU01:FS00:0xa4:- Reading up to 811536 from "01/wudata_01.trr": Read 811536
20:18:22:WU01:FS00:0xa4:trr file hash check passed.
20:18:22:WU01:FS00:0xa4:- Reading up to 746200 from "01/wudata_01.xtc": Read 746200
20:18:22:WU01:FS00:0xa4:xtc file hash check passed.
20:18:22:WU01:FS00:0xa4:edr file hash check passed.
20:18:22:WU01:FS00:0xa4:logfile size: 23851
20:18:22:WU01:FS00:0xa4:Leaving Run
20:18:25:WU01:FS00:0xa4:- Writing 1584075 bytes of core data to disk...
20:18:25:WU01:FS00:0xa4:Done: 1583563 -> 1538089 (compressed to 97.1 percent)
20:18:25:WU01:FS00:0xa4:  ... Done.
20:18:25:WU01:FS00:0xa4:- Shutting down core
20:18:25:WU01:FS00:0xa4:
20:18:25:WU01:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
20:18:25:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
20:18:25:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:9038 run:925 clone:2 gen:98 core:0xa4 unit:0x0000006dab436c9e569828dbec645d51
20:18:25:WU01:FS00:Uploading 1.47MiB to 171.67.108.158
20:18:25:WU01:FS00:Connecting to 171.67.108.158:8080
20:18:25:WU00:FS00:Starting
20:18:25:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 3168 -checkpoint 15 -np 7
20:18:25:WU00:FS00:Started FahCore on PID 7520
20:18:25:WU00:FS00:Core PID:8728
20:18:25:WU00:FS00:FahCore 0xa4 started
20:18:26:WU00:FS00:0xa4:
20:18:26:WU00:FS00:0xa4:*------------------------------*
20:18:26:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
20:18:26:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
20:18:26:WU00:FS00:0xa4:
20:18:26:WU00:FS00:0xa4:Preparing to commence simulation
20:18:26:WU00:FS00:0xa4:- Looking at optimizations...
20:18:26:WU00:FS00:0xa4:- Created dyn
20:18:26:WU00:FS00:0xa4:- Files status OK
20:18:26:WU00:FS00:0xa4:- Expanded 1980825 -> 2917716 (decompressed 147.2 percent)
20:18:26:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=1980825 data_size=2917716, decompressed_data_size=2917716 diff=0
20:18:26:WU00:FS00:0xa4:- Digital signature verified
20:18:26:WU00:FS00:0xa4:
20:18:26:WU00:FS00:0xa4:Project: 7526 (Run 8, Clone 8, Gen 490)
20:18:26:WU00:FS00:0xa4:
20:18:26:WU00:FS00:0xa4:Assembly optimizations on if available.
20:18:26:WU00:FS00:0xa4:Entering M.D.
20:18:31:WU01:FS00:Upload 8.52%
20:18:32:WU00:FS00:0xa4:Mapping NT from 7 to 7 
20:18:32:WU00:FS00:0xa4:Completed 0 out of 500000 steps  (0%)
20:18:40:WU01:FS00:Upload 17.04%
20:18:46:WU01:FS00:Upload 21.30%
20:18:56:WU01:FS00:Upload 29.82%
20:19:03:WU01:FS00:Upload 38.34%
20:19:13:WU01:FS00:Upload 46.85%
20:19:20:WU01:FS00:Upload 55.37%
20:19:27:WU01:FS00:Upload 63.89%
20:19:34:WU01:FS00:Upload 72.41%
20:19:40:WU01:FS00:Upload 80.93%
20:19:46:WU01:FS00:Upload 89.45%
20:19:53:WU01:FS00:Upload 97.97%
20:19:55:WU01:FS00:Upload complete
20:19:55:WU01:FS00:Server responded WORK_ACK (400)
20:19:55:WU01:FS00:Final credit estimate, 1542.00 points
20:19:55:WU01:FS00:Cleaning up
20:23:01:WU00:FS00:0xa4:Completed 5000 out of 500000 steps  (1%)
20:27:31:WU00:FS00:0xa4:Completed 10000 out of 500000 steps  (2%)
20:32:01:WU00:FS00:0xa4:Completed 15000 out of 500000 steps  (3%)
20:34:41:FS00:Paused
20:34:41:FS00:Shutting core down
20:34:48:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
20:35:19:FS00:Unpaused
20:35:19:WU00:FS00:Starting
20:35:19:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 3168 -checkpoint 15 -np 7
20:35:19:WU00:FS00:Started FahCore on PID 3436
20:35:19:WU00:FS00:Core PID:8276
20:35:19:WU00:FS00:FahCore 0xa4 started
20:35:20:WU00:FS00:0xa4:
20:35:20:WU00:FS00:0xa4:*------------------------------*
20:35:20:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
20:35:20:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
20:35:20:WU00:FS00:0xa4:
20:35:20:WU00:FS00:0xa4:Preparing to commence simulation
20:35:20:WU00:FS00:0xa4:- Looking at optimizations...
20:35:20:WU00:FS00:0xa4:- Files status OK
20:35:20:WU00:FS00:0xa4:- Expanded 1980825 -> 2917716 (decompressed 147.2 percent)
20:35:20:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=1980825 data_size=2917716, decompressed_data_size=2917716 diff=0
20:35:20:WU00:FS00:0xa4:- Digital signature verified
20:35:20:WU00:FS00:0xa4:
20:35:20:WU00:FS00:0xa4:Project: 7526 (Run 8, Clone 8, Gen 490)
20:35:20:WU00:FS00:0xa4:
20:35:20:WU00:FS00:0xa4:Assembly optimizations on if available.
20:35:20:WU00:FS00:0xa4:Entering M.D.
20:35:25:WU00:FS00:0xa4:Using Gromacs checkpoints
20:35:26:WU00:FS00:0xa4:Mapping NT from 7 to 7 
20:35:26:WU00:FS00:0xa4:Resuming from checkpoint
20:35:26:WU00:FS00:0xa4:Verified 00/wudata_01.log
20:35:26:WU00:FS00:0xa4:Verified 00/wudata_01.trr
20:35:26:WU00:FS00:0xa4:Verified 00/wudata_01.xtc
20:35:26:WU00:FS00:0xa4:Verified 00/wudata_01.edr
20:35:26:WU00:FS00:0xa4:Completed 16390 out of 500000 steps  (3%)
20:38:50:WU00:FS00:0xa4:Completed 20000 out of 500000 steps  (4%)
20:43:29:WU00:FS00:0xa4:Completed 25000 out of 500000 steps  (5%)
20:48:01:WU00:FS00:0xa4:Completed 30000 out of 500000 steps  (6%)
20:52:35:WU00:FS00:0xa4:Completed 35000 out of 500000 steps  (7%)
20:57:05:WU00:FS00:0xa4:Completed 40000 out of 500000 steps  (8%)
21:01:35:WU00:FS00:0xa4:Completed 45000 out of 500000 steps  (9%)
21:06:05:WU00:FS00:0xa4:Completed 50000 out of 500000 steps  (10%)
21:10:36:WU00:FS00:0xa4:Completed 55000 out of 500000 steps  (11%)
21:15:08:WU00:FS00:0xa4:Completed 60000 out of 500000 steps  (12%)
21:19:38:WU00:FS00:0xa4:Completed 65000 out of 500000 steps  (13%)
21:24:09:WU00:FS00:0xa4:Completed 70000 out of 500000 steps  (14%)
21:28:39:WU00:FS00:0xa4:Completed 75000 out of 500000 steps  (15%)
21:33:09:WU00:FS00:0xa4:Completed 80000 out of 500000 steps  (16%)
21:37:40:WU00:FS00:0xa4:Completed 85000 out of 500000 steps  (17%)
21:42:10:WU00:FS00:0xa4:Completed 90000 out of 500000 steps  (18%)
21:46:37:WU00:FS00:0xa4:Completed 95000 out of 500000 steps  (19%)
21:51:03:WU00:FS00:0xa4:Completed 100000 out of 500000 steps  (20%)
21:54:42:FS00:Paused
21:54:43:FS00:Shutting core down
21:54:52:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
******************************* Date: 2016-03-08 *******************************
02:09:06:FS00:Unpaused
02:09:06:WU00:FS00:Starting
02:09:06:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 3168 -checkpoint 15 -np 7
02:09:06:WU00:FS00:Started FahCore on PID 9060
02:09:06:WU00:FS00:Core PID:448
02:09:06:WU00:FS00:FahCore 0xa4 started
02:09:07:WU00:FS00:0xa4:
02:09:07:WU00:FS00:0xa4:*------------------------------*
02:09:07:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
02:09:07:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
02:09:07:WU00:FS00:0xa4:
02:09:07:WU00:FS00:0xa4:Preparing to commence simulation
02:09:07:WU00:FS00:0xa4:- Looking at optimizations...
02:09:07:WU00:FS00:0xa4:- Files status OK
02:09:07:WU00:FS00:0xa4:- Expanded 1980825 -> 2917716 (decompressed 147.2 percent)
02:09:07:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=1980825 data_size=2917716, decompressed_data_size=2917716 diff=0
02:09:07:WU00:FS00:0xa4:- Digital signature verified
02:09:07:WU00:FS00:0xa4:
02:09:07:WU00:FS00:0xa4:Project: 7526 (Run 8, Clone 8, Gen 490)
02:09:07:WU00:FS00:0xa4:
02:09:07:WU00:FS00:0xa4:Assembly optimizations on if available.
02:09:07:WU00:FS00:0xa4:Entering M.D.
02:09:13:WU00:FS00:0xa4:Using Gromacs checkpoints
02:09:13:WU00:FS00:0xa4:Mapping NT from 7 to 7 
02:09:13:WU00:FS00:0xa4:Resuming from checkpoint
02:09:13:WU00:FS00:0xa4:Verified 00/wudata_01.log
02:09:13:WU00:FS00:0xa4:Verified 00/wudata_01.trr
02:09:13:WU00:FS00:0xa4:Verified 00/wudata_01.xtc
02:09:13:WU00:FS00:0xa4:Verified 00/wudata_01.edr
02:09:13:WU00:FS00:0xa4:Completed 99320 out of 500000 steps  (19%)
02:09:50:WU00:FS00:0xa4:Completed 100000 out of 500000 steps  (20%)

07:45:27:WU00:FS00:0xa4:Completed 480000 out of 500000 steps  (96%)
07:49:51:WU00:FS00:0xa4:Completed 485000 out of 500000 steps  (97%)
07:54:16:WU00:FS00:0xa4:Completed 490000 out of 500000 steps  (98%)
07:54:17:WU02:FS00:Connecting to 171.67.108.45:8080
07:58:40:WU00:FS00:0xa4:Completed 495000 out of 500000 steps  (99%)
08:03:04:WU00:FS00:0xa4:Completed 500000 out of 500000 steps  (100%)
08:03:05:WU00:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
08:03:15:WU00:FS00:0xa4:
08:03:15:WU00:FS00:0xa4:Finished Work Unit:
08:03:15:WU00:FS00:0xa4:- Reading up to 5729904 from "00/wudata_01.trr": Read 5729904
08:03:15:WU00:FS00:0xa4:trr file hash check passed.
08:03:15:WU00:FS00:0xa4:- Reading up to 6150556 from "00/wudata_01.xtc": Read 6150556
08:03:15:WU00:FS00:0xa4:xtc file hash check passed.
08:03:15:WU00:FS00:0xa4:edr file hash check passed.
08:03:15:WU00:FS00:0xa4:logfile size: 326738
08:03:15:WU00:FS00:0xa4:Leaving Run
08:03:18:WU00:FS00:0xa4:- Writing 12239602 bytes of core data to disk...
08:03:20:WU00:FS00:0xa4:Done: 12239090 -> 11643597 (compressed to 95.1 percent)
08:03:20:WU00:FS00:0xa4:  ... Done.
08:03:21:WU00:FS00:0xa4:- Shutting down core
08:03:21:WU00:FS00:0xa4:
08:03:21:WU00:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
08:03:21:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
08:03:21:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:7526 run:8 clone:8 gen:490 core:0xa4 unit:0x000004d3fbcb017d5563d1f122ff939d
08:03:21:WU00:FS00:Uploading 11.10MiB to 128.143.199.97
08:03:21:WU00:FS00:Connecting to 128.143.199.97:8080
08:03:32:WU00:FS00:Upload 1.13%
08:03:40:WU00:FS00:Upload 2.25%

08:15:39:WU00:FS00:Upload 97.93%
08:15:48:WU00:FS00:Upload 99.06%
08:15:55:WU00:FS00:Upload 100.00%
08:16:02:WU00:FS00:Upload complete
08:16:03:WU00:FS00:Server responded WORK_ACK (400)
08:16:03:WU00:FS00:Final credit estimate, 4775.00 points
08:16:03:WU00:FS00:Cleaning up
******************************* Date: 2016-03-08 *******************************
17:59:12:FS00:Paused
17:59:21:FS00:Unpaused
19:13:48:FS00:Finishing
******************************* Date: 2016-03-08 *******************************

[toTOW]

There is a known bug where, sometimes, the client fails to detect a timeout when it fails to download a WU, then the slot is stuck ...

Restart the client (which is sometimes impossible to do cleanly when it's stuck like that) or reboot the system.

[A_Remnant]

Here is a little more info:

The GPU slot has had no Warnings or Errors yet but the CPU slot has had a few over the last 6 days.

*********************** Log Started 2016-03-02T17:21:31Z ***********************
******************************* Date: 2016-03-02 *******************************
03:43:59:ERROR:WU00:FS00:Exception: Transfer failed
03:49:45:ERROR:WU00:FS00:Exception: Transfer failed
******************************* Date: 2016-03-03 *******************************
******************************* Date: 2016-03-03 *******************************
******************************* Date: 2016-03-03 *******************************
******************************* Date: 2016-03-03 *******************************
01:42:38:WARNING:WU03:FS00:Exception: Failed to send results to work server: Transfer failed
******************************* Date: 2016-03-04 *******************************
******************************* Date: 2016-03-04 *******************************
******************************* Date: 2016-03-04 *******************************
******************************* Date: 2016-03-04 *******************************
******************************* Date: 2016-03-05 *******************************
******************************* Date: 2016-03-05 *******************************
******************************* Date: 2016-03-05 *******************************
******************************* Date: 2016-03-05 *******************************
00:13:50:ERROR:WU01:FS00:Exception: Transfer failed
******************************* Date: 2016-03-06 *******************************
******************************* Date: 2016-03-06 *******************************
******************************* Date: 2016-03-06 *******************************
******************************* Date: 2016-03-06 *******************************
******************************* Date: 2016-03-07 *******************************
******************************* Date: 2016-03-07 *******************************
******************************* Date: 2016-03-07 *******************************
******************************* Date: 2016-03-08 *******************************
******************************* Date: 2016-03-08 *******************************
******************************* Date: 2016-03-08 *******************************
******************************* Date: 2016-03-08 *******************************

[A_Remnant]

Thank you toTow

I will shut it down...reboot...after GPU slot completes....~40 minutes

[A_Remnant]

OK

I reloaded the client ('Advanced Control') after the GPU slot had "finished" and there was no change in the CPU slot(still in the do nothing mode).....opened and closed the 'Web Control' as well....restarted the 'Advanced Control' and still no change.

Closed all programs and rebooted the 'puter......noticed a couple of "address' errors on both shutdown and restart.....to quick to record, I'm sorry to say......so I rebooted again with no errors posting.

Restarted the F@H Advanced Control and both the GPU and CPU slots were well into the downloads.....both slots are happily folding now and no 'Warnings or Errors" were posted for either slot.

Simple fix....almost sorry I bothered you.

Again....I thank you

[Joe_H]

Just using FAHControl is not enough, the FAHClient process needs to be restarted when this condition occurs. How FAHClient is restarted depends on which OS it is being run on. Often the easiest way is just rebooting, but for instance I have the necessary command lines in my command history for the OS X Terminal app to usually avoid rebooting.

[bruce]

Starting/stopping FAHControl is entirely up to you (do you want to see what's going on or modify something?) and whether it's running or not has no bearing on what is folding except when you click something.

FAHClient is supposedly designed to run continuously (ideally starting automatically after any reboot). They really should fix the bug that you encountered. I think it's the only bug that prevents FAHClient from being totally ignored since everything else can be done with FAHControl.

[A_Remnant]

bruce, Joe_H, thank you both.

Code: Select all

    CPU: Intel(R) Core(TM) i7-2700K CPU @ 3.50GHz
10:24:07:       CPU ID: GenuineIntel Family 6 Model 42 Stepping 7
10:24:07:         CPUs: 8
10:24:07:       Memory: 15.90GiB
10:24:07:  Free Memory: 14.11GiB
10:24:07:      Threads: WINDOWS_THREADS
10:24:07:   OS Version: 6.1
10:24:07:  Has Battery: false
10:24:07:   On Battery: false
10:24:07:   UTC Offset: -7
10:24:07:          PID: 4352
10:24:07:          CWD: C:/ProgramData/FAHClient
10:24:07:           OS: Windows 7 Professional
10:24:07:      OS Arch: AMD64
10:24:07:         GPUs: 1
10:24:07:        GPU 0: ATI:4 Cayman XT [Radeon HD 6900 Series]
10:24:07:         CUDA: Not detected
10:24:07:Win32 Service: false

It had been quit a while since I rebooted this computer.......all is well right now....both slots have completed at least one WU, requested and downloaded new, as advertised.