RX580 stalls at 0.00% or 99.99%

It seems that a lot of GPU problems revolve around specific versions of drivers. Though AMD has their own support structure, you can often learn from information reported by others who fold.

Moderators: Site Moderators, FAHC Science Team

Post Reply
LoomisTowcar
Posts: 4
Joined: Fri Jun 12, 2020 10:59 pm

RX580 stalls at 0.00% or 99.99%

Post by LoomisTowcar »

Driver version: 26.20.15029.27017, installed with win10-radeon-software-adrenalin-2020-edition-20.4.2-may25.exe
Pause/unpause doesn't help. I'll leave it stalled for a day, then quit and relaunch to get it going again. I only have this issue with AMD GPUs, several nVidia GPUs do not have this problem.
Below is the log from a stall @ 99.99%. Note: I pause folding between utility peak hours of 23:00Z and 4:00Z. Any insights would be appreciated!

Code: Select all

*********************** Log Started 2020-06-12T22:53:55Z ***********************
22:53:58:WU00:FS01:Starting
22:53:58:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Mas\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
22:53:58:WU00:FS01:Started FahCore on PID 18044
22:53:58:WU00:FS01:Core PID:15556
22:53:58:WU00:FS01:FahCore 0x22 started
22:53:59:WU00:FS01:0x22:*********************** Log Started 2020-06-12T22:53:58Z ***********************
22:53:59:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
22:53:59:WU00:FS01:0x22:       Type: 0x22
22:53:59:WU00:FS01:0x22:       Core: Core22
22:53:59:WU00:FS01:0x22:    Website: https://foldingathome.org/
22:53:59:WU00:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
22:53:59:WU00:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
22:53:59:WU00:FS01:0x22:             <rafal.wiewiora@choderalab.org>
22:53:59:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 18044 -checkpoint 15
22:53:59:WU00:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
22:53:59:WU00:FS01:0x22:     Config: <none>
22:53:59:WU00:FS01:0x22:************************************ Build *************************************
22:53:59:WU00:FS01:0x22:    Version: 0.0.5
22:53:59:WU00:FS01:0x22:       Date: Apr 22 2020
22:53:59:WU00:FS01:0x22:       Time: 04:42:59
22:53:59:WU00:FS01:0x22: Repository: Git
22:53:59:WU00:FS01:0x22:   Revision: 2d69202c898bd9bb3e093f51cd32bf411c2a0388
22:53:59:WU00:FS01:0x22:     Branch: HEAD
22:53:59:WU00:FS01:0x22:   Compiler: Visual C++ 2008
22:53:59:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:53:59:WU00:FS01:0x22:   Platform: win32 10
22:53:59:WU00:FS01:0x22:       Bits: 64
22:53:59:WU00:FS01:0x22:       Mode: Release
22:53:59:WU00:FS01:0x22:************************************ System ************************************
22:53:59:WU00:FS01:0x22:        CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
22:53:59:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
22:53:59:WU00:FS01:0x22:       CPUs: 18
22:53:59:WU00:FS01:0x22:     Memory: 32.00GiB
22:53:59:WU00:FS01:0x22:Free Memory: 28.13GiB
22:53:59:WU00:FS01:0x22:    Threads: WINDOWS_THREADS
22:53:59:WU00:FS01:0x22: OS Version: 6.2
22:53:59:WU00:FS01:0x22:Has Battery: false
22:53:59:WU00:FS01:0x22: On Battery: false
22:53:59:WU00:FS01:0x22: UTC Offset: -7
22:53:59:WU00:FS01:0x22:        PID: 15556
22:53:59:WU00:FS01:0x22:        CWD: C:\Users\Mas\AppData\Roaming\FAHClient\work
22:53:59:WU00:FS01:0x22:         OS: Windows 10 Enterprise
22:53:59:WU00:FS01:0x22:    OS Arch: AMD64
22:53:59:WU00:FS01:0x22:********************************************************************************
22:53:59:WU00:FS01:0x22:Project: 14561 (Run 0, Clone 1355, Gen 117)
22:53:59:WU00:FS01:0x22:Unit: 0x000000a980fccb025e9615bf10c2c7a8
22:53:59:WU00:FS01:0x22:Reading tar file core.xml
22:53:59:WU00:FS01:0x22:Reading tar file integrator.xml
22:53:59:WU00:FS01:0x22:Reading tar file state.xml
22:54:04:WU00:FS01:0x22:Reading tar file system.xml
22:54:09:WU00:FS01:0x22:Digital signatures verified
22:54:09:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
22:54:09:WU00:FS01:0x22:Version 0.0.5
22:56:15:WU00:FS01:0x22:Completed 0 out of 500000 steps (0%)
22:56:15:WU00:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
22:59:40:WU00:FS01:0x22:Completed 5000 out of 500000 steps (1%)
23:00:01:FS01:Paused
23:00:01:FS01:Shutting core down
23:00:01:WU00:FS01:0x22:WARNING:Console control signal 1 on PID 15556
23:00:01:WU00:FS01:0x22:Exiting, please wait. . .
23:00:02:WU00:FS01:0x22:Folding@home Core Shutdown: INTERRUPTED
23:00:03:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
04:00:01:FS01:Unpaused
04:00:01:WU00:FS01:Starting
04:00:01:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Mas\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
04:00:01:WU00:FS01:Started FahCore on PID 20952
04:00:02:WU00:FS01:Core PID:19004
04:00:02:WU00:FS01:FahCore 0x22 started
04:00:02:WU00:FS01:0x22:*********************** Log Started 2020-06-13T04:00:02Z ***********************
04:00:02:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
04:00:02:WU00:FS01:0x22:       Type: 0x22
04:00:02:WU00:FS01:0x22:       Core: Core22
04:00:02:WU00:FS01:0x22:    Website: https://foldingathome.org/
04:00:02:WU00:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
04:00:02:WU00:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
04:00:02:WU00:FS01:0x22:             <rafal.wiewiora@choderalab.org>
04:00:02:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 20952 -checkpoint 15
04:00:02:WU00:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
04:00:02:WU00:FS01:0x22:     Config: <none>
04:00:02:WU00:FS01:0x22:************************************ Build *************************************
04:00:02:WU00:FS01:0x22:    Version: 0.0.5
04:00:02:WU00:FS01:0x22:       Date: Apr 22 2020
04:00:02:WU00:FS01:0x22:       Time: 04:42:59
04:00:02:WU00:FS01:0x22: Repository: Git
04:00:02:WU00:FS01:0x22:   Revision: 2d69202c898bd9bb3e093f51cd32bf411c2a0388
04:00:02:WU00:FS01:0x22:     Branch: HEAD
04:00:02:WU00:FS01:0x22:   Compiler: Visual C++ 2008
04:00:02:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
04:00:02:WU00:FS01:0x22:   Platform: win32 10
04:00:02:WU00:FS01:0x22:       Bits: 64
04:00:02:WU00:FS01:0x22:       Mode: Release
04:00:02:WU00:FS01:0x22:************************************ System ************************************
04:00:02:WU00:FS01:0x22:        CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
04:00:02:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
04:00:02:WU00:FS01:0x22:       CPUs: 18
04:00:02:WU00:FS01:0x22:     Memory: 32.00GiB
04:00:02:WU00:FS01:0x22:Free Memory: 28.19GiB
04:00:02:WU00:FS01:0x22:    Threads: WINDOWS_THREADS
04:00:02:WU00:FS01:0x22: OS Version: 6.2
04:00:02:WU00:FS01:0x22:Has Battery: false
04:00:02:WU00:FS01:0x22: On Battery: false
04:00:02:WU00:FS01:0x22: UTC Offset: -7
04:00:02:WU00:FS01:0x22:        PID: 19004
04:00:02:WU00:FS01:0x22:        CWD: C:\Users\Mas\AppData\Roaming\FAHClient\work
04:00:02:WU00:FS01:0x22:         OS: Windows 10 Enterprise
04:00:02:WU00:FS01:0x22:    OS Arch: AMD64
04:00:02:WU00:FS01:0x22:********************************************************************************
04:00:02:WU00:FS01:0x22:Project: 14561 (Run 0, Clone 1355, Gen 117)
04:00:02:WU00:FS01:0x22:Unit: 0x000000a980fccb025e9615bf10c2c7a8
04:00:02:WU00:FS01:0x22:Digital signatures verified
04:00:02:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
04:00:02:WU00:FS01:0x22:Version 0.0.5
******************************* Date: 2020-06-13 *******************************
******************************* Date: 2020-06-13 *******************************
******************************* Date: 2020-06-13 *******************************
_r2w_ben
Posts: 285
Joined: Wed Apr 23, 2008 3:11 pm

Re: RX580 stalls at 0.00% or 99.99%

Post by _r2w_ben »

I have this happen a couple times a month as well on an RX 460 using Windows 8.1. For me the symptoms are 100% load reported in GPU-Z but memory is running at idle clock speed. Attempting to end the FahCore_22.exe in Task Manager results in "Access Denied". I have to reboot, which takes a few minutes for Windows to finally kill the process. I haven't noticed a pattern between projects and this happening. The same work unit that stalled will normally startup fine after a reboot and finish. All this to say I don't have a fix but can confirm similar behaviour.
LoomisTowcar
Posts: 4
Joined: Fri Jun 12, 2020 10:59 pm

Re: RX580 stalls at 0.00% or 99.99%

Post by LoomisTowcar »

_r2w_ben wrote:I have this happen a couple times a month as well on an RX 460 using Windows 8.1. For me the symptoms are 100% load reported in GPU-Z but memory is running at idle clock speed. Attempting to end the FahCore_22.exe in Task Manager results in "Access Denied". I have to reboot, which takes a few minutes for Windows to finally kill the process. I haven't noticed a pattern between projects and this happening. The same work unit that stalled will normally startup fine after a reboot and finish. All this to say I don't have a fix but can confirm similar behaviour.
Fortunately, I've only had to reboot once where I couldn't quit the client because the system tray icon had disappeared. That was with the pre-7.6.13 client (.9?).
LoomisTowcar
Posts: 4
Joined: Fri Jun 12, 2020 10:59 pm

Re: RX580 stalls at 0.00% or 99.99%

Post by LoomisTowcar »

More logs. The first is an excerpt from %APPDATA%, from a stall at an indicated 99.99% again, where it seems like the GPU was paused for my peak utility window, then unpaused, found a checkpoint, but didn't make any progress (04:00:05:WU00:FS01:0x22: Found a checkpoint file). It appears to have actually stalled at 68%, indicated during the process of shutting down:

Code: Select all

*********************** Log Started 2020-06-12T22:53:55Z ***********************
22:53:55:Trying to access database...
22:53:55:Successfully acquired database lock
22:53:55:Downloading GPUs.txt from assign1.foldingathome.org:80
22:53:55:Connecting to assign1.foldingathome.org:80
22:53:56:Read GPUs.txt
22:53:56:Enabled folding slot 00: READY cpu:16
22:53:58:Enabled folding slot 01: READY gpu:0:Ellesmere XT [Radeon RX 470/480/570/580/590]
22:53:58:****************************** FAHClient ******************************
22:53:58:        Version: 7.6.13
22:53:58:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
22:53:58:      Copyright: 2020 foldingathome.org
22:53:58:       Homepage: https://foldingathome.org/
22:53:58:           Date: Apr 27 2020
22:53:58:           Time: 21:21:01
22:53:58:       Revision: 5a652817f46116b6e135503af97f18e094414e3b
22:53:58:         Branch: master
22:53:58:       Compiler: Visual C++ 2008
22:53:58:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:53:58:       Platform: win32 10
22:53:58:           Bits: 32
22:53:58:           Mode: Release
22:53:58:           Args: --open-web-control
22:53:58:         Config: C:\Users\XXX\AppData\Roaming\FAHClient\config.xml
22:53:58:******************************** CBang ********************************
22:53:58:           Date: Apr 24 2020
22:53:58:           Time: 17:07:55
22:53:58:       Revision: ea081a3b3b0f4a37c4d0440b4f1bc184197c7797
22:53:58:         Branch: master
22:53:58:       Compiler: Visual C++ 2008
22:53:58:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:53:58:       Platform: win32 10
22:53:58:           Bits: 32
22:53:58:           Mode: Release
22:53:58:******************************* System ********************************
22:53:58:            CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
22:53:58:         CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
22:53:58:           CPUs: 18
22:53:58:         Memory: 32.00GiB
22:53:58:    Free Memory: 28.15GiB
22:53:58:        Threads: WINDOWS_THREADS
22:53:58:     OS Version: 6.2
22:53:58:    Has Battery: false
22:53:58:     On Battery: false
22:53:58:     UTC Offset: -7
22:53:58:            PID: 17292
22:53:58:            CWD: C:\Users\XXX\AppData\Roaming\FAHClient
22:53:58:  Win32 Service: false
22:53:58:             OS: Windows 10 Enterprise
22:53:58:        OS Arch: AMD64
22:53:58:           GPUs: 1
22:53:58:          GPU 0: Bus:3 Slot:0 Func:0 AMD:5 Ellesmere XT [Radeon RX
22:53:58:                 470/480/570/580/590]
22:53:58:           CUDA: Not detected: Failed to open dynamic library 'nvcuda.dll': The
22:53:58:                 specified module could not be found.
22:53:58:
22:53:58:OpenCL Device 0: Platform:0 Device:0 Bus:3 Slot:0 Compute:1.2 Driver:3004.8
22:53:58:******************************* libFAH ********************************
22:53:58:           Date: Apr 15 2020
22:53:58:           Time: 14:53:14
22:53:58:       Revision: 216968bc7025029c841ed6e36e81a03a316890d3
22:53:58:         Branch: master
22:53:58:       Compiler: Visual C++ 2008
22:53:58:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:53:58:       Platform: win32 10
22:53:58:           Bits: 32
22:53:58:           Mode: Release
22:53:58:***********************************************************************
22:53:58:<config>
22:53:58:  <!-- Folding Slot Configuration -->
22:53:58:  <cause v='COVID_19'/>
22:53:58:  <max-packet-size v='big'/>
22:53:58:
22:53:58:  <!-- HTTP Server -->
22:53:58:  <allow v='127.0.0.1 10.12.9.0/24'/>
22:53:58:
22:53:58:  <!-- Network -->
22:53:58:  <proxy v=':8080'/>
22:53:58:
22:53:58:  <!-- Remote Command Server -->
22:53:58:  <command-allow-no-pass v='127.0.0.1 10.12.9.0/24'/>
22:53:58:
22:53:58:  <!-- Slot Control -->
22:53:58:  <power v='full'/>
22:53:58:
22:53:58:  <!-- User Information -->
22:53:58:  <passkey v='*****'/>
22:53:58:  <team v='230318'/>
22:53:58:  <user v='Loomis_Towcar'/>
22:53:58:
22:53:58:  <!-- Web Server -->
22:53:58:  <web-allow v='127.0.0.1 10.12.9.0/24'/>
22:53:58:
22:53:58:  <!-- Folding Slots -->
22:53:58:  <slot id='0' type='CPU'>
22:53:58:    <cpus v='16'/>
22:53:58:  </slot>
22:53:58:  <slot id='1' type='GPU'/>
22:53:58:</config>
22:53:58:WU00:FS01:Starting
22:53:58:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\XXX\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
22:53:58:WU00:FS01:Started FahCore on PID 18044
22:53:58:WU00:FS01:Core PID:15556
22:53:58:WU00:FS01:FahCore 0x22 started
22:53:59:WU00:FS01:0x22:*********************** Log Started 2020-06-12T22:53:58Z ***********************
22:53:59:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
22:53:59:WU00:FS01:0x22:       Type: 0x22
22:53:59:WU00:FS01:0x22:       Core: Core22
22:53:59:WU00:FS01:0x22:    Website: https://foldingathome.org/
22:53:59:WU00:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
22:53:59:WU00:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
22:53:59:WU00:FS01:0x22:             <rafal.wiewiora@choderalab.org>
22:53:59:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 18044 -checkpoint 15
22:53:59:WU00:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
22:53:59:WU00:FS01:0x22:     Config: <none>
22:53:59:WU00:FS01:0x22:************************************ Build *************************************
22:53:59:WU00:FS01:0x22:    Version: 0.0.5
22:53:59:WU00:FS01:0x22:       Date: Apr 22 2020
22:53:59:WU00:FS01:0x22:       Time: 04:42:59
22:53:59:WU00:FS01:0x22: Repository: Git
22:53:59:WU00:FS01:0x22:   Revision: 2d69202c898bd9bb3e093f51cd32bf411c2a0388
22:53:59:WU00:FS01:0x22:     Branch: HEAD
22:53:59:WU00:FS01:0x22:   Compiler: Visual C++ 2008
22:53:59:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:53:59:WU00:FS01:0x22:   Platform: win32 10
22:53:59:WU00:FS01:0x22:       Bits: 64
22:53:59:WU00:FS01:0x22:       Mode: Release
22:53:59:WU00:FS01:0x22:************************************ System ************************************
22:53:59:WU00:FS01:0x22:        CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
22:53:59:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
22:53:59:WU00:FS01:0x22:       CPUs: 18
22:53:59:WU00:FS01:0x22:     Memory: 32.00GiB
22:53:59:WU00:FS01:0x22:Free Memory: 28.13GiB
22:53:59:WU00:FS01:0x22:    Threads: WINDOWS_THREADS
22:53:59:WU00:FS01:0x22: OS Version: 6.2
22:53:59:WU00:FS01:0x22:Has Battery: false
22:53:59:WU00:FS01:0x22: On Battery: false
22:53:59:WU00:FS01:0x22: UTC Offset: -7
22:53:59:WU00:FS01:0x22:        PID: 15556
22:53:59:WU00:FS01:0x22:        CWD: C:\Users\XXX\AppData\Roaming\FAHClient\work
22:53:59:WU00:FS01:0x22:         OS: Windows 10 Enterprise
22:53:59:WU00:FS01:0x22:    OS Arch: AMD64
22:53:59:WU00:FS01:0x22:********************************************************************************
22:53:59:WU00:FS01:0x22:Project: 14561 (Run 0, Clone 1355, Gen 117)
22:53:59:WU00:FS01:0x22:Unit: 0x000000a980fccb025e9615bf10c2c7a8
22:53:59:WU00:FS01:0x22:Reading tar file core.xml
22:53:59:WU00:FS01:0x22:Reading tar file integrator.xml
22:53:59:WU00:FS01:0x22:Reading tar file state.xml
22:54:00:WU01:FS00:Starting
22:54:00:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\XXX\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -np 16
22:54:00:WU01:FS00:Started FahCore on PID 20204
22:54:00:WU01:FS00:Core PID:20252
22:54:00:WU01:FS00:FahCore 0xa7 started
22:54:00:WU01:FS00:0xa7:*********************** Log Started 2020-06-12T22:54:00Z ***********************
22:54:00:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
22:54:00:WU01:FS00:0xa7:       Type: 0xa7
22:54:00:WU01:FS00:0xa7:       Core: Gromacs
22:54:00:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 20204 -checkpoint 15 -np
22:54:00:WU01:FS00:0xa7:             16
22:54:00:WU01:FS00:0xa7:************************************ CBang *************************************
22:54:00:WU01:FS00:0xa7:       Date: Oct 26 2019
22:54:00:WU01:FS00:0xa7:       Time: 01:38:25
22:54:00:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
22:54:00:WU01:FS00:0xa7:     Branch: master
22:54:00:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
22:54:00:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:54:00:WU01:FS00:0xa7:   Platform: win32 10
22:54:00:WU01:FS00:0xa7:       Bits: 64
22:54:00:WU01:FS00:0xa7:       Mode: Release
22:54:00:WU01:FS00:0xa7:************************************ System ************************************
22:54:00:WU01:FS00:0xa7:        CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
22:54:00:WU01:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
22:54:00:WU01:FS00:0xa7:       CPUs: 18
22:54:00:WU01:FS00:0xa7:     Memory: 32.00GiB
22:54:00:WU01:FS00:0xa7:Free Memory: 27.83GiB
22:54:00:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
22:54:00:WU01:FS00:0xa7: OS Version: 6.2
22:54:00:WU01:FS00:0xa7:Has Battery: false
22:54:00:WU01:FS00:0xa7: On Battery: false
22:54:01:WU01:FS00:0xa7: UTC Offset: -7
22:54:01:WU01:FS00:0xa7:        PID: 20252
22:54:01:WU01:FS00:0xa7:        CWD: C:\Users\XXX\AppData\Roaming\FAHClient\work
22:54:01:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
22:54:01:WU01:FS00:0xa7:    Version: 0.0.18
22:54:01:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
22:54:01:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
22:54:01:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
22:54:01:WU01:FS00:0xa7:       Date: Oct 26 2019
22:54:01:WU01:FS00:0xa7:       Time: 01:52:30
22:54:01:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
22:54:01:WU01:FS00:0xa7:     Branch: master
22:54:01:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
22:54:01:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:54:01:WU01:FS00:0xa7:   Platform: win32 10
22:54:01:WU01:FS00:0xa7:       Bits: 64
22:54:01:WU01:FS00:0xa7:       Mode: Release
22:54:01:WU01:FS00:0xa7:************************************ Build *************************************
22:54:01:WU01:FS00:0xa7:       SIMD: avx_256
22:54:01:WU01:FS00:0xa7:********************************************************************************
22:54:01:WU01:FS00:0xa7:Project: 16805 (Run 7, Clone 370, Gen 27)
22:54:01:WU01:FS00:0xa7:Unit: 0x0000002482ed0b915eb42210cef44fc3
22:54:01:WU01:FS00:0xa7:Digital signatures verified
22:54:01:WU01:FS00:0xa7:Calling: mdrun -s frame27.tpr -o frame27.trr -cpi state.cpt -cpt 15 -nt 16
22:54:01:WU01:FS00:0xa7:Steps: first=13500000 total=500000
22:54:04:WU00:FS01:0x22:Reading tar file system.xml
22:54:05:WU01:FS00:0xa7:Completed 423072 out of 500000 steps (84%)
22:54:07:8:127.0.0.1:New Web session
22:54:09:WU00:FS01:0x22:Digital signatures verified
22:54:09:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
22:54:09:WU00:FS01:0x22:Version 0.0.5
22:56:15:WU00:FS01:0x22:Completed 0 out of 500000 steps (0%)
22:56:15:WU00:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
22:56:38:WU01:FS00:0xa7:Completed 425000 out of 500000 steps (85%)
22:59:40:WU00:FS01:0x22:Completed 5000 out of 500000 steps (1%)
23:00:01:FS00:Paused
23:00:01:FS01:Paused
23:00:01:FS00:Shutting core down
23:00:01:FS01:Shutting core down
23:00:01:WU01:FS00:0xa7:WARNING:Console control signal 1 on PID 20252
23:00:01:WU00:FS01:0x22:WARNING:Console control signal 1 on PID 15556
23:00:01:WU01:FS00:0xa7:Exiting, please wait. . .
23:00:01:WU00:FS01:0x22:Exiting, please wait. . .
23:00:02:WU00:FS01:0x22:Folding@home Core Shutdown: INTERRUPTED
23:00:03:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
23:00:04:WU01:FS00:0xa7:Folding@home Core Shutdown: INTERRUPTED
23:00:05:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
23:01:02:Removing old file 'configs/config-20200604-230022.xml'
23:01:02:Saving configuration to config.xml
23:01:02:<config>
23:01:02:  <!-- Folding Slot Configuration -->
23:01:02:  <cause v='COVID_19'/>
23:01:02:  <max-packet-size v='big'/>
23:01:02:
23:01:02:  <!-- HTTP Server -->
23:01:02:  <allow v='127.0.0.1 10.12.9.0/24'/>
23:01:02:
23:01:02:  <!-- Network -->
23:01:02:  <proxy v=':8080'/>
23:01:02:
23:01:02:  <!-- Remote Command Server -->
23:01:02:  <command-allow-no-pass v='127.0.0.1 10.12.9.0/24'/>
23:01:02:
23:01:02:  <!-- Slot Control -->
23:01:02:  <power v='full'/>
23:01:02:
23:01:02:  <!-- User Information -->
23:01:02:  <passkey v='*****'/>
23:01:02:  <team v='230318'/>
23:01:02:  <user v='Loomis_Towcar'/>
23:01:02:
23:01:02:  <!-- Web Server -->
23:01:02:  <web-allow v='127.0.0.1 10.12.9.0/24'/>
23:01:02:
23:01:02:  <!-- Folding Slots -->
23:01:02:  <slot id='0' type='CPU'>
23:01:02:    <cpus v='16'/>
23:01:02:    <paused v='true'/>
23:01:02:  </slot>
23:01:02:  <slot id='1' type='GPU'>
23:01:02:    <paused v='true'/>
23:01:02:  </slot>
23:01:02:</config>
04:00:01:FS00:Unpaused
04:00:01:FS01:Unpaused
04:00:01:WU00:FS01:Starting
04:00:01:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\XXX\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
04:00:01:WU00:FS01:Started FahCore on PID 20952
04:00:02:WU00:FS01:Core PID:19004
04:00:02:WU00:FS01:FahCore 0x22 started
04:00:02:WU01:FS00:Starting
04:00:02:WU00:FS01:0x22:*********************** Log Started 2020-06-13T04:00:02Z ***********************
04:00:02:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\XXX\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -np 16
04:00:02:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
04:00:02:WU01:FS00:Started FahCore on PID 19184
04:00:02:WU00:FS01:0x22:       Type: 0x22
04:00:02:WU00:FS01:0x22:       Core: Core22
04:00:02:WU00:FS01:0x22:    Website: https://foldingathome.org/
04:00:02:WU00:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
04:00:02:WU00:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
04:00:02:WU00:FS01:0x22:             <rafal.wiewiora@choderalab.org>
04:00:02:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 20952 -checkpoint 15
04:00:02:WU00:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
04:00:02:WU00:FS01:0x22:     Config: <none>
04:00:02:WU00:FS01:0x22:************************************ Build *************************************
04:00:02:WU00:FS01:0x22:    Version: 0.0.5
04:00:02:WU00:FS01:0x22:       Date: Apr 22 2020
04:00:02:WU00:FS01:0x22:       Time: 04:42:59
04:00:02:WU00:FS01:0x22: Repository: Git
04:00:02:WU00:FS01:0x22:   Revision: 2d69202c898bd9bb3e093f51cd32bf411c2a0388
04:00:02:WU00:FS01:0x22:     Branch: HEAD
04:00:02:WU01:FS00:Core PID:19544
04:00:02:WU00:FS01:0x22:   Compiler: Visual C++ 2008
04:00:02:WU01:FS00:FahCore 0xa7 started
04:00:02:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
04:00:02:WU00:FS01:0x22:   Platform: win32 10
04:00:02:WU00:FS01:0x22:       Bits: 64
04:00:02:WU00:FS01:0x22:       Mode: Release
04:00:02:WU00:FS01:0x22:************************************ System ************************************
04:00:02:WU00:FS01:0x22:        CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
04:00:02:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
04:00:02:WU00:FS01:0x22:       CPUs: 18
04:00:02:WU00:FS01:0x22:     Memory: 32.00GiB
04:00:02:WU00:FS01:0x22:Free Memory: 28.19GiB
04:00:02:WU00:FS01:0x22:    Threads: WINDOWS_THREADS
04:00:02:WU00:FS01:0x22: OS Version: 6.2
04:00:02:WU00:FS01:0x22:Has Battery: false
04:00:02:WU00:FS01:0x22: On Battery: false
04:00:02:WU00:FS01:0x22: UTC Offset: -7
04:00:02:WU00:FS01:0x22:        PID: 19004
04:00:02:WU00:FS01:0x22:        CWD: C:\Users\XXX\AppData\Roaming\FAHClient\work
04:00:02:WU00:FS01:0x22:         OS: Windows 10 Enterprise
04:00:02:WU00:FS01:0x22:    OS Arch: AMD64
04:00:02:WU00:FS01:0x22:********************************************************************************
04:00:02:WU00:FS01:0x22:Project: 14561 (Run 0, Clone 1355, Gen 117)
04:00:02:WU00:FS01:0x22:Unit: 0x000000a980fccb025e9615bf10c2c7a8
04:00:02:WU00:FS01:0x22:Digital signatures verified
04:00:02:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
04:00:02:WU00:FS01:0x22:Version 0.0.5
<FS00 entried redacted to shorten post>
******************************* Date: 2020-06-13 *******************************
<FS00 entried redacted to shorten post>
******************************* Date: 2020-06-13 *******************************
<FS00 entried redacted to shorten post>
******************************* Date: 2020-06-13 *******************************
<FS00 entried redacted to shorten post>
19:09:23:WU00:FS01:0x22:Completed 0 out of 500000 steps (0%)
19:09:24:WU00:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
19:09:44:WU01:FS00:0xa7:Completed 222500 out of 250000 steps (89%)
19:11:16:WU01:FS00:0xa7:Completed 225000 out of 250000 steps (90%)
19:12:45:WU00:FS01:0x22:Completed 5000 out of 500000 steps (1%)
19:12:46:WU01:FS00:0xa7:Completed 227500 out of 250000 steps (91%)
19:14:16:WU01:FS00:0xa7:Completed 230000 out of 250000 steps (92%)
19:15:46:WU01:FS00:0xa7:Completed 232500 out of 250000 steps (93%)
19:15:59:WU00:FS01:0x22:Completed 10000 out of 500000 steps (2%)
19:17:17:WU01:FS00:0xa7:Completed 235000 out of 250000 steps (94%)
19:18:47:WU01:FS00:0xa7:Completed 237500 out of 250000 steps (95%)
19:19:12:WU00:FS01:0x22:Completed 15000 out of 500000 steps (3%)
19:20:16:WU01:FS00:0xa7:Completed 240000 out of 250000 steps (96%)
19:21:46:WU01:FS00:0xa7:Completed 242500 out of 250000 steps (97%)
19:22:25:WU00:FS01:0x22:Completed 20000 out of 500000 steps (4%)
19:23:17:WU01:FS00:0xa7:Completed 245000 out of 250000 steps (98%)
19:24:47:WU01:FS00:0xa7:Completed 247500 out of 250000 steps (99%)
19:24:48:WU02:FS00:Connecting to assign1.foldingathome.org:80
19:24:48:WU02:FS00:Assigned to work server 69.94.66.7
19:24:48:WU02:FS00:Requesting new work unit for slot 00: RUNNING cpu:16 from 69.94.66.7
19:24:48:WU02:FS00:Connecting to 69.94.66.7:8080
19:24:49:WU02:FS00:Downloading 2.84MiB
19:24:51:WU02:FS00:Download complete
19:24:51:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:14379 run:563 clone:3 gen:169 core:0xa7 unit:0x000000c3455e42075e93300173653c36
19:26:08:WU00:FS01:0x22:Completed 25000 out of 500000 steps (5%)
19:26:17:WU01:FS00:0xa7:Completed 250000 out of 250000 steps (100%)
19:26:22:WU01:FS00:0xa7:Saving result file ..\logfile_01.txt
19:26:22:WU01:FS00:0xa7:Saving result file dhdl.xvg
19:26:22:WU01:FS00:0xa7:Saving result file frame170.trr
19:26:22:WU01:FS00:0xa7:Saving result file md.log
19:26:22:WU01:FS00:0xa7:Saving result file pullf.xvg
19:26:22:WU01:FS00:0xa7:Saving result file pullx.xvg
19:26:22:WU01:FS00:0xa7:Saving result file science.log
19:26:22:WU01:FS00:0xa7:Saving result file traj_comp.xtc
19:26:22:WU01:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
19:26:22:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
19:26:22:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:14379 run:523 clone:3 gen:170 core:0xa7 unit:0x000000c2455e42075e9330d5943ddfbd
19:26:22:WU01:FS00:Uploading 6.49MiB to 69.94.66.7
19:26:22:WU01:FS00:Connecting to 69.94.66.7:8080
19:26:22:WU02:FS00:Starting
19:26:22:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\XXX\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 02 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -np 16
19:26:22:WU02:FS00:Started FahCore on PID 17424
19:26:22:WU02:FS00:Core PID:18096
19:26:22:WU02:FS00:FahCore 0xa7 started
19:26:23:WU02:FS00:0xa7:*********************** Log Started 2020-06-13T19:26:22Z ***********************
19:26:23:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
<FS00 entried redacted to shorten post>
19:26:23:WU02:FS00:0xa7:Steps: first=0 total=250000
19:26:26:WU02:FS00:0xa7:Completed 1 out of 250000 steps (0%)
19:26:28:WU01:FS00:Upload 25.05%
19:26:34:WU01:FS00:Upload 53.96%
19:26:40:WU01:FS00:Upload 81.91%
19:26:44:WU01:FS00:Upload complete
19:26:44:WU01:FS00:Server responded WORK_ACK (400)
19:26:44:WU01:FS00:Final credit estimate, 4039.00 points
19:26:44:WU01:FS00:Cleaning up
19:27:55:WU02:FS00:0xa7:Completed 2500 out of 250000 steps (1%)
19:29:21:WU00:FS01:0x22:Completed 30000 out of 500000 steps (6%)
19:29:25:WU02:FS00:0xa7:Completed 5000 out of 250000 steps (2%)
19:30:53:WU02:FS00:0xa7:Completed 7500 out of 250000 steps (3%)
19:32:22:WU02:FS00:0xa7:Completed 10000 out of 250000 steps (4%)
19:32:34:WU00:FS01:0x22:Completed 35000 out of 500000 steps (7%)
19:33:52:WU02:FS00:0xa7:Completed 12500 out of 250000 steps (5%)
19:35:21:WU02:FS00:0xa7:Completed 15000 out of 250000 steps (6%)
19:35:48:WU00:FS01:0x22:Completed 40000 out of 500000 steps (8%)
19:36:53:WU02:FS00:0xa7:Completed 17500 out of 250000 steps (7%)
19:38:23:WU02:FS00:0xa7:Completed 20000 out of 250000 steps (8%)
19:39:31:WU00:FS01:0x22:Completed 45000 out of 500000 steps (9%)
19:39:52:WU02:FS00:0xa7:Completed 22500 out of 250000 steps (9%)
19:41:22:WU02:FS00:0xa7:Completed 25000 out of 250000 steps (10%)
19:42:44:WU00:FS01:0x22:Completed 50000 out of 500000 steps (10%)
19:42:53:WU02:FS00:0xa7:Completed 27500 out of 250000 steps (11%)
19:44:23:WU02:FS00:0xa7:Completed 30000 out of 250000 steps (12%)
19:45:52:WU02:FS00:0xa7:Completed 32500 out of 250000 steps (13%)
19:45:57:WU00:FS01:0x22:Completed 55000 out of 500000 steps (11%)
19:47:23:WU02:FS00:0xa7:Completed 35000 out of 250000 steps (14%)
19:48:53:WU02:FS00:0xa7:Completed 37500 out of 250000 steps (15%)
19:49:10:WU00:FS01:0x22:Completed 60000 out of 500000 steps (12%)
19:50:26:WU02:FS00:0xa7:Completed 40000 out of 250000 steps (16%)
19:51:56:WU02:FS00:0xa7:Completed 42500 out of 250000 steps (17%)
19:52:56:WU00:FS01:0x22:Completed 65000 out of 500000 steps (13%)
19:53:25:WU02:FS00:0xa7:Completed 45000 out of 250000 steps (18%)
19:54:55:WU02:FS00:0xa7:Completed 47500 out of 250000 steps (19%)
19:56:09:WU00:FS01:0x22:Completed 70000 out of 500000 steps (14%)
19:56:26:WU02:FS00:0xa7:Completed 50000 out of 250000 steps (20%)
19:57:56:WU02:FS00:0xa7:Completed 52500 out of 250000 steps (21%)
19:59:22:WU00:FS01:0x22:Completed 75000 out of 500000 steps (15%)
19:59:25:WU02:FS00:0xa7:Completed 55000 out of 250000 steps (22%)
20:00:54:WU02:FS00:0xa7:Completed 57500 out of 250000 steps (23%)
20:02:25:WU02:FS00:0xa7:Completed 60000 out of 250000 steps (24%)
20:02:35:WU00:FS01:0x22:Completed 80000 out of 500000 steps (16%)
20:03:57:WU02:FS00:0xa7:Completed 62500 out of 250000 steps (25%)
20:05:26:WU02:FS00:0xa7:Completed 65000 out of 250000 steps (26%)
20:06:21:WU00:FS01:0x22:Completed 85000 out of 500000 steps (17%)
20:06:56:WU02:FS00:0xa7:Completed 67500 out of 250000 steps (27%)
20:08:26:WU02:FS00:0xa7:Completed 70000 out of 250000 steps (28%)
20:09:35:WU00:FS01:0x22:Completed 90000 out of 500000 steps (18%)
20:09:57:WU02:FS00:0xa7:Completed 72500 out of 250000 steps (29%)
20:11:28:WU02:FS00:0xa7:Completed 75000 out of 250000 steps (30%)
20:12:47:WU00:FS01:0x22:Completed 95000 out of 500000 steps (19%)
20:12:58:WU02:FS00:0xa7:Completed 77500 out of 250000 steps (31%)
20:14:29:WU02:FS00:0xa7:Completed 80000 out of 250000 steps (32%)
20:16:00:WU02:FS00:0xa7:Completed 82500 out of 250000 steps (33%)
20:16:00:WU00:FS01:0x22:Completed 100000 out of 500000 steps (20%)
20:17:32:WU02:FS00:0xa7:Completed 85000 out of 250000 steps (34%)
20:19:02:WU02:FS00:0xa7:Completed 87500 out of 250000 steps (35%)
20:19:44:WU00:FS01:0x22:Completed 105000 out of 500000 steps (21%)
20:20:32:WU02:FS00:0xa7:Completed 90000 out of 250000 steps (36%)
20:22:02:WU02:FS00:0xa7:Completed 92500 out of 250000 steps (37%)
20:22:57:WU00:FS01:0x22:Completed 110000 out of 500000 steps (22%)
20:23:33:WU02:FS00:0xa7:Completed 95000 out of 250000 steps (38%)
20:25:03:WU02:FS00:0xa7:Completed 97500 out of 250000 steps (39%)
20:26:10:WU00:FS01:0x22:Completed 115000 out of 500000 steps (23%)
20:26:35:WU02:FS00:0xa7:Completed 100000 out of 250000 steps (40%)
20:28:05:WU02:FS00:0xa7:Completed 102500 out of 250000 steps (41%)
20:29:22:WU00:FS01:0x22:Completed 120000 out of 500000 steps (24%)
20:29:37:WU02:FS00:0xa7:Completed 105000 out of 250000 steps (42%)
20:31:08:WU02:FS00:0xa7:Completed 107500 out of 250000 steps (43%)
20:32:38:WU02:FS00:0xa7:Completed 110000 out of 250000 steps (44%)
20:33:06:WU00:FS01:0x22:Completed 125000 out of 500000 steps (25%)
20:34:08:WU02:FS00:0xa7:Completed 112500 out of 250000 steps (45%)
20:35:39:WU02:FS00:0xa7:Completed 115000 out of 250000 steps (46%)
20:36:19:WU00:FS01:0x22:Completed 130000 out of 500000 steps (26%)
20:37:10:WU02:FS00:0xa7:Completed 117500 out of 250000 steps (47%)
20:38:40:WU02:FS00:0xa7:Completed 120000 out of 250000 steps (48%)
20:39:32:WU00:FS01:0x22:Completed 135000 out of 500000 steps (27%)
20:40:10:WU02:FS00:0xa7:Completed 122500 out of 250000 steps (49%)
20:41:43:WU02:FS00:0xa7:Completed 125000 out of 250000 steps (50%)
20:42:44:WU00:FS01:0x22:Completed 140000 out of 500000 steps (28%)
20:43:16:WU02:FS00:0xa7:Completed 127500 out of 250000 steps (51%)
20:44:47:WU02:FS00:0xa7:Completed 130000 out of 250000 steps (52%)
20:46:17:WU02:FS00:0xa7:Completed 132500 out of 250000 steps (53%)
20:46:27:WU00:FS01:0x22:Completed 145000 out of 500000 steps (29%)
20:47:48:WU02:FS00:0xa7:Completed 135000 out of 250000 steps (54%)
20:49:19:WU02:FS00:0xa7:Completed 137500 out of 250000 steps (55%)
20:49:40:WU00:FS01:0x22:Completed 150000 out of 500000 steps (30%)
20:50:49:WU02:FS00:0xa7:Completed 140000 out of 250000 steps (56%)
20:52:19:WU02:FS00:0xa7:Completed 142500 out of 250000 steps (57%)
20:52:53:WU00:FS01:0x22:Completed 155000 out of 500000 steps (31%)
20:53:50:WU02:FS00:0xa7:Completed 145000 out of 250000 steps (58%)
20:55:19:WU02:FS00:0xa7:Completed 147500 out of 250000 steps (59%)
20:56:06:WU00:FS01:0x22:Completed 160000 out of 500000 steps (32%)
20:56:54:WU02:FS00:0xa7:Completed 150000 out of 250000 steps (60%)
20:58:25:WU02:FS00:0xa7:Completed 152500 out of 250000 steps (61%)
20:59:50:WU00:FS01:0x22:Completed 165000 out of 500000 steps (33%)
20:59:55:WU02:FS00:0xa7:Completed 155000 out of 250000 steps (62%)
21:01:25:WU02:FS00:0xa7:Completed 157500 out of 250000 steps (63%)
21:02:56:WU02:FS00:0xa7:Completed 160000 out of 250000 steps (64%)
21:03:03:WU00:FS01:0x22:Completed 170000 out of 500000 steps (34%)
21:04:27:WU02:FS00:0xa7:Completed 162500 out of 250000 steps (65%)
21:05:56:WU02:FS00:0xa7:Completed 165000 out of 250000 steps (66%)
21:06:15:WU00:FS01:0x22:Completed 175000 out of 500000 steps (35%)
21:07:26:WU02:FS00:0xa7:Completed 167500 out of 250000 steps (67%)
21:08:56:WU02:FS00:0xa7:Completed 170000 out of 250000 steps (68%)
21:09:28:WU00:FS01:0x22:Completed 180000 out of 500000 steps (36%)
21:10:29:WU02:FS00:0xa7:Completed 172500 out of 250000 steps (69%)
21:12:01:WU02:FS00:0xa7:Completed 175000 out of 250000 steps (70%)
21:13:13:WU00:FS01:0x22:Completed 185000 out of 500000 steps (37%)
21:13:31:WU02:FS00:0xa7:Completed 177500 out of 250000 steps (71%)
21:15:01:WU02:FS00:0xa7:Completed 180000 out of 250000 steps (72%)
21:16:26:WU00:FS01:0x22:Completed 190000 out of 500000 steps (38%)
21:16:31:WU02:FS00:0xa7:Completed 182500 out of 250000 steps (73%)
21:18:01:WU02:FS00:0xa7:Completed 185000 out of 250000 steps (74%)
21:19:31:WU02:FS00:0xa7:Completed 187500 out of 250000 steps (75%)
21:19:39:WU00:FS01:0x22:Completed 195000 out of 500000 steps (39%)
21:21:01:WU02:FS00:0xa7:Completed 190000 out of 250000 steps (76%)
21:22:29:WU02:FS00:0xa7:Completed 192500 out of 250000 steps (77%)
21:22:52:WU00:FS01:0x22:Completed 200000 out of 500000 steps (40%)
21:24:00:WU02:FS00:0xa7:Completed 195000 out of 250000 steps (78%)
21:25:30:WU02:FS00:0xa7:Completed 197500 out of 250000 steps (79%)
21:26:36:WU00:FS01:0x22:Completed 205000 out of 500000 steps (41%)
21:27:01:WU02:FS00:0xa7:Completed 200000 out of 250000 steps (80%)
21:28:32:WU02:FS00:0xa7:Completed 202500 out of 250000 steps (81%)
21:29:49:WU00:FS01:0x22:Completed 210000 out of 500000 steps (42%)
21:30:01:WU02:FS00:0xa7:Completed 205000 out of 250000 steps (82%)
21:31:31:WU02:FS00:0xa7:Completed 207500 out of 250000 steps (83%)
21:33:01:WU02:FS00:0xa7:Completed 210000 out of 250000 steps (84%)
21:33:03:WU00:FS01:0x22:Completed 215000 out of 500000 steps (43%)
21:34:31:WU02:FS00:0xa7:Completed 212500 out of 250000 steps (85%)
21:36:01:WU02:FS00:0xa7:Completed 215000 out of 250000 steps (86%)
21:36:16:WU00:FS01:0x22:Completed 220000 out of 500000 steps (44%)
21:37:33:WU02:FS00:0xa7:Completed 217500 out of 250000 steps (87%)
21:39:03:WU02:FS00:0xa7:Completed 220000 out of 250000 steps (88%)
21:39:58:WU00:FS01:0x22:Completed 225000 out of 500000 steps (45%)
21:40:32:WU02:FS00:0xa7:Completed 222500 out of 250000 steps (89%)
21:42:03:WU02:FS00:0xa7:Completed 225000 out of 250000 steps (90%)
21:43:11:WU00:FS01:0x22:Completed 230000 out of 500000 steps (46%)
21:43:34:WU02:FS00:0xa7:Completed 227500 out of 250000 steps (91%)
21:45:03:WU02:FS00:0xa7:Completed 230000 out of 250000 steps (92%)
21:46:24:WU00:FS01:0x22:Completed 235000 out of 500000 steps (47%)
21:46:33:WU02:FS00:0xa7:Completed 232500 out of 250000 steps (93%)
21:48:04:WU02:FS00:0xa7:Completed 235000 out of 250000 steps (94%)
21:49:34:WU02:FS00:0xa7:Completed 237500 out of 250000 steps (95%)
21:49:37:WU00:FS01:0x22:Completed 240000 out of 500000 steps (48%)
21:51:07:WU02:FS00:0xa7:Completed 240000 out of 250000 steps (96%)
21:52:36:WU02:FS00:0xa7:Completed 242500 out of 250000 steps (97%)
21:53:22:WU00:FS01:0x22:Completed 245000 out of 500000 steps (49%)
21:54:06:WU02:FS00:0xa7:Completed 245000 out of 250000 steps (98%)
21:55:36:WU02:FS00:0xa7:Completed 247500 out of 250000 steps (99%)
21:55:37:WU01:FS00:Connecting to assign1.foldingathome.org:80
21:55:37:WU01:FS00:Assigned to work server 40.114.52.201
21:55:37:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:16 from 40.114.52.201
21:55:37:WU01:FS00:Connecting to 40.114.52.201:8080
21:55:38:WU01:FS00:Downloading 2.14MiB
21:55:39:WU01:FS00:Download complete
21:55:39:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13851 run:0 clone:17673 gen:184 core:0xa7 unit:0x000000db287234c95e73013aa3ef248d
21:56:35:WU00:FS01:0x22:Completed 250000 out of 500000 steps (50%)
21:57:06:WU02:FS00:0xa7:Completed 250000 out of 250000 steps (100%)
21:57:11:WU02:FS00:0xa7:Saving result file ..\logfile_01.txt
21:57:11:WU02:FS00:0xa7:Saving result file dhdl.xvg
21:57:11:WU02:FS00:0xa7:Saving result file frame169.trr
21:57:11:WU02:FS00:0xa7:Saving result file md.log
21:57:11:WU02:FS00:0xa7:Saving result file pullf.xvg
21:57:11:WU02:FS00:0xa7:Saving result file pullx.xvg
21:57:11:WU02:FS00:0xa7:Saving result file science.log
21:57:11:WU02:FS00:0xa7:Saving result file traj_comp.xtc
21:57:11:WU02:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
21:57:12:WU02:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
21:57:12:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:14379 run:563 clone:3 gen:169 core:0xa7 unit:0x000000c3455e42075e93300173653c36
21:57:12:WU02:FS00:Uploading 6.48MiB to 69.94.66.7
21:57:12:WU01:FS00:Starting
21:57:12:WU02:FS00:Connecting to 69.94.66.7:8080
21:57:12:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\XXX\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -np 16
21:57:12:WU01:FS00:Started FahCore on PID 16436
21:57:12:WU01:FS00:Core PID:6480
21:57:12:WU01:FS00:FahCore 0xa7 started
21:57:13:WU01:FS00:0xa7:*********************** Log Started 2020-06-13T21:57:12Z ***********************
21:57:13:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
21:57:13:WU01:FS00:0xa7:       Type: 0xa7
21:57:13:WU01:FS00:0xa7:       Core: Gromacs
21:57:13:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 16436 -checkpoint 15 -np
21:57:13:WU01:FS00:0xa7:             16
21:57:13:WU01:FS00:0xa7:************************************ CBang *************************************
21:57:13:WU01:FS00:0xa7:       Date: Oct 26 2019
21:57:13:WU01:FS00:0xa7:       Time: 01:38:25
21:57:13:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
21:57:13:WU01:FS00:0xa7:     Branch: master
21:57:13:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
21:57:13:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
21:57:13:WU01:FS00:0xa7:   Platform: win32 10
21:57:13:WU01:FS00:0xa7:       Bits: 64
21:57:13:WU01:FS00:0xa7:       Mode: Release
21:57:13:WU01:FS00:0xa7:************************************ System ************************************
21:57:13:WU01:FS00:0xa7:        CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
21:57:13:WU01:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
21:57:13:WU01:FS00:0xa7:       CPUs: 18
21:57:13:WU01:FS00:0xa7:     Memory: 32.00GiB
21:57:13:WU01:FS00:0xa7:Free Memory: 25.65GiB
21:57:13:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
21:57:13:WU01:FS00:0xa7: OS Version: 6.2
21:57:13:WU01:FS00:0xa7:Has Battery: false
21:57:13:WU01:FS00:0xa7: On Battery: false
21:57:13:WU01:FS00:0xa7: UTC Offset: -7
21:57:13:WU01:FS00:0xa7:        PID: 6480
21:57:13:WU01:FS00:0xa7:        CWD: C:\Users\XXX\AppData\Roaming\FAHClient\work
21:57:13:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
21:57:13:WU01:FS00:0xa7:    Version: 0.0.18
21:57:13:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
21:57:13:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
21:57:13:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
21:57:13:WU01:FS00:0xa7:       Date: Oct 26 2019
21:57:13:WU01:FS00:0xa7:       Time: 01:52:30
21:57:13:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
21:57:13:WU01:FS00:0xa7:     Branch: master
21:57:13:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
21:57:13:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
21:57:13:WU01:FS00:0xa7:   Platform: win32 10
21:57:13:WU01:FS00:0xa7:       Bits: 64
21:57:13:WU01:FS00:0xa7:       Mode: Release
21:57:13:WU01:FS00:0xa7:************************************ Build *************************************
21:57:13:WU01:FS00:0xa7:       SIMD: avx_256
21:57:13:WU01:FS00:0xa7:********************************************************************************
21:57:13:WU01:FS00:0xa7:Project: 13851 (Run 0, Clone 17673, Gen 184)
21:57:13:WU01:FS00:0xa7:Unit: 0x000000db287234c95e73013aa3ef248d
21:57:13:WU01:FS00:0xa7:Reading tar file core.xml
21:57:13:WU01:FS00:0xa7:Reading tar file frame184.tpr
21:57:13:WU01:FS00:0xa7:Digital signatures verified
21:57:13:WU01:FS00:0xa7:Calling: mdrun -s frame184.tpr -o frame184.trr -x frame184.xtc -e frame184.edr -cpt 15 -nt 16
21:57:13:WU01:FS00:0xa7:Steps: first=92000000 total=500000
21:57:16:WU01:FS00:0xa7:Completed 1 out of 500000 steps (0%)
21:57:18:WU02:FS00:Upload 23.14%
21:57:24:WU02:FS00:Upload 50.14%
21:57:30:WU02:FS00:Upload 76.17%
21:57:36:WU02:FS00:Upload complete
21:57:36:WU02:FS00:Server responded WORK_ACK (400)
21:57:36:WU02:FS00:Final credit estimate, 4031.00 points
21:57:36:WU02:FS00:Cleaning up
21:59:10:WU01:FS00:0xa7:Completed 5000 out of 500000 steps (1%)
21:59:48:WU00:FS01:0x22:Completed 255000 out of 500000 steps (51%)
22:01:03:WU01:FS00:0xa7:Completed 10000 out of 500000 steps (2%)
22:02:55:WU01:FS00:0xa7:Completed 15000 out of 500000 steps (3%)
22:03:00:WU00:FS01:0x22:Completed 260000 out of 500000 steps (52%)
22:04:51:WU01:FS00:0xa7:Completed 20000 out of 500000 steps (4%)
22:06:45:WU01:FS00:0xa7:Completed 25000 out of 500000 steps (5%)
22:06:47:WU00:FS01:0x22:Completed 265000 out of 500000 steps (53%)
22:08:37:WU01:FS00:0xa7:Completed 30000 out of 500000 steps (6%)
22:10:00:WU00:FS01:0x22:Completed 270000 out of 500000 steps (54%)
22:10:30:WU01:FS00:0xa7:Completed 35000 out of 500000 steps (7%)
22:12:25:WU01:FS00:0xa7:Completed 40000 out of 500000 steps (8%)
22:13:14:WU00:FS01:0x22:Completed 275000 out of 500000 steps (55%)
22:14:18:WU01:FS00:0xa7:Completed 45000 out of 500000 steps (9%)
22:16:11:WU01:FS00:0xa7:Completed 50000 out of 500000 steps (10%)
22:16:26:WU00:FS01:0x22:Completed 280000 out of 500000 steps (56%)
22:18:05:WU01:FS00:0xa7:Completed 55000 out of 500000 steps (11%)
22:19:57:WU01:FS00:0xa7:Completed 60000 out of 500000 steps (12%)
22:20:07:WU00:FS01:0x22:Completed 285000 out of 500000 steps (57%)
22:21:51:WU01:FS00:0xa7:Completed 65000 out of 500000 steps (13%)
22:23:20:WU00:FS01:0x22:Completed 290000 out of 500000 steps (58%)
22:23:44:WU01:FS00:0xa7:Completed 70000 out of 500000 steps (14%)
22:25:36:WU01:FS00:0xa7:Completed 75000 out of 500000 steps (15%)
22:26:33:WU00:FS01:0x22:Completed 295000 out of 500000 steps (59%)
22:27:31:WU01:FS00:0xa7:Completed 80000 out of 500000 steps (16%)
22:29:25:WU01:FS00:0xa7:Completed 85000 out of 500000 steps (17%)
22:29:46:WU00:FS01:0x22:Completed 300000 out of 500000 steps (60%)
22:31:21:WU01:FS00:0xa7:Completed 90000 out of 500000 steps (18%)
22:33:13:WU01:FS00:0xa7:Completed 95000 out of 500000 steps (19%)
22:33:31:WU00:FS01:0x22:Completed 305000 out of 500000 steps (61%)
22:35:08:WU01:FS00:0xa7:Completed 100000 out of 500000 steps (20%)
22:36:44:WU00:FS01:0x22:Completed 310000 out of 500000 steps (62%)
22:37:01:WU01:FS00:0xa7:Completed 105000 out of 500000 steps (21%)
22:38:55:WU01:FS00:0xa7:Completed 110000 out of 500000 steps (22%)
22:39:57:WU00:FS01:0x22:Completed 315000 out of 500000 steps (63%)
22:40:48:WU01:FS00:0xa7:Completed 115000 out of 500000 steps (23%)
22:42:42:WU01:FS00:0xa7:Completed 120000 out of 500000 steps (24%)
22:43:10:WU00:FS01:0x22:Completed 320000 out of 500000 steps (64%)
22:44:37:WU01:FS00:0xa7:Completed 125000 out of 500000 steps (25%)
22:46:29:WU01:FS00:0xa7:Completed 130000 out of 500000 steps (26%)
22:46:54:WU00:FS01:0x22:Completed 325000 out of 500000 steps (65%)
22:48:22:WU01:FS00:0xa7:Completed 135000 out of 500000 steps (27%)
22:50:07:WU00:FS01:0x22:Completed 330000 out of 500000 steps (66%)
22:50:15:WU01:FS00:0xa7:Completed 140000 out of 500000 steps (28%)
22:52:08:WU01:FS00:0xa7:Completed 145000 out of 500000 steps (29%)
22:53:22:WU00:FS01:0x22:Completed 335000 out of 500000 steps (67%)
22:54:03:WU01:FS00:0xa7:Completed 150000 out of 500000 steps (30%)
22:55:56:WU01:FS00:0xa7:Completed 155000 out of 500000 steps (31%)
22:56:35:WU00:FS01:0x22:Completed 340000 out of 500000 steps (68%)
******************************* Date: 2020-06-13 *******************************
22:57:54:WU01:FS00:0xa7:Completed 160000 out of 500000 steps (32%)
22:59:47:WU01:FS00:0xa7:Completed 165000 out of 500000 steps (33%)
23:00:01:FS00:Paused
23:00:01:FS01:Paused
23:00:01:FS00:Shutting core down
23:00:01:FS01:Shutting core down
23:00:01:WU01:FS00:0xa7:WARNING:Console control signal 1 on PID 6480
23:00:01:WU01:FS00:0xa7:Exiting, please wait. . .
23:00:01:WU00:FS01:0x22:WARNING:Console control signal 1 on PID 19004
23:00:01:WU00:FS01:0x22:Exiting, please wait. . .
23:00:02:WU00:FS01:0x22:Folding@home Core Shutdown: INTERRUPTED
23:00:03:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
23:00:03:WU01:FS00:0xa7:Folding@home Core Shutdown: INTERRUPTED
23:00:04:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
23:00:38:Removing old file 'configs/config-20200605-230030.xml'
23:00:38:Saving configuration to config.xml
23:00:38:<config>
23:00:38:  <!-- Folding Slot Configuration -->
23:00:38:  <cause v='COVID_19'/>
23:00:38:  <max-packet-size v='big'/>
23:00:38:
23:00:38:  <!-- HTTP Server -->
23:00:38:  <allow v='127.0.0.1 10.12.9.0/24'/>
23:00:38:
23:00:38:  <!-- Network -->
23:00:38:  <proxy v=':8080'/>
23:00:38:
23:00:38:  <!-- Remote Command Server -->
23:00:38:  <command-allow-no-pass v='127.0.0.1 10.12.9.0/24'/>
23:00:38:
23:00:38:  <!-- Slot Control -->
23:00:38:  <power v='full'/>
23:00:38:
23:00:38:  <!-- User Information -->
23:00:38:  <passkey v='*****'/>
23:00:38:  <team v='230318'/>
23:00:38:  <user v='Loomis_Towcar'/>
23:00:38:
23:00:38:  <!-- Web Server -->
23:00:38:  <web-allow v='127.0.0.1 10.12.9.0/24'/>
23:00:38:
23:00:38:  <!-- Folding Slots -->
23:00:38:  <slot id='0' type='CPU'>
23:00:38:    <cpus v='16'/>
23:00:38:    <paused v='true'/>
23:00:38:  </slot>
23:00:38:  <slot id='1' type='GPU'>
23:00:38:    <paused v='true'/>
23:00:38:  </slot>
23:00:38:</config>
04:00:01:FS00:Unpaused
04:00:01:FS01:Unpaused
04:00:01:WU00:FS01:Starting
04:00:01:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\XXX\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
04:00:01:WU00:FS01:Started FahCore on PID 19652
04:00:01:WU00:FS01:Core PID:20964
04:00:01:WU00:FS01:FahCore 0x22 started
04:00:02:WU00:FS01:0x22:*********************** Log Started 2020-06-14T04:00:02Z ***********************
04:00:02:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
04:00:02:WU00:FS01:0x22:       Type: 0x22
04:00:02:WU01:FS00:Starting
04:00:02:WU00:FS01:0x22:       Core: Core22
04:00:02:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\XXX\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -np 16
04:00:02:WU00:FS01:0x22:    Website: https://foldingathome.org/
04:00:02:WU01:FS00:Started FahCore on PID 14544
04:00:02:WU00:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
04:00:02:WU00:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
04:00:02:WU00:FS01:0x22:             <rafal.wiewiora@choderalab.org>
04:00:02:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 19652 -checkpoint 15
04:00:02:WU00:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
04:00:02:WU00:FS01:0x22:     Config: <none>
04:00:02:WU00:FS01:0x22:************************************ Build *************************************
04:00:02:WU00:FS01:0x22:    Version: 0.0.5
04:00:02:WU00:FS01:0x22:       Date: Apr 22 2020
04:00:02:WU00:FS01:0x22:       Time: 04:42:59
04:00:02:WU01:FS00:Core PID:17932
04:00:02:WU00:FS01:0x22: Repository: Git
04:00:02:WU01:FS00:FahCore 0xa7 started
04:00:02:WU00:FS01:0x22:   Revision: 2d69202c898bd9bb3e093f51cd32bf411c2a0388
04:00:02:WU00:FS01:0x22:     Branch: HEAD
04:00:02:WU00:FS01:0x22:   Compiler: Visual C++ 2008
04:00:02:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
04:00:02:WU00:FS01:0x22:   Platform: win32 10
04:00:02:WU00:FS01:0x22:       Bits: 64
04:00:02:WU00:FS01:0x22:       Mode: Release
04:00:02:WU00:FS01:0x22:************************************ System ************************************
04:00:02:WU00:FS01:0x22:        CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
04:00:02:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
04:00:02:WU00:FS01:0x22:       CPUs: 18
04:00:02:WU00:FS01:0x22:     Memory: 32.00GiB
04:00:02:WU00:FS01:0x22:Free Memory: 28.03GiB
04:00:02:WU00:FS01:0x22:    Threads: WINDOWS_THREADS
04:00:02:WU00:FS01:0x22: OS Version: 6.2
04:00:02:WU00:FS01:0x22:Has Battery: false
04:00:02:WU00:FS01:0x22: On Battery: false
04:00:02:WU00:FS01:0x22: UTC Offset: -7
04:00:02:WU00:FS01:0x22:        PID: 20964
04:00:02:WU00:FS01:0x22:        CWD: C:\Users\XXX\AppData\Roaming\FAHClient\work
04:00:02:WU00:FS01:0x22:         OS: Windows 10 Enterprise
04:00:02:WU00:FS01:0x22:    OS Arch: AMD64
04:00:02:WU00:FS01:0x22:********************************************************************************
04:00:02:WU00:FS01:0x22:Project: 14561 (Run 0, Clone 1355, Gen 117)
04:00:02:WU00:FS01:0x22:Unit: 0x000000a980fccb025e9615bf10c2c7a8
04:00:02:WU00:FS01:0x22:Digital signatures verified
04:00:02:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
04:00:02:WU00:FS01:0x22:Version 0.0.5
04:00:03:WU01:FS00:0xa7:*********************** Log Started 2020-06-14T04:00:02Z ***********************
04:00:03:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
04:00:03:WU01:FS00:0xa7:       Type: 0xa7
04:00:03:WU01:FS00:0xa7:       Core: Gromacs
04:00:03:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 14544 -checkpoint 15 -np
04:00:03:WU01:FS00:0xa7:             16
04:00:03:WU01:FS00:0xa7:************************************ CBang *************************************
04:00:03:WU01:FS00:0xa7:       Date: Oct 26 2019
04:00:03:WU01:FS00:0xa7:       Time: 01:38:25
04:00:03:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
04:00:03:WU01:FS00:0xa7:     Branch: master
04:00:03:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
04:00:03:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
04:00:03:WU01:FS00:0xa7:   Platform: win32 10
04:00:03:WU01:FS00:0xa7:       Bits: 64
04:00:03:WU01:FS00:0xa7:       Mode: Release
04:00:03:WU01:FS00:0xa7:************************************ System ************************************
04:00:03:WU01:FS00:0xa7:        CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
04:00:03:WU01:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
04:00:03:WU01:FS00:0xa7:       CPUs: 18
04:00:03:WU01:FS00:0xa7:     Memory: 32.00GiB
04:00:03:WU01:FS00:0xa7:Free Memory: 28.01GiB
04:00:03:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
04:00:03:WU01:FS00:0xa7: OS Version: 6.2
04:00:03:WU01:FS00:0xa7:Has Battery: false
04:00:03:WU01:FS00:0xa7: On Battery: false
04:00:03:WU01:FS00:0xa7: UTC Offset: -7
04:00:03:WU01:FS00:0xa7:        PID: 17932
04:00:03:WU01:FS00:0xa7:        CWD: C:\Users\XXX\AppData\Roaming\FAHClient\work
04:00:03:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
04:00:03:WU01:FS00:0xa7:    Version: 0.0.18
04:00:03:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
04:00:03:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
04:00:03:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
04:00:03:WU01:FS00:0xa7:       Date: Oct 26 2019
04:00:03:WU01:FS00:0xa7:       Time: 01:52:30
04:00:03:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
04:00:03:WU01:FS00:0xa7:     Branch: master
04:00:03:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
04:00:03:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
04:00:03:WU01:FS00:0xa7:   Platform: win32 10
04:00:03:WU01:FS00:0xa7:       Bits: 64
04:00:03:WU01:FS00:0xa7:       Mode: Release
04:00:03:WU01:FS00:0xa7:************************************ Build *************************************
04:00:03:WU01:FS00:0xa7:       SIMD: avx_256
04:00:03:WU01:FS00:0xa7:********************************************************************************
04:00:03:WU01:FS00:0xa7:Project: 13851 (Run 0, Clone 17673, Gen 184)
04:00:03:WU01:FS00:0xa7:Unit: 0x000000db287234c95e73013aa3ef248d
04:00:03:WU01:FS00:0xa7:Digital signatures verified
04:00:03:WU01:FS00:0xa7:Calling: mdrun -s frame184.tpr -o frame184.trr -x frame184.xtc -e frame184.edr -cpi state.cpt -cpt 15 -nt 16
04:00:03:WU01:FS00:0xa7:Steps: first=92000000 total=500000
04:00:05:WU00:FS01:0x22:  Found a checkpoint file
<FS00 entried redacted to shorten post>
******************************* Date: 2020-06-14 *******************************
<FS00 entried redacted to shorten post>
******************************* Date: 2020-06-14 *******************************
<FS00 entried redacted to shorten post>
******************************* Date: 2020-06-14 *******************************
<FS00 entried redacted to shorten post>
19:27:56:FS01:Shutting core down
19:27:56:WU01:FS00:0xa7:WARNING:Console control signal 1 on PID 2776
19:27:56:WU00:FS01:0x22:WARNING:Console control signal 1 on PID 20964
19:27:56:WU01:FS00:0xa7:Exiting, please wait. . .
19:27:56:WU00:FS01:0x22:Exiting, please wait. . .
19:28:08:WU01:FS00:0xa7:Folding@home Core Shutdown: INTERRUPTED
19:28:22:WU00:FS01:0x22:Completed 340000 out of 500000 steps (68%)
19:28:23:WU00:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
19:28:23:WU00:FS01:0x22:Folding@home Core Shutdown: INTERRUPTED
19:28:24:Clean exit
...here's the current log from after I killed the client and restarted it. This time, it finds the checkpoint, reports the 68% progress, then continues to actually make progress:

Code: Select all

*********************** Log Started 2020-06-14T19:28:31Z ***********************
19:28:34:WU00:FS01:Starting
19:28:34:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\XXX\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 20272 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
19:28:34:WU00:FS01:Started FahCore on PID 6736
19:28:34:WU00:FS01:Core PID:22252
19:28:34:WU00:FS01:FahCore 0x22 started
19:28:35:WU00:FS01:0x22:*********************** Log Started 2020-06-14T19:28:34Z ***********************
19:28:35:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
19:28:35:WU00:FS01:0x22:       Type: 0x22
19:28:35:WU00:FS01:0x22:       Core: Core22
19:28:35:WU00:FS01:0x22:    Website: https://foldingathome.org/
19:28:35:WU00:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
19:28:35:WU00:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
19:28:35:WU00:FS01:0x22:             <rafal.wiewiora@choderalab.org>
19:28:35:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 6736 -checkpoint 15
19:28:35:WU00:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
19:28:35:WU00:FS01:0x22:     Config: <none>
19:28:35:WU00:FS01:0x22:************************************ Build *************************************
19:28:35:WU00:FS01:0x22:    Version: 0.0.5
19:28:35:WU00:FS01:0x22:       Date: Apr 22 2020
19:28:35:WU00:FS01:0x22:       Time: 04:42:59
19:28:35:WU00:FS01:0x22: Repository: Git
19:28:35:WU00:FS01:0x22:   Revision: 2d69202c898bd9bb3e093f51cd32bf411c2a0388
19:28:35:WU00:FS01:0x22:     Branch: HEAD
19:28:35:WU00:FS01:0x22:   Compiler: Visual C++ 2008
19:28:35:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
19:28:35:WU00:FS01:0x22:   Platform: win32 10
19:28:35:WU00:FS01:0x22:       Bits: 64
19:28:35:WU00:FS01:0x22:       Mode: Release
19:28:35:WU00:FS01:0x22:************************************ System ************************************
19:28:35:WU00:FS01:0x22:        CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
19:28:35:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
19:28:35:WU00:FS01:0x22:       CPUs: 18
19:28:35:WU00:FS01:0x22:     Memory: 32.00GiB
19:28:35:WU00:FS01:0x22:Free Memory: 27.75GiB
19:28:35:WU00:FS01:0x22:    Threads: WINDOWS_THREADS
19:28:35:WU00:FS01:0x22: OS Version: 6.2
19:28:35:WU00:FS01:0x22:Has Battery: false
19:28:35:WU00:FS01:0x22: On Battery: false
19:28:35:WU00:FS01:0x22: UTC Offset: -7
19:28:35:WU00:FS01:0x22:        PID: 22252
19:28:35:WU00:FS01:0x22:        CWD: C:\Users\XXX\AppData\Roaming\FAHClient\work
19:28:35:WU00:FS01:0x22:         OS: Windows 10 Enterprise
19:28:35:WU00:FS01:0x22:    OS Arch: AMD64
19:28:35:WU00:FS01:0x22:********************************************************************************
19:28:35:WU00:FS01:0x22:Project: 14561 (Run 0, Clone 1355, Gen 117)
19:28:35:WU00:FS01:0x22:Unit: 0x000000a980fccb025e9615bf10c2c7a8
19:28:35:WU00:FS01:0x22:Digital signatures verified
19:28:35:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
19:28:35:WU00:FS01:0x22:Version 0.0.5
19:28:38:WU00:FS01:0x22:  Found a checkpoint file
19:30:25:WU00:FS01:0x22:Completed 340000 out of 500000 steps (68%)
19:30:25:WU00:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
19:33:48:WU00:FS01:0x22:Completed 345000 out of 500000 steps (69%)
19:37:01:WU00:FS01:0x22:Completed 350000 out of 500000 steps (70%)
19:40:13:WU00:FS01:0x22:Completed 355000 out of 500000 steps (71%)
19:43:26:WU00:FS01:0x22:Completed 360000 out of 500000 steps (72%)
19:47:08:WU00:FS01:0x22:Completed 365000 out of 500000 steps (73%)
19:50:21:WU00:FS01:0x22:Completed 370000 out of 500000 steps (74%)
19:53:34:WU00:FS01:0x22:Completed 375000 out of 500000 steps (75%)
19:56:47:WU00:FS01:0x22:Completed 380000 out of 500000 steps (76%)
20:00:32:WU00:FS01:0x22:Completed 385000 out of 500000 steps (77%)
20:03:45:WU00:FS01:0x22:Completed 390000 out of 500000 steps (78%)
20:06:57:WU00:FS01:0x22:Completed 395000 out of 500000 steps (79%)
20:10:09:WU00:FS01:0x22:Completed 400000 out of 500000 steps (80%)
20:13:56:WU00:FS01:0x22:Completed 405000 out of 500000 steps (81%)
20:17:11:WU00:FS01:0x22:Completed 410000 out of 500000 steps (82%)
20:20:24:WU00:FS01:0x22:Completed 415000 out of 500000 steps (83%)
20:23:38:WU00:FS01:0x22:Completed 420000 out of 500000 steps (84%)
20:27:21:WU00:FS01:0x22:Completed 425000 out of 500000 steps (85%)
20:30:34:WU00:FS01:0x22:Completed 430000 out of 500000 steps (86%)
20:33:47:WU00:FS01:0x22:Completed 435000 out of 500000 steps (87%)
20:37:00:WU00:FS01:0x22:Completed 440000 out of 500000 steps (88%)
20:40:44:WU00:FS01:0x22:Completed 445000 out of 500000 steps (89%)
20:43:58:WU00:FS01:0x22:Completed 450000 out of 500000 steps (90%)
20:47:12:WU00:FS01:0x22:Completed 455000 out of 500000 steps (91%)
20:50:26:WU00:FS01:0x22:Completed 460000 out of 500000 steps (92%)
20:54:12:WU00:FS01:0x22:Completed 465000 out of 500000 steps (93%)
20:57:25:WU00:FS01:0x22:Completed 470000 out of 500000 steps (94%)
21:00:38:WU00:FS01:0x22:Completed 475000 out of 500000 steps (95%)
21:03:52:WU00:FS01:0x22:Completed 480000 out of 500000 steps (96%)
21:07:34:WU00:FS01:0x22:Completed 485000 out of 500000 steps (97%)
21:10:47:WU00:FS01:0x22:Completed 490000 out of 500000 steps (98%)
21:14:01:WU00:FS01:0x22:Completed 495000 out of 500000 steps (99%)
21:14:01:WU02:FS01:Connecting to assign1.foldingathome.org:80
21:14:01:WARNING:WU02:FS01:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
21:14:01:WU02:FS01:Connecting to assign2.foldingathome.org:80
21:14:02:WARNING:WU02:FS01:Failed to get assignment from 'assign2.foldingathome.org:80': No WUs available for this configuration
21:14:02:WU02:FS01:Connecting to assign3.foldingathome.org:80
21:14:02:WARNING:WU02:FS01:Failed to get assignment from 'assign3.foldingathome.org:80': No WUs available for this configuration
21:14:02:WU02:FS01:Connecting to assign4.foldingathome.org:80
21:14:03:WARNING:WU02:FS01:Failed to get assignment from 'assign4.foldingathome.org:80': No WUs available for this configuration
21:14:03:ERROR:WU02:FS01:Exception: Could not get an assignment
21:14:03:WU02:FS01:Connecting to assign1.foldingathome.org:80
21:14:03:WARNING:WU02:FS01:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
21:14:03:WU02:FS01:Connecting to assign2.foldingathome.org:80
21:14:04:WARNING:WU02:FS01:Failed to get assignment from 'assign2.foldingathome.org:80': No WUs available for this configuration
21:14:04:WU02:FS01:Connecting to assign3.foldingathome.org:80
21:14:04:WARNING:WU02:FS01:Failed to get assignment from 'assign3.foldingathome.org:80': No WUs available for this configuration
21:14:04:WU02:FS01:Connecting to assign4.foldingathome.org:80
21:14:04:WARNING:WU02:FS01:Failed to get assignment from 'assign4.foldingathome.org:80': No WUs available for this configuration
21:14:04:ERROR:WU02:FS01:Exception: Could not get an assignment
_r2w_ben
Posts: 285
Joined: Wed Apr 23, 2008 3:11 pm

Re: RX580 stalls at 0.00% or 99.99%

Post by _r2w_ben »

LoomisTowcar wrote:More logs. The first is an excerpt from %APPDATA%, from a stall at an indicated 99.99% again, where it seems like the GPU was paused for my peak utility window, then unpaused, found a checkpoint, but didn't make any progress (04:00:05:WU00:FS01:0x22: Found a checkpoint file). It appears to have actually stalled at 68%, indicated during the process of shutting down:
FAHControl keeps increasing the progress based on Estimated TPF. The actual progress is what's written to the log.
LoomisTowcar
Posts: 4
Joined: Fri Jun 12, 2020 10:59 pm

RX580 stalls; must restart client to get it going again.

Post by LoomisTowcar »

Right. Ok, so the progress reported by FAHControl isn't as relevant as the progress actually logged. Revised the subject line.
Post Reply