RX580 stalls at 0.00% or 99.99%

It seems that a lot of GPU problems revolve around specific versions of drivers. Though AMD has their own support structure, you can often learn from information reported by others who fold.
Post Reply
LoomisTowcar
Posts: 4
Joined: Fri Jun 12, 2020 10:59 pm

RX580 stalls at 0.00% or 99.99%

Post by LoomisTowcar »

Driver version: 26.20.15029.27017, installed with win10-radeon-software-adrenalin-2020-edition-20.4.2-may25.exe
Pause/unpause doesn't help. I'll leave it stalled for a day, then quit and relaunch to get it going again. I only have this issue with AMD GPUs, several nVidia GPUs do not have this problem.
Below is the log from a stall @ 99.99%. Note: I pause folding between utility peak hours of 23:00Z and 4:00Z. Any insights would be appreciated!

Code: Select all

*********************** Log Started 2020-06-12T22:53:55Z ***********************
22:53:58:WU00:FS01:Starting
22:53:58:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Mas\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
22:53:58:WU00:FS01:Started FahCore on PID 18044
22:53:58:WU00:FS01:Core PID:15556
22:53:58:WU00:FS01:FahCore 0x22 started
22:53:59:WU00:FS01:0x22:*********************** Log Started 2020-06-12T22:53:58Z ***********************
22:53:59:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
22:53:59:WU00:FS01:0x22:       Type: 0x22
22:53:59:WU00:FS01:0x22:       Core: Core22
22:53:59:WU00:FS01:0x22:    Website: https://foldingathome.org/
22:53:59:WU00:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
22:53:59:WU00:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
22:53:59:WU00:FS01:0x22:             <rafal.wiewiora@choderalab.org>
22:53:59:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 18044 -checkpoint 15
22:53:59:WU00:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
22:53:59:WU00:FS01:0x22:     Config: <none>
22:53:59:WU00:FS01:0x22:************************************ Build *************************************
22:53:59:WU00:FS01:0x22:    Version: 0.0.5
22:53:59:WU00:FS01:0x22:       Date: Apr 22 2020
22:53:59:WU00:FS01:0x22:       Time: 04:42:59
22:53:59:WU00:FS01:0x22: Repository: Git
22:53:59:WU00:FS01:0x22:   Revision: 2d69202c898bd9bb3e093f51cd32bf411c2a0388
22:53:59:WU00:FS01:0x22:     Branch: HEAD
22:53:59:WU00:FS01:0x22:   Compiler: Visual C++ 2008
22:53:59:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:53:59:WU00:FS01:0x22:   Platform: win32 10
22:53:59:WU00:FS01:0x22:       Bits: 64
22:53:59:WU00:FS01:0x22:       Mode: Release
22:53:59:WU00:FS01:0x22:************************************ System ************************************
22:53:59:WU00:FS01:0x22:        CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
22:53:59:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
22:53:59:WU00:FS01:0x22:       CPUs: 18
22:53:59:WU00:FS01:0x22:     Memory: 32.00GiB
22:53:59:WU00:FS01:0x22:Free Memory: 28.13GiB
22:53:59:WU00:FS01:0x22:    Threads: WINDOWS_THREADS
22:53:59:WU00:FS01:0x22: OS Version: 6.2
22:53:59:WU00:FS01:0x22:Has Battery: false
22:53:59:WU00:FS01:0x22: On Battery: false
22:53:59:WU00:FS01:0x22: UTC Offset: -7
22:53:59:WU00:FS01:0x22:        PID: 15556
22:53:59:WU00:FS01:0x22:        CWD: C:\Users\Mas\AppData\Roaming\FAHClient\work
22:53:59:WU00:FS01:0x22:         OS: Windows 10 Enterprise
22:53:59:WU00:FS01:0x22:    OS Arch: AMD64
22:53:59:WU00:FS01:0x22:********************************************************************************
22:53:59:WU00:FS01:0x22:Project: 14561 (Run 0, Clone 1355, Gen 117)
22:53:59:WU00:FS01:0x22:Unit: 0x000000a980fccb025e9615bf10c2c7a8
22:53:59:WU00:FS01:0x22:Reading tar file core.xml
22:53:59:WU00:FS01:0x22:Reading tar file integrator.xml
22:53:59:WU00:FS01:0x22:Reading tar file state.xml
22:54:04:WU00:FS01:0x22:Reading tar file system.xml
22:54:09:WU00:FS01:0x22:Digital signatures verified
22:54:09:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
22:54:09:WU00:FS01:0x22:Version 0.0.5
22:56:15:WU00:FS01:0x22:Completed 0 out of 500000 steps (0%)
22:56:15:WU00:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
22:59:40:WU00:FS01:0x22:Completed 5000 out of 500000 steps (1%)
23:00:01:FS01:Paused
23:00:01:FS01:Shutting core down
23:00:01:WU00:FS01:0x22:WARNING:Console control signal 1 on PID 15556
23:00:01:WU00:FS01:0x22:Exiting, please wait. . .
23:00:02:WU00:FS01:0x22:Folding@home Core Shutdown: INTERRUPTED
23:00:03:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
04:00:01:FS01:Unpaused
04:00:01:WU00:FS01:Starting
04:00:01:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Mas\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
04:00:01:WU00:FS01:Started FahCore on PID 20952
04:00:02:WU00:FS01:Core PID:19004
04:00:02:WU00:FS01:FahCore 0x22 started
04:00:02:WU00:FS01:0x22:*********************** Log Started 2020-06-13T04:00:02Z ***********************
04:00:02:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
04:00:02:WU00:FS01:0x22:       Type: 0x22
04:00:02:WU00:FS01:0x22:       Core: Core22
04:00:02:WU00:FS01:0x22:    Website: https://foldingathome.org/
04:00:02:WU00:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
04:00:02:WU00:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
04:00:02:WU00:FS01:0x22:             <rafal.wiewiora@choderalab.org>
04:00:02:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 20952 -checkpoint 15
04:00:02:WU00:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
04:00:02:WU00:FS01:0x22:     Config: <none>
04:00:02:WU00:FS01:0x22:************************************ Build *************************************
04:00:02:WU00:FS01:0x22:    Version: 0.0.5
04:00:02:WU00:FS01:0x22:       Date: Apr 22 2020
04:00:02:WU00:FS01:0x22:       Time: 04:42:59
04:00:02:WU00:FS01:0x22: Repository: Git
04:00:02:WU00:FS01:0x22:   Revision: 2d69202c898bd9bb3e093f51cd32bf411c2a0388
04:00:02:WU00:FS01:0x22:     Branch: HEAD
04:00:02:WU00:FS01:0x22:   Compiler: Visual C++ 2008
04:00:02:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
04:00:02:WU00:FS01:0x22:   Platform: win32 10
04:00:02:WU00:FS01:0x22:       Bits: 64
04:00:02:WU00:FS01:0x22:       Mode: Release
04:00:02:WU00:FS01:0x22:************************************ System ************************************
04:00:02:WU00:FS01:0x22:        CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
04:00:02:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
04:00:02:WU00:FS01:0x22:       CPUs: 18
04:00:02:WU00:FS01:0x22:     Memory: 32.00GiB
04:00:02:WU00:FS01:0x22:Free Memory: 28.19GiB
04:00:02:WU00:FS01:0x22:    Threads: WINDOWS_THREADS
04:00:02:WU00:FS01:0x22: OS Version: 6.2
04:00:02:WU00:FS01:0x22:Has Battery: false
04:00:02:WU00:FS01:0x22: On Battery: false
04:00:02:WU00:FS01:0x22: UTC Offset: -7
04:00:02:WU00:FS01:0x22:        PID: 19004
04:00:02:WU00:FS01:0x22:        CWD: C:\Users\Mas\AppData\Roaming\FAHClient\work
04:00:02:WU00:FS01:0x22:         OS: Windows 10 Enterprise
04:00:02:WU00:FS01:0x22:    OS Arch: AMD64
04:00:02:WU00:FS01:0x22:********************************************************************************
04:00:02:WU00:FS01:0x22:Project: 14561 (Run 0, Clone 1355, Gen 117)
04:00:02:WU00:FS01:0x22:Unit: 0x000000a980fccb025e9615bf10c2c7a8
04:00:02:WU00:FS01:0x22:Digital signatures verified
04:00:02:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
04:00:02:WU00:FS01:0x22:Version 0.0.5
******************************* Date: 2020-06-13 *******************************
******************************* Date: 2020-06-13 *******************************
******************************* Date: 2020-06-13 *******************************
_r2w_ben
Posts: 285
Joined: Wed Apr 23, 2008 3:11 pm

Re: RX580 stalls at 0.00% or 99.99%

Post by _r2w_ben »

I have this happen a couple times a month as well on an RX 460 using Windows 8.1. For me the symptoms are 100% load reported in GPU-Z but memory is running at idle clock speed. Attempting to end the FahCore_22.exe in Task Manager results in "Access Denied". I have to reboot, which takes a few minutes for Windows to finally kill the process. I haven't noticed a pattern between projects and this happening. The same work unit that stalled will normally startup fine after a reboot and finish. All this to say I don't have a fix but can confirm similar behaviour.
LoomisTowcar
Posts: 4
Joined: Fri Jun 12, 2020 10:59 pm

Re: RX580 stalls at 0.00% or 99.99%

Post by LoomisTowcar »

_r2w_ben wrote:I have this happen a couple times a month as well on an RX 460 using Windows 8.1. For me the symptoms are 100% load reported in GPU-Z but memory is running at idle clock speed. Attempting to end the FahCore_22.exe in Task Manager results in "Access Denied". I have to reboot, which takes a few minutes for Windows to finally kill the process. I haven't noticed a pattern between projects and this happening. The same work unit that stalled will normally startup fine after a reboot and finish. All this to say I don't have a fix but can confirm similar behaviour.
Fortunately, I've only had to reboot once where I couldn't quit the client because the system tray icon had disappeared. That was with the pre-7.6.13 client (.9?).
LoomisTowcar
Posts: 4
Joined: Fri Jun 12, 2020 10:59 pm

Re: RX580 stalls at 0.00% or 99.99%

Post by LoomisTowcar »

More logs. The first is an excerpt from %APPDATA%, from a stall at an indicated 99.99% again, where it seems like the GPU was paused for my peak utility window, then unpaused, found a checkpoint, but didn't make any progress (04:00:05:WU00:FS01:0x22: Found a checkpoint file). It appears to have actually stalled at 68%, indicated during the process of shutting down:

Code: Select all

*********************** Log Started 2020-06-12T22:53:55Z ***********************
22:53:55:Trying to access database...
22:53:55:Successfully acquired database lock
22:53:55:Downloading GPUs.txt from assign1.foldingathome.org:80
22:53:55:Connecting to assign1.foldingathome.org:80
22:53:56:Read GPUs.txt
22:53:56:Enabled folding slot 00: READY cpu:16
22:53:58:Enabled folding slot 01: READY gpu:0:Ellesmere XT [Radeon RX 470/480/570/580/590]
22:53:58:****************************** FAHClient ******************************
22:53:58:        Version: 7.6.13
22:53:58:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
22:53:58:      Copyright: 2020 foldingathome.org
22:53:58:       Homepage: https://foldingathome.org/
22:53:58:           Date: Apr 27 2020
22:53:58:           Time: 21:21:01
22:53:58:       Revision: 5a652817f46116b6e135503af97f18e094414e3b
22:53:58:         Branch: master
22:53:58:       Compiler: Visual C++ 2008
22:53:58:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:53:58:       Platform: win32 10
22:53:58:           Bits: 32
22:53:58:           Mode: Release
22:53:58:           Args: --open-web-control
22:53:58:         Config: C:\Users\XXX\AppData\Roaming\FAHClient\config.xml
22:53:58:******************************** CBang ********************************
22:53:58:           Date: Apr 24 2020
22:53:58:           Time: 17:07:55
22:53:58:       Revision: ea081a3b3b0f4a37c4d0440b4f1bc184197c7797
22:53:58:         Branch: master
22:53:58:       Compiler: Visual C++ 2008
22:53:58:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:53:58:       Platform: win32 10
22:53:58:           Bits: 32
22:53:58:           Mode: Release
22:53:58:******************************* System ********************************
22:53:58:            CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
22:53:58:         CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
22:53:58:           CPUs: 18
22:53:58:         Memory: 32.00GiB
22:53:58:    Free Memory: 28.15GiB
22:53:58:        Threads: WINDOWS_THREADS
22:53:58:     OS Version: 6.2
22:53:58:    Has Battery: false
22:53:58:     On Battery: false
22:53:58:     UTC Offset: -7
22:53:58:            PID: 17292
22:53:58:            CWD: C:\Users\XXX\AppData\Roaming\FAHClient
22:53:58:  Win32 Service: false
22:53:58:             OS: Windows 10 Enterprise
22:53:58:        OS Arch: AMD64
22:53:58:           GPUs: 1
22:53:58:          GPU 0: Bus:3 Slot:0 Func:0 AMD:5 Ellesmere XT [Radeon RX
22:53:58:                 470/480/570/580/590]
22:53:58:           CUDA: Not detected: Failed to open dynamic library 'nvcuda.dll': The
22:53:58:                 specified module could not be found.
22:53:58:
22:53:58:OpenCL Device 0: Platform:0 Device:0 Bus:3 Slot:0 Compute:1.2 Driver:3004.8
22:53:58:******************************* libFAH ********************************
22:53:58:           Date: Apr 15 2020
22:53:58:           Time: 14:53:14
22:53:58:       Revision: 216968bc7025029c841ed6e36e81a03a316890d3
22:53:58:         Branch: master
22:53:58:       Compiler: Visual C++ 2008
22:53:58:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:53:58:       Platform: win32 10
22:53:58:           Bits: 32
22:53:58:           Mode: Release
22:53:58:***********************************************************************
22:53:58:<config>
22:53:58:  <!-- Folding Slot Configuration -->
22:53:58:  <cause v='COVID_19'/>
22:53:58:  <max-packet-size v='big'/>
22:53:58:
22:53:58:  <!-- HTTP Server -->
22:53:58:  <allow v='127.0.0.1 10.12.9.0/24'/>
22:53:58:
22:53:58:  <!-- Network -->
22:53:58:  <proxy v=':8080'/>
22:53:58:
22:53:58:  <!-- Remote Command Server -->
22:53:58:  <command-allow-no-pass v='127.0.0.1 10.12.9.0/24'/>
22:53:58:
22:53:58:  <!-- Slot Control -->
22:53:58:  <power v='full'/>
22:53:58:
22:53:58:  <!-- User Information -->
22:53:58:  <passkey v='*****'/>
22:53:58:  <team v='230318'/>
22:53:58:  <user v='Loomis_Towcar'/>
22:53:58:
22:53:58:  <!-- Web Server -->
22:53:58:  <web-allow v='127.0.0.1 10.12.9.0/24'/>
22:53:58:
22:53:58:  <!-- Folding Slots -->
22:53:58:  <slot id='0' type='CPU'>
22:53:58:    <cpus v='16'/>
22:53:58:  </slot>
22:53:58:  <slot id='1' type='GPU'/>
22:53:58:</config>
22:53:58:WU00:FS01:Starting
22:53:58:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\XXX\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
22:53:58:WU00:FS01:Started FahCore on PID 18044
22:53:58:WU00:FS01:Core PID:15556
22:53:58:WU00:FS01:FahCore 0x22 started
22:53:59:WU00:FS01:0x22:*********************** Log Started 2020-06-12T22:53:58Z ***********************
22:53:59:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
22:53:59:WU00:FS01:0x22:       Type: 0x22
22:53:59:WU00:FS01:0x22:       Core: Core22
22:53:59:WU00:FS01:0x22:    Website: https://foldingathome.org/
22:53:59:WU00:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
22:53:59:WU00:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
22:53:59:WU00:FS01:0x22:             <rafal.wiewiora@choderalab.org>
22:53:59:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 18044 -checkpoint 15
22:53:59:WU00:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
22:53:59:WU00:FS01:0x22:     Config: <none>
22:53:59:WU00:FS01:0x22:************************************ Build *************************************
22:53:59:WU00:FS01:0x22:    Version: 0.0.5
22:53:59:WU00:FS01:0x22:       Date: Apr 22 2020
22:53:59:WU00:FS01:0x22:       Time: 04:42:59
22:53:59:WU00:FS01:0x22: Repository: Git
22:53:59:WU00:FS01:0x22:   Revision: 2d69202c898bd9bb3e093f51cd32bf411c2a0388
22:53:59:WU00:FS01:0x22:     Branch: HEAD
22:53:59:WU00:FS01:0x22:   Compiler: Visual C++ 2008
22:53:59:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:53:59:WU00:FS01:0x22:   Platform: win32 10
22:53:59:WU00:FS01:0x22:       Bits: 64
22:53:59:WU00:FS01:0x22:       Mode: Release
22:53:59:WU00:FS01:0x22:************************************ System ************************************
22:53:59:WU00:FS01:0x22:        CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
22:53:59:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
22:53:59:WU00:FS01:0x22:       CPUs: 18
22:53:59:WU00:FS01:0x22:     Memory: 32.00GiB
22:53:59:WU00:FS01:0x22:Free Memory: 28.13GiB
22:53:59:WU00:FS01:0x22:    Threads: WINDOWS_THREADS
22:53:59:WU00:FS01:0x22: OS Version: 6.2
22:53:59:WU00:FS01:0x22:Has Battery: false
22:53:59:WU00:FS01:0x22: On Battery: false
22:53:59:WU00:FS01:0x22: UTC Offset: -7
22:53:59:WU00:FS01:0x22:        PID: 15556
22:53:59:WU00:FS01:0x22:        CWD: C:\Users\XXX\AppData\Roaming\FAHClient\work
22:53:59:WU00:FS01:0x22:         OS: Windows 10 Enterprise
22:53:59:WU00:FS01:0x22:    OS Arch: AMD64
22:53:59:WU00:FS01:0x22:********************************************************************************
22:53:59:WU00:FS01:0x22:Project: 14561 (Run 0, Clone 1355, Gen 117)
22:53:59:WU00:FS01:0x22:Unit: 0x000000a980fccb025e9615bf10c2c7a8
22:53:59:WU00:FS01:0x22:Reading tar file core.xml
22:53:59:WU00:FS01:0x22:Reading tar file integrator.xml
22:53:59:WU00:FS01:0x22:Reading tar file state.xml
22:54:00:WU01:FS00:Starting
22:54:00:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\XXX\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -np 16
22:54:00:WU01:FS00:Started FahCore on PID 20204
22:54:00:WU01:FS00:Core PID:20252
22:54:00:WU01:FS00:FahCore 0xa7 started
22:54:00:WU01:FS00:0xa7:*********************** Log Started 2020-06-12T22:54:00Z ***********************
22:54:00:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
22:54:00:WU01:FS00:0xa7:       Type: 0xa7
22:54:00:WU01:FS00:0xa7:       Core: Gromacs
22:54:00:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 20204 -checkpoint 15 -np
22:54:00:WU01:FS00:0xa7:             16
22:54:00:WU01:FS00:0xa7:************************************ CBang *************************************
22:54:00:WU01:FS00:0xa7:       Date: Oct 26 2019
22:54:00:WU01:FS00:0xa7:       Time: 01:38:25
22:54:00:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
22:54:00:WU01:FS00:0xa7:     Branch: master
22:54:00:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
22:54:00:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:54:00:WU01:FS00:0xa7:   Platform: win32 10
22:54:00:WU01:FS00:0xa7:       Bits: 64
22:54:00:WU01:FS00:0xa7:       Mode: Release
22:54:00:WU01:FS00:0xa7:************************************ System ************************************
22:54:00:WU01:FS00:0xa7:        CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
22:54:00:WU01:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
22:54:00:WU01:FS00:0xa7:       CPUs: 18
22:54:00:WU01:FS00:0xa7:     Memory: 32.00GiB
22:54:00:WU01:FS00:0xa7:Free Memory: 27.83GiB
22:54:00:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
22:54:00:WU01:FS00:0xa7: OS Version: 6.2
22:54:00:WU01:FS00:0xa7:Has Battery: false
22:54:00:WU01:FS00:0xa7: On Battery: false
22:54:01:WU01:FS00:0xa7: UTC Offset: -7
22:54:01:WU01:FS00:0xa7:        PID: 20252
22:54:01:WU01:FS00:0xa7:        CWD: C:\Users\XXX\AppData\Roaming\FAHClient\work
22:54:01:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
22:54:01:WU01:FS00:0xa7:    Version: 0.0.18
22:54:01:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
22:54:01:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
22:54:01:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
22:54:01:WU01:FS00:0xa7:       Date: Oct 26 2019
22:54:01:WU01:FS00:0xa7:       Time: 01:52:30
22:54:01:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
22:54:01:WU01:FS00:0xa7:     Branch: master
22:54:01:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
22:54:01:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:54:01:WU01:FS00:0xa7:   Platform: win32 10
22:54:01:WU01:FS00:0xa7:       Bits: 64
22:54:01:WU01:FS00:0xa7:       Mode: Release
22:54:01:WU01:FS00:0xa7:************************************ Build *************************************
22:54:01:WU01:FS00:0xa7:       SIMD: avx_256
22:54:01:WU01:FS00:0xa7:********************************************************************************
22:54:01:WU01:FS00:0xa7:Project: 16805 (Run 7, Clone 370, Gen 27)
22:54:01:WU01:FS00:0xa7:Unit: 0x0000002482ed0b915eb42210cef44fc3
22:54:01:WU01:FS00:0xa7:Digital signatures verified
22:54:01:WU01:FS00:0xa7:Calling: mdrun -s frame27.tpr -o frame27.trr -cpi state.cpt -cpt 15 -nt 16
22:54:01:WU01:FS00:0xa7:Steps: first=13500000 total=500000
22:54:04:WU00:FS01:0x22:Reading tar file system.xml
22:54:05:WU01:FS00:0xa7:Completed 423072 out of 500000 steps (84%)
22:54:07:8:127.0.0.1:New Web session
22:54:09:WU00:FS01:0x22:Digital signatures verified
22:54:09:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
22:54:09:WU00:FS01:0x22:Version 0.0.5
22:56:15:WU00:FS01:0x22:Completed 0 out of 500000 steps (0%)
22:56:15:WU00:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
22:56:38:WU01:FS00:0xa7:Completed 425000 out of 500000 steps (85%)
22:59:40:WU00:FS01:0x22:Completed 5000 out of 500000 steps (1%)
23:00:01:FS00:Paused
23:00:01:FS01:Paused
23:00:01:FS00:Shutting core down
23:00:01:FS01:Shutting core down
23:00:01:WU01:FS00:0xa7:WARNING:Console control signal 1 on PID 20252
23:00:01:WU00:FS01:0x22:WARNING:Console control signal 1 on PID 15556
23:00:01:WU01:FS00:0xa7:Exiting, please wait. . .
23:00:01:WU00:FS01:0x22:Exiting, please wait. . .
23:00:02:WU00:FS01:0x22:Folding@home Core Shutdown: INTERRUPTED
23:00:03:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
23:00:04:WU01:FS00:0xa7:Folding@home Core Shutdown: INTERRUPTED
23:00:05:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
23:01:02:Removing old file 'configs/config-20200604-230022.xml'
23:01:02:Saving configuration to config.xml
23:01:02:<config>
23:01:02:  <!-- Folding Slot Configuration -->
23:01:02:  <cause v='COVID_19'/>
23:01:02:  <max-packet-size v='big'/>
23:01:02:
23:01:02:  <!-- HTTP Server -->
23:01:02:  <allow v='127.0.0.1 10.12.9.0/24'/>
23:01:02:
23:01:02:  <!-- Network -->
23:01:02:  <proxy v=':8080'/>
23:01:02:
23:01:02:  <!-- Remote Command Server -->
23:01:02:  <command-allow-no-pass v='127.0.0.1 10.12.9.0/24'/>
23:01:02:
23:01:02:  <!-- Slot Control -->
23:01:02:  <power v='full'/>
23:01:02:
23:01:02:  <!-- User Information -->
23:01:02:  <passkey v='*****'/>
23:01:02:  <team v='230318'/>
23:01:02:  <user v='Loomis_Towcar'/>
23:01:02:
23:01:02:  <!-- Web Server -->
23:01:02:  <web-allow v='127.0.0.1 10.12.9.0/24'/>
23:01:02:
23:01:02:  <!-- Folding Slots -->
23:01:02:  <slot id='0' type='CPU'>
23:01:02:    <cpus v='16'/>
23:01:02:    <paused v='true'/>
23:01:02:  </slot>
23:01:02:  <slot id='1' type='GPU'>
23:01:02:    <paused v='true'/>
23:01:02:  </slot>
23:01:02:</config>
04:00:01:FS00:Unpaused
04:00:01:FS01:Unpaused
04:00:01:WU00:FS01:Starting
04:00:01:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\XXX\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
04:00:01:WU00:FS01:Started FahCore on PID 20952
04:00:02:WU00:FS01:Core PID:19004
04:00:02:WU00:FS01:FahCore 0x22 started
04:00:02:WU01:FS00:Starting
04:00:02:WU00:FS01:0x22:*********************** Log Started 2020-06-13T04:00:02Z ***********************
04:00:02:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\XXX\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -np 16
04:00:02:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
04:00:02:WU01:FS00:Started FahCore on PID 19184
04:00:02:WU00:FS01:0x22:       Type: 0x22
04:00:02:WU00:FS01:0x22:       Core: Core22
04:00:02:WU00:FS01:0x22:    Website: https://foldingathome.org/
04:00:02:WU00:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
04:00:02:WU00:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
04:00:02:WU00:FS01:0x22:             <rafal.wiewiora@choderalab.org>
04:00:02:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 20952 -checkpoint 15
04:00:02:WU00:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
04:00:02:WU00:FS01:0x22:     Config: <none>
04:00:02:WU00:FS01:0x22:************************************ Build *************************************
04:00:02:WU00:FS01:0x22:    Version: 0.0.5
04:00:02:WU00:FS01:0x22:       Date: Apr 22 2020
04:00:02:WU00:FS01:0x22:       Time: 04:42:59
04:00:02:WU00:FS01:0x22: Repository: Git
04:00:02:WU00:FS01:0x22:   Revision: 2d69202c898bd9bb3e093f51cd32bf411c2a0388
04:00:02:WU00:FS01:0x22:     Branch: HEAD
04:00:02:WU01:FS00:Core PID:19544
04:00:02:WU00:FS01:0x22:   Compiler: Visual C++ 2008
04:00:02:WU01:FS00:FahCore 0xa7 started
04:00:02:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
04:00:02:WU00:FS01:0x22:   Platform: win32 10
04:00:02:WU00:FS01:0x22:       Bits: 64
04:00:02:WU00:FS01:0x22:       Mode: Release
04:00:02:WU00:FS01:0x22:************************************ System ************************************
04:00:02:WU00:FS01:0x22:        CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
04:00:02:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
04:00:02:WU00:FS01:0x22:       CPUs: 18
04:00:02:WU00:FS01:0x22:     Memory: 32.00GiB
04:00:02:WU00:FS01:0x22:Free Memory: 28.19GiB
04:00:02:WU00:FS01:0x22:    Threads: WINDOWS_THREADS
04:00:02:WU00:FS01:0x22: OS Version: 6.2
04:00:02:WU00:FS01:0x22:Has Battery: false
04:00:02:WU00:FS01:0x22: On Battery: false
04:00:02:WU00:FS01:0x22: UTC Offset: -7
04:00:02:WU00:FS01:0x22:        PID: 19004
04:00:02:WU00:FS01:0x22:        CWD: C:\Users\XXX\AppData\Roaming\FAHClient\work
04:00:02:WU00:FS01:0x22:         OS: Windows 10 Enterprise
04:00:02:WU00:FS01:0x22:    OS Arch: AMD64
04:00:02:WU00:FS01:0x22:********************************************************************************
04:00:02:WU00:FS01:0x22:Project: 14561 (Run 0, Clone 1355, Gen 117)
04:00:02:WU00:FS01:0x22:Unit: 0x000000a980fccb025e9615bf10c2c7a8
04:00:02:WU00:FS01:0x22:Digital signatures verified
04:00:02:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
04:00:02:WU00:FS01:0x22:Version 0.0.5
<FS00 entried redacted to shorten post>
******************************* Date: 2020-06-13 *******************************
<FS00 entried redacted to shorten post>
******************************* Date: 2020-06-13 *******************************
<FS00 entried redacted to shorten post>
******************************* Date: 2020-06-13 *******************************
<FS00 entried redacted to shorten post>
19:09:23:WU00:FS01:0x22:Completed 0 out of 500000 steps (0%)
19:09:24:WU00:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
19:09:44:WU01:FS00:0xa7:Completed 222500 out of 250000 steps (89%)
19:11:16:WU01:FS00:0xa7:Completed 225000 out of 250000 steps (90%)
19:12:45:WU00:FS01:0x22:Completed 5000 out of 500000 steps (1%)
19:12:46:WU01:FS00:0xa7:Completed 227500 out of 250000 steps (91%)
19:14:16:WU01:FS00:0xa7:Completed 230000 out of 250000 steps (92%)
19:15:46:WU01:FS00:0xa7:Completed 232500 out of 250000 steps (93%)
19:15:59:WU00:FS01:0x22:Completed 10000 out of 500000 steps (2%)
19:17:17:WU01:FS00:0xa7:Completed 235000 out of 250000 steps (94%)
19:18:47:WU01:FS00:0xa7:Completed 237500 out of 250000 steps (95%)
19:19:12:WU00:FS01:0x22:Completed 15000 out of 500000 steps (3%)
19:20:16:WU01:FS00:0xa7:Completed 240000 out of 250000 steps (96%)
19:21:46:WU01:FS00:0xa7:Completed 242500 out of 250000 steps (97%)
19:22:25:WU00:FS01:0x22:Completed 20000 out of 500000 steps (4%)
19:23:17:WU01:FS00:0xa7:Completed 245000 out of 250000 steps (98%)
19:24:47:WU01:FS00:0xa7:Completed 247500 out of 250000 steps (99%)
19:24:48:WU02:FS00:Connecting to assign1.foldingathome.org:80
19:24:48:WU02:FS00:Assigned to work server 69.94.66.7
19:24:48:WU02:FS00:Requesting new work unit for slot 00: RUNNING cpu:16 from 69.94.66.7
19:24:48:WU02:FS00:Connecting to 69.94.66.7:8080
19:24:49:WU02:FS00:Downloading 2.84MiB
19:24:51:WU02:FS00:Download complete
19:24:51:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:14379 run:563 clone:3 gen:169 core:0xa7 unit:0x000000c3455e42075e93300173653c36
19:26:08:WU00:FS01:0x22:Completed 25000 out of 500000 steps (5%)
19:26:17:WU01:FS00:0xa7:Completed 250000 out of 250000 steps (100%)
19:26:22:WU01:FS00:0xa7:Saving result file ..\logfile_01.txt
19:26:22:WU01:FS00:0xa7:Saving result file dhdl.xvg
19:26:22:WU01:FS00:0xa7:Saving result file frame170.trr
19:26:22:WU01:FS00:0xa7:Saving result file md.log
19:26:22:WU01:FS00:0xa7:Saving result file pullf.xvg
19:26:22:WU01:FS00:0xa7:Saving result file pullx.xvg
19:26:22:WU01:FS00:0xa7:Saving result file science.log
19:26:22:WU01:FS00:0xa7:Saving result file traj_comp.xtc
19:26:22:WU01:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
19:26:22:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
19:26:22:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:14379 run:523 clone:3 gen:170 core:0xa7 unit:0x000000c2455e42075e9330d5943ddfbd
19:26:22:WU01:FS00:Uploading 6.49MiB to 69.94.66.7
19:26:22:WU01:FS00:Connecting to 69.94.66.7:8080
19:26:22:WU02:FS00:Starting
19:26:22:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\XXX\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 02 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -np 16
19:26:22:WU02:FS00:Started FahCore on PID 17424
19:26:22:WU02:FS00:Core PID:18096
19:26:22:WU02:FS00:FahCore 0xa7 started
19:26:23:WU02:FS00:0xa7:*********************** Log Started 2020-06-13T19:26:22Z ***********************
19:26:23:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
<FS00 entried redacted to shorten post>
19:26:23:WU02:FS00:0xa7:Steps: first=0 total=250000
19:26:26:WU02:FS00:0xa7:Completed 1 out of 250000 steps (0%)
19:26:28:WU01:FS00:Upload 25.05%
19:26:34:WU01:FS00:Upload 53.96%
19:26:40:WU01:FS00:Upload 81.91%
19:26:44:WU01:FS00:Upload complete
19:26:44:WU01:FS00:Server responded WORK_ACK (400)
19:26:44:WU01:FS00:Final credit estimate, 4039.00 points
19:26:44:WU01:FS00:Cleaning up
19:27:55:WU02:FS00:0xa7:Completed 2500 out of 250000 steps (1%)
19:29:21:WU00:FS01:0x22:Completed 30000 out of 500000 steps (6%)
19:29:25:WU02:FS00:0xa7:Completed 5000 out of 250000 steps (2%)
19:30:53:WU02:FS00:0xa7:Completed 7500 out of 250000 steps (3%)
19:32:22:WU02:FS00:0xa7:Completed 10000 out of 250000 steps (4%)
19:32:34:WU00:FS01:0x22:Completed 35000 out of 500000 steps (7%)
19:33:52:WU02:FS00:0xa7:Completed 12500 out of 250000 steps (5%)
19:35:21:WU02:FS00:0xa7:Completed 15000 out of 250000 steps (6%)
19:35:48:WU00:FS01:0x22:Completed 40000 out of 500000 steps (8%)
19:36:53:WU02:FS00:0xa7:Completed 17500 out of 250000 steps (7%)
19:38:23:WU02:FS00:0xa7:Completed 20000 out of 250000 steps (8%)
19:39:31:WU00:FS01:0x22:Completed 45000 out of 500000 steps (9%)
19:39:52:WU02:FS00:0xa7:Completed 22500 out of 250000 steps (9%)
19:41:22:WU02:FS00:0xa7:Completed 25000 out of 250000 steps (10%)
19:42:44:WU00:FS01:0x22:Completed 50000 out of 500000 steps (10%)
19:42:53:WU02:FS00:0xa7:Completed 27500 out of 250000 steps (11%)
19:44:23:WU02:FS00:0xa7:Completed 30000 out of 250000 steps (12%)
19:45:52:WU02:FS00:0xa7:Completed 32500 out of 250000 steps (13%)
19:45:57:WU00:FS01:0x22:Completed 55000 out of 500000 steps (11%)
19:47:23:WU02:FS00:0xa7:Completed 35000 out of 250000 steps (14%)
19:48:53:WU02:FS00:0xa7:Completed 37500 out of 250000 steps (15%)
19:49:10:WU00:FS01:0x22:Completed 60000 out of 500000 steps (12%)
19:50:26:WU02:FS00:0xa7:Completed 40000 out of 250000 steps (16%)
19:51:56:WU02:FS00:0xa7:Completed 42500 out of 250000 steps (17%)
19:52:56:WU00:FS01:0x22:Completed 65000 out of 500000 steps (13%)
19:53:25:WU02:FS00:0xa7:Completed 45000 out of 250000 steps (18%)
19:54:55:WU02:FS00:0xa7:Completed 47500 out of 250000 steps (19%)
19:56:09:WU00:FS01:0x22:Completed 70000 out of 500000 steps (14%)
19:56:26:WU02:FS00:0xa7:Completed 50000 out of 250000 steps (20%)
19:57:56:WU02:FS00:0xa7:Completed 52500 out of 250000 steps (21%)
19:59:22:WU00:FS01:0x22:Completed 75000 out of 500000 steps (15%)
19:59:25:WU02:FS00:0xa7:Completed 55000 out of 250000 steps (22%)
20:00:54:WU02:FS00:0xa7:Completed 57500 out of 250000 steps (23%)
20:02:25:WU02:FS00:0xa7:Completed 60000 out of 250000 steps (24%)
20:02:35:WU00:FS01:0x22:Completed 80000 out of 500000 steps (16%)
20:03:57:WU02:FS00:0xa7:Completed 62500 out of 250000 steps (25%)
20:05:26:WU02:FS00:0xa7:Completed 65000 out of 250000 steps (26%)
20:06:21:WU00:FS01:0x22:Completed 85000 out of 500000 steps (17%)
20:06:56:WU02:FS00:0xa7:Completed 67500 out of 250000 steps (27%)
20:08:26:WU02:FS00:0xa7:Completed 70000 out of 250000 steps (28%)
20:09:35:WU00:FS01:0x22:Completed 90000 out of 500000 steps (18%)
20:09:57:WU02:FS00:0xa7:Completed 72500 out of 250000 steps (29%)
20:11:28:WU02:FS00:0xa7:Completed 75000 out of 250000 steps (30%)
20:12:47:WU00:FS01:0x22:Completed 95000 out of 500000 steps (19%)
20:12:58:WU02:FS00:0xa7:Completed 77500 out of 250000 steps (31%)
20:14:29:WU02:FS00:0xa7:Completed 80000 out of 250000 steps (32%)
20:16:00:WU02:FS00:0xa7:Completed 82500 out of 250000 steps (33%)
20:16:00:WU00:FS01:0x22:Completed 100000 out of 500000 steps (20%)
20:17:32:WU02:FS00:0xa7:Completed 85000 out of 250000 steps (34%)
20:19:02:WU02:FS00:0xa7:Completed 87500 out of 250000 steps (35%)
20:19:44:WU00:FS01:0x22:Completed 105000 out of 500000 steps (21%)
20:20:32:WU02:FS00:0xa7:Completed 90000 out of 250000 steps (36%)
20:22:02:WU02:FS00:0xa7:Completed 92500 out of 250000 steps (37%)
20:22:57:WU00:FS01:0x22:Completed 110000 out of 500000 steps (22%)
20:23:33:WU02:FS00:0xa7:Completed 95000 out of 250000 steps (38%)
20:25:03:WU02:FS00:0xa7:Completed 97500 out of 250000 steps (39%)
20:26:10:WU00:FS01:0x22:Completed 115000 out of 500000 steps (23%)
20:26:35:WU02:FS00:0xa7:Completed 100000 out of 250000 steps (40%)
20:28:05:WU02:FS00:0xa7:Completed 102500 out of 250000 steps (41%)
20:29:22:WU00:FS01:0x22:Completed 120000 out of 500000 steps (24%)
20:29:37:WU02:FS00:0xa7:Completed 105000 out of 250000 steps (42%)
20:31:08:WU02:FS00:0xa7:Completed 107500 out of 250000 steps (43%)
20:32:38:WU02:FS00:0xa7:Completed 110000 out of 250000 steps (44%)
20:33:06:WU00:FS01:0x22:Completed 125000 out of 500000 steps (25%)
20:34:08:WU02:FS00:0xa7:Completed 112500 out of 250000 steps (45%)
20:35:39:WU02:FS00:0xa7:Completed 115000 out of 250000 steps (46%)
20:36:19:WU00:FS01:0x22:Completed 130000 out of 500000 steps (26%)
20:37:10:WU02:FS00:0xa7:Completed 117500 out of 250000 steps (47%)
20:38:40:WU02:FS00:0xa7:Completed 120000 out of 250000 steps (48%)
20:39:32:WU00:FS01:0x22:Completed 135000 out of 500000 steps (27%)
20:40:10:WU02:FS00:0xa7:Completed 122500 out of 250000 steps (49%)
20:41:43:WU02:FS00:0xa7:Completed 125000 out of 250000 steps (50%)
20:42:44:WU00:FS01:0x22:Completed 140000 out of 500000 steps (28%)
20:43:16:WU02:FS00:0xa7:Completed 127500 out of 250000 steps (51%)
20:44:47:WU02:FS00:0xa7:Completed 130000 out of 250000 steps (52%)
20:46:17:WU02:FS00:0xa7:Completed 132500 out of 250000 steps (53%)
20:46:27:WU00:FS01:0x22:Completed 145000 out of 500000 steps (29%)
20:47:48:WU02:FS00:0xa7:Completed 135000 out of 250000 steps (54%)
20:49:19:WU02:FS00:0xa7:Completed 137500 out of 250000 steps (55%)
20:49:40:WU00:FS01:0x22:Completed 150000 out of 500000 steps (30%)
20:50:49:WU02:FS00:0xa7:Completed 140000 out of 250000 steps (56%)
20:52:19:WU02:FS00:0xa7:Completed 142500 out of 250000 steps (57%)
20:52:53:WU00:FS01:0x22:Completed 155000 out of 500000 steps (31%)
20:53:50:WU02:FS00:0xa7:Completed 145000 out of 250000 steps (58%)
20:55:19:WU02:FS00:0xa7:Completed 147500 out of 250000 steps (59%)
20:56:06:WU00:FS01:0x22:Completed 160000 out of 500000 steps (32%)
20:56:54:WU02:FS00:0xa7:Completed 150000 out of 250000 steps (60%)
20:58:25:WU02:FS00:0xa7:Completed 152500 out of 250000 steps (61%)
20:59:50:WU00:FS01:0x22:Completed 165000 out of 500000 steps (33%)
20:59:55:WU02:FS00:0xa7:Completed 155000 out of 250000 steps (62%)
21:01:25:WU02:FS00:0xa7:Completed 157500 out of 250000 steps (63%)
21:02:56:WU02:FS00:0xa7:Completed 160000 out of 250000 steps (64%)
21:03:03:WU00:FS01:0x22:Completed 170000 out of 500000 steps (34%)
21:04:27:WU02:FS00:0xa7:Completed 162500 out of 250000 steps (65%)
21:05:56:WU02:FS00:0xa7:Completed 165000 out of 250000 steps (66%)
21:06:15:WU00:FS01:0x22:Completed 175000 out of 500000 steps (35%)
21:07:26:WU02:FS00:0xa7:Completed 167500 out of 250000 steps (67%)
21:08:56:WU02:FS00:0xa7:Completed 170000 out of 250000 steps (68%)
21:09:28:WU00:FS01:0x22:Completed 180000 out of 500000 steps (36%)
21:10:29:WU02:FS00:0xa7:Completed 172500 out of 250000 steps (69%)
21:12:01:WU02:FS00:0xa7:Completed 175000 out of 250000 steps (70%)
21:13:13:WU00:FS01:0x22:Completed 185000 out of 500000 steps (37%)
21:13:31:WU02:FS00:0xa7:Completed 177500 out of 250000 steps (71%)
21:15:01:WU02:FS00:0xa7:Completed 180000 out of 250000 steps (72%)
21:16:26:WU00:FS01:0x22:Completed 190000 out of 500000 steps (38%)
21:16:31:WU02:FS00:0xa7:Completed 182500 out of 250000 steps (73%)
21:18:01:WU02:FS00:0xa7:Completed 185000 out of 250000 steps (74%)
21:19:31:WU02:FS00:0xa7:Completed 187500 out of 250000 steps (75%)
21:19:39:WU00:FS01:0x22:Completed 195000 out of 500000 steps (39%)
21:21:01:WU02:FS00:0xa7:Completed 190000 out of 250000 steps (76%)
21:22:29:WU02:FS00:0xa7:Completed 192500 out of 250000 steps (77%)
21:22:52:WU00:FS01:0x22:Completed 200000 out of 500000 steps (40%)
21:24:00:WU02:FS00:0xa7:Completed 195000 out of 250000 steps (78%)
21:25:30:WU02:FS00:0xa7:Completed 197500 out of 250000 steps (79%)
21:26:36:WU00:FS01:0x22:Completed 205000 out of 500000 steps (41%)
21:27:01:WU02:FS00:0xa7:Completed 200000 out of 250000 steps (80%)
21:28:32:WU02:FS00:0xa7:Completed 202500 out of 250000 steps (81%)
21:29:49:WU00:FS01:0x22:Completed 210000 out of 500000 steps (42%)
21:30:01:WU02:FS00:0xa7:Completed 205000 out of 250000 steps (82%)
21:31:31:WU02:FS00:0xa7:Completed 207500 out of 250000 steps (83%)
21:33:01:WU02:FS00:0xa7:Completed 210000 out of 250000 steps (84%)
21:33:03:WU00:FS01:0x22:Completed 215000 out of 500000 steps (43%)
21:34:31:WU02:FS00:0xa7:Completed 212500 out of 250000 steps (85%)
21:36:01:WU02:FS00:0xa7:Completed 215000 out of 250000 steps (86%)
21:36:16:WU00:FS01:0x22:Completed 220000 out of 500000 steps (44%)
21:37:33:WU02:FS00:0xa7:Completed 217500 out of 250000 steps (87%)
21:39:03:WU02:FS00:0xa7:Completed 220000 out of 250000 steps (88%)
21:39:58:WU00:FS01:0x22:Completed 225000 out of 500000 steps (45%)
21:40:32:WU02:FS00:0xa7:Completed 222500 out of 250000 steps (89%)
21:42:03:WU02:FS00:0xa7:Completed 225000 out of 250000 steps (90%)
21:43:11:WU00:FS01:0x22:Completed 230000 out of 500000 steps (46%)
21:43:34:WU02:FS00:0xa7:Completed 227500 out of 250000 steps (91%)
21:45:03:WU02:FS00:0xa7:Completed 230000 out of 250000 steps (92%)
21:46:24:WU00:FS01:0x22:Completed 235000 out of 500000 steps (47%)
21:46:33:WU02:FS00:0xa7:Completed 232500 out of 250000 steps (93%)
21:48:04:WU02:FS00:0xa7:Completed 235000 out of 250000 steps (94%)
21:49:34:WU02:FS00:0xa7:Completed 237500 out of 250000 steps (95%)
21:49:37:WU00:FS01:0x22:Completed 240000 out of 500000 steps (48%)
21:51:07:WU02:FS00:0xa7:Completed 240000 out of 250000 steps (96%)
21:52:36:WU02:FS00:0xa7:Completed 242500 out of 250000 steps (97%)
21:53:22:WU00:FS01:0x22:Completed 245000 out of 500000 steps (49%)
21:54:06:WU02:FS00:0xa7:Completed 245000 out of 250000 steps (98%)
21:55:36:WU02:FS00:0xa7:Completed 247500 out of 250000 steps (99%)
21:55:37:WU01:FS00:Connecting to assign1.foldingathome.org:80
21:55:37:WU01:FS00:Assigned to work server 40.114.52.201
21:55:37:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:16 from 40.114.52.201
21:55:37:WU01:FS00:Connecting to 40.114.52.201:8080
21:55:38:WU01:FS00:Downloading 2.14MiB
21:55:39:WU01:FS00:Download complete
21:55:39:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13851 run:0 clone:17673 gen:184 core:0xa7 unit:0x000000db287234c95e73013aa3ef248d
21:56:35:WU00:FS01:0x22:Completed 250000 out of 500000 steps (50%)
21:57:06:WU02:FS00:0xa7:Completed 250000 out of 250000 steps (100%)
21:57:11:WU02:FS00:0xa7:Saving result file ..\logfile_01.txt
21:57:11:WU02:FS00:0xa7:Saving result file dhdl.xvg
21:57:11:WU02:FS00:0xa7:Saving result file frame169.trr
21:57:11:WU02:FS00:0xa7:Saving result file md.log
21:57:11:WU02:FS00:0xa7:Saving result file pullf.xvg
21:57:11:WU02:FS00:0xa7:Saving result file pullx.xvg
21:57:11:WU02:FS00:0xa7:Saving result file science.log
21:57:11:WU02:FS00:0xa7:Saving result file traj_comp.xtc
21:57:11:WU02:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
21:57:12:WU02:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
21:57:12:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:14379 run:563 clone:3 gen:169 core:0xa7 unit:0x000000c3455e42075e93300173653c36
21:57:12:WU02:FS00:Uploading 6.48MiB to 69.94.66.7
21:57:12:WU01:FS00:Starting
21:57:12:WU02:FS00:Connecting to 69.94.66.7:8080
21:57:12:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\XXX\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -np 16
21:57:12:WU01:FS00:Started FahCore on PID 16436
21:57:12:WU01:FS00:Core PID:6480
21:57:12:WU01:FS00:FahCore 0xa7 started
21:57:13:WU01:FS00:0xa7:*********************** Log Started 2020-06-13T21:57:12Z ***********************
21:57:13:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
21:57:13:WU01:FS00:0xa7:       Type: 0xa7
21:57:13:WU01:FS00:0xa7:       Core: Gromacs
21:57:13:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 16436 -checkpoint 15 -np
21:57:13:WU01:FS00:0xa7:             16
21:57:13:WU01:FS00:0xa7:************************************ CBang *************************************
21:57:13:WU01:FS00:0xa7:       Date: Oct 26 2019
21:57:13:WU01:FS00:0xa7:       Time: 01:38:25
21:57:13:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
21:57:13:WU01:FS00:0xa7:     Branch: master
21:57:13:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
21:57:13:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
21:57:13:WU01:FS00:0xa7:   Platform: win32 10
21:57:13:WU01:FS00:0xa7:       Bits: 64
21:57:13:WU01:FS00:0xa7:       Mode: Release
21:57:13:WU01:FS00:0xa7:************************************ System ************************************
21:57:13:WU01:FS00:0xa7:        CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
21:57:13:WU01:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
21:57:13:WU01:FS00:0xa7:       CPUs: 18
21:57:13:WU01:FS00:0xa7:     Memory: 32.00GiB
21:57:13:WU01:FS00:0xa7:Free Memory: 25.65GiB
21:57:13:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
21:57:13:WU01:FS00:0xa7: OS Version: 6.2
21:57:13:WU01:FS00:0xa7:Has Battery: false
21:57:13:WU01:FS00:0xa7: On Battery: false
21:57:13:WU01:FS00:0xa7: UTC Offset: -7
21:57:13:WU01:FS00:0xa7:        PID: 6480
21:57:13:WU01:FS00:0xa7:        CWD: C:\Users\XXX\AppData\Roaming\FAHClient\work
21:57:13:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
21:57:13:WU01:FS00:0xa7:    Version: 0.0.18
21:57:13:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
21:57:13:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
21:57:13:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
21:57:13:WU01:FS00:0xa7:       Date: Oct 26 2019
21:57:13:WU01:FS00:0xa7:       Time: 01:52:30
21:57:13:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
21:57:13:WU01:FS00:0xa7:     Branch: master
21:57:13:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
21:57:13:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
21:57:13:WU01:FS00:0xa7:   Platform: win32 10
21:57:13:WU01:FS00:0xa7:       Bits: 64
21:57:13:WU01:FS00:0xa7:       Mode: Release
21:57:13:WU01:FS00:0xa7:************************************ Build *************************************
21:57:13:WU01:FS00:0xa7:       SIMD: avx_256
21:57:13:WU01:FS00:0xa7:********************************************************************************
21:57:13:WU01:FS00:0xa7:Project: 13851 (Run 0, Clone 17673, Gen 184)
21:57:13:WU01:FS00:0xa7:Unit: 0x000000db287234c95e73013aa3ef248d
21:57:13:WU01:FS00:0xa7:Reading tar file core.xml
21:57:13:WU01:FS00:0xa7:Reading tar file frame184.tpr
21:57:13:WU01:FS00:0xa7:Digital signatures verified
21:57:13:WU01:FS00:0xa7:Calling: mdrun -s frame184.tpr -o frame184.trr -x frame184.xtc -e frame184.edr -cpt 15 -nt 16
21:57:13:WU01:FS00:0xa7:Steps: first=92000000 total=500000
21:57:16:WU01:FS00:0xa7:Completed 1 out of 500000 steps (0%)
21:57:18:WU02:FS00:Upload 23.14%
21:57:24:WU02:FS00:Upload 50.14%
21:57:30:WU02:FS00:Upload 76.17%
21:57:36:WU02:FS00:Upload complete
21:57:36:WU02:FS00:Server responded WORK_ACK (400)
21:57:36:WU02:FS00:Final credit estimate, 4031.00 points
21:57:36:WU02:FS00:Cleaning up
21:59:10:WU01:FS00:0xa7:Completed 5000 out of 500000 steps (1%)
21:59:48:WU00:FS01:0x22:Completed 255000 out of 500000 steps (51%)
22:01:03:WU01:FS00:0xa7:Completed 10000 out of 500000 steps (2%)
22:02:55:WU01:FS00:0xa7:Completed 15000 out of 500000 steps (3%)
22:03:00:WU00:FS01:0x22:Completed 260000 out of 500000 steps (52%)
22:04:51:WU01:FS00:0xa7:Completed 20000 out of 500000 steps (4%)
22:06:45:WU01:FS00:0xa7:Completed 25000 out of 500000 steps (5%)
22:06:47:WU00:FS01:0x22:Completed 265000 out of 500000 steps (53%)
22:08:37:WU01:FS00:0xa7:Completed 30000 out of 500000 steps (6%)
22:10:00:WU00:FS01:0x22:Completed 270000 out of 500000 steps (54%)
22:10:30:WU01:FS00:0xa7:Completed 35000 out of 500000 steps (7%)
22:12:25:WU01:FS00:0xa7:Completed 40000 out of 500000 steps (8%)
22:13:14:WU00:FS01:0x22:Completed 275000 out of 500000 steps (55%)
22:14:18:WU01:FS00:0xa7:Completed 45000 out of 500000 steps (9%)
22:16:11:WU01:FS00:0xa7:Completed 50000 out of 500000 steps (10%)
22:16:26:WU00:FS01:0x22:Completed 280000 out of 500000 steps (56%)
22:18:05:WU01:FS00:0xa7:Completed 55000 out of 500000 steps (11%)
22:19:57:WU01:FS00:0xa7:Completed 60000 out of 500000 steps (12%)
22:20:07:WU00:FS01:0x22:Completed 285000 out of 500000 steps (57%)
22:21:51:WU01:FS00:0xa7:Completed 65000 out of 500000 steps (13%)
22:23:20:WU00:FS01:0x22:Completed 290000 out of 500000 steps (58%)
22:23:44:WU01:FS00:0xa7:Completed 70000 out of 500000 steps (14%)
22:25:36:WU01:FS00:0xa7:Completed 75000 out of 500000 steps (15%)
22:26:33:WU00:FS01:0x22:Completed 295000 out of 500000 steps (59%)
22:27:31:WU01:FS00:0xa7:Completed 80000 out of 500000 steps (16%)
22:29:25:WU01:FS00:0xa7:Completed 85000 out of 500000 steps (17%)
22:29:46:WU00:FS01:0x22:Completed 300000 out of 500000 steps (60%)
22:31:21:WU01:FS00:0xa7:Completed 90000 out of 500000 steps (18%)
22:33:13:WU01:FS00:0xa7:Completed 95000 out of 500000 steps (19%)
22:33:31:WU00:FS01:0x22:Completed 305000 out of 500000 steps (61%)
22:35:08:WU01:FS00:0xa7:Completed 100000 out of 500000 steps (20%)
22:36:44:WU00:FS01:0x22:Completed 310000 out of 500000 steps (62%)
22:37:01:WU01:FS00:0xa7:Completed 105000 out of 500000 steps (21%)
22:38:55:WU01:FS00:0xa7:Completed 110000 out of 500000 steps (22%)
22:39:57:WU00:FS01:0x22:Completed 315000 out of 500000 steps (63%)
22:40:48:WU01:FS00:0xa7:Completed 115000 out of 500000 steps (23%)
22:42:42:WU01:FS00:0xa7:Completed 120000 out of 500000 steps (24%)
22:43:10:WU00:FS01:0x22:Completed 320000 out of 500000 steps (64%)
22:44:37:WU01:FS00:0xa7:Completed 125000 out of 500000 steps (25%)
22:46:29:WU01:FS00:0xa7:Completed 130000 out of 500000 steps (26%)
22:46:54:WU00:FS01:0x22:Completed 325000 out of 500000 steps (65%)
22:48:22:WU01:FS00:0xa7:Completed 135000 out of 500000 steps (27%)
22:50:07:WU00:FS01:0x22:Completed 330000 out of 500000 steps (66%)
22:50:15:WU01:FS00:0xa7:Completed 140000 out of 500000 steps (28%)
22:52:08:WU01:FS00:0xa7:Completed 145000 out of 500000 steps (29%)
22:53:22:WU00:FS01:0x22:Completed 335000 out of 500000 steps (67%)
22:54:03:WU01:FS00:0xa7:Completed 150000 out of 500000 steps (30%)
22:55:56:WU01:FS00:0xa7:Completed 155000 out of 500000 steps (31%)
22:56:35:WU00:FS01:0x22:Completed 340000 out of 500000 steps (68%)
******************************* Date: 2020-06-13 *******************************
22:57:54:WU01:FS00:0xa7:Completed 160000 out of 500000 steps (32%)
22:59:47:WU01:FS00:0xa7:Completed 165000 out of 500000 steps (33%)
23:00:01:FS00:Paused
23:00:01:FS01:Paused
23:00:01:FS00:Shutting core down
23:00:01:FS01:Shutting core down
23:00:01:WU01:FS00:0xa7:WARNING:Console control signal 1 on PID 6480
23:00:01:WU01:FS00:0xa7:Exiting, please wait. . .
23:00:01:WU00:FS01:0x22:WARNING:Console control signal 1 on PID 19004
23:00:01:WU00:FS01:0x22:Exiting, please wait. . .
23:00:02:WU00:FS01:0x22:Folding@home Core Shutdown: INTERRUPTED
23:00:03:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
23:00:03:WU01:FS00:0xa7:Folding@home Core Shutdown: INTERRUPTED
23:00:04:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
23:00:38:Removing old file 'configs/config-20200605-230030.xml'
23:00:38:Saving configuration to config.xml
23:00:38:<config>
23:00:38:  <!-- Folding Slot Configuration -->
23:00:38:  <cause v='COVID_19'/>
23:00:38:  <max-packet-size v='big'/>
23:00:38:
23:00:38:  <!-- HTTP Server -->
23:00:38:  <allow v='127.0.0.1 10.12.9.0/24'/>
23:00:38:
23:00:38:  <!-- Network -->
23:00:38:  <proxy v=':8080'/>
23:00:38:
23:00:38:  <!-- Remote Command Server -->
23:00:38:  <command-allow-no-pass v='127.0.0.1 10.12.9.0/24'/>
23:00:38:
23:00:38:  <!-- Slot Control -->
23:00:38:  <power v='full'/>
23:00:38:
23:00:38:  <!-- User Information -->
23:00:38:  <passkey v='*****'/>
23:00:38:  <team v='230318'/>
23:00:38:  <user v='Loomis_Towcar'/>
23:00:38:
23:00:38:  <!-- Web Server -->
23:00:38:  <web-allow v='127.0.0.1 10.12.9.0/24'/>
23:00:38:
23:00:38:  <!-- Folding Slots -->
23:00:38:  <slot id='0' type='CPU'>
23:00:38:    <cpus v='16'/>
23:00:38:    <paused v='true'/>
23:00:38:  </slot>
23:00:38:  <slot id='1' type='GPU'>
23:00:38:    <paused v='true'/>
23:00:38:  </slot>
23:00:38:</config>
04:00:01:FS00:Unpaused
04:00:01:FS01:Unpaused
04:00:01:WU00:FS01:Starting
04:00:01:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\XXX\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
04:00:01:WU00:FS01:Started FahCore on PID 19652
04:00:01:WU00:FS01:Core PID:20964
04:00:01:WU00:FS01:FahCore 0x22 started
04:00:02:WU00:FS01:0x22:*********************** Log Started 2020-06-14T04:00:02Z ***********************
04:00:02:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
04:00:02:WU00:FS01:0x22:       Type: 0x22
04:00:02:WU01:FS00:Starting
04:00:02:WU00:FS01:0x22:       Core: Core22
04:00:02:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\XXX\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 17292 -checkpoint 15 -np 16
04:00:02:WU00:FS01:0x22:    Website: https://foldingathome.org/
04:00:02:WU01:FS00:Started FahCore on PID 14544
04:00:02:WU00:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
04:00:02:WU00:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
04:00:02:WU00:FS01:0x22:             <rafal.wiewiora@choderalab.org>
04:00:02:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 19652 -checkpoint 15
04:00:02:WU00:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
04:00:02:WU00:FS01:0x22:     Config: <none>
04:00:02:WU00:FS01:0x22:************************************ Build *************************************
04:00:02:WU00:FS01:0x22:    Version: 0.0.5
04:00:02:WU00:FS01:0x22:       Date: Apr 22 2020
04:00:02:WU00:FS01:0x22:       Time: 04:42:59
04:00:02:WU01:FS00:Core PID:17932
04:00:02:WU00:FS01:0x22: Repository: Git
04:00:02:WU01:FS00:FahCore 0xa7 started
04:00:02:WU00:FS01:0x22:   Revision: 2d69202c898bd9bb3e093f51cd32bf411c2a0388
04:00:02:WU00:FS01:0x22:     Branch: HEAD
04:00:02:WU00:FS01:0x22:   Compiler: Visual C++ 2008
04:00:02:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
04:00:02:WU00:FS01:0x22:   Platform: win32 10
04:00:02:WU00:FS01:0x22:       Bits: 64
04:00:02:WU00:FS01:0x22:       Mode: Release
04:00:02:WU00:FS01:0x22:************************************ System ************************************
04:00:02:WU00:FS01:0x22:        CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
04:00:02:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
04:00:02:WU00:FS01:0x22:       CPUs: 18
04:00:02:WU00:FS01:0x22:     Memory: 32.00GiB
04:00:02:WU00:FS01:0x22:Free Memory: 28.03GiB
04:00:02:WU00:FS01:0x22:    Threads: WINDOWS_THREADS
04:00:02:WU00:FS01:0x22: OS Version: 6.2
04:00:02:WU00:FS01:0x22:Has Battery: false
04:00:02:WU00:FS01:0x22: On Battery: false
04:00:02:WU00:FS01:0x22: UTC Offset: -7
04:00:02:WU00:FS01:0x22:        PID: 20964
04:00:02:WU00:FS01:0x22:        CWD: C:\Users\XXX\AppData\Roaming\FAHClient\work
04:00:02:WU00:FS01:0x22:         OS: Windows 10 Enterprise
04:00:02:WU00:FS01:0x22:    OS Arch: AMD64
04:00:02:WU00:FS01:0x22:********************************************************************************
04:00:02:WU00:FS01:0x22:Project: 14561 (Run 0, Clone 1355, Gen 117)
04:00:02:WU00:FS01:0x22:Unit: 0x000000a980fccb025e9615bf10c2c7a8
04:00:02:WU00:FS01:0x22:Digital signatures verified
04:00:02:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
04:00:02:WU00:FS01:0x22:Version 0.0.5
04:00:03:WU01:FS00:0xa7:*********************** Log Started 2020-06-14T04:00:02Z ***********************
04:00:03:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
04:00:03:WU01:FS00:0xa7:       Type: 0xa7
04:00:03:WU01:FS00:0xa7:       Core: Gromacs
04:00:03:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 14544 -checkpoint 15 -np
04:00:03:WU01:FS00:0xa7:             16
04:00:03:WU01:FS00:0xa7:************************************ CBang *************************************
04:00:03:WU01:FS00:0xa7:       Date: Oct 26 2019
04:00:03:WU01:FS00:0xa7:       Time: 01:38:25
04:00:03:WU01:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
04:00:03:WU01:FS00:0xa7:     Branch: master
04:00:03:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
04:00:03:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
04:00:03:WU01:FS00:0xa7:   Platform: win32 10
04:00:03:WU01:FS00:0xa7:       Bits: 64
04:00:03:WU01:FS00:0xa7:       Mode: Release
04:00:03:WU01:FS00:0xa7:************************************ System ************************************
04:00:03:WU01:FS00:0xa7:        CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
04:00:03:WU01:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
04:00:03:WU01:FS00:0xa7:       CPUs: 18
04:00:03:WU01:FS00:0xa7:     Memory: 32.00GiB
04:00:03:WU01:FS00:0xa7:Free Memory: 28.01GiB
04:00:03:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
04:00:03:WU01:FS00:0xa7: OS Version: 6.2
04:00:03:WU01:FS00:0xa7:Has Battery: false
04:00:03:WU01:FS00:0xa7: On Battery: false
04:00:03:WU01:FS00:0xa7: UTC Offset: -7
04:00:03:WU01:FS00:0xa7:        PID: 17932
04:00:03:WU01:FS00:0xa7:        CWD: C:\Users\XXX\AppData\Roaming\FAHClient\work
04:00:03:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
04:00:03:WU01:FS00:0xa7:    Version: 0.0.18
04:00:03:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
04:00:03:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
04:00:03:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
04:00:03:WU01:FS00:0xa7:       Date: Oct 26 2019
04:00:03:WU01:FS00:0xa7:       Time: 01:52:30
04:00:03:WU01:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
04:00:03:WU01:FS00:0xa7:     Branch: master
04:00:03:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
04:00:03:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
04:00:03:WU01:FS00:0xa7:   Platform: win32 10
04:00:03:WU01:FS00:0xa7:       Bits: 64
04:00:03:WU01:FS00:0xa7:       Mode: Release
04:00:03:WU01:FS00:0xa7:************************************ Build *************************************
04:00:03:WU01:FS00:0xa7:       SIMD: avx_256
04:00:03:WU01:FS00:0xa7:********************************************************************************
04:00:03:WU01:FS00:0xa7:Project: 13851 (Run 0, Clone 17673, Gen 184)
04:00:03:WU01:FS00:0xa7:Unit: 0x000000db287234c95e73013aa3ef248d
04:00:03:WU01:FS00:0xa7:Digital signatures verified
04:00:03:WU01:FS00:0xa7:Calling: mdrun -s frame184.tpr -o frame184.trr -x frame184.xtc -e frame184.edr -cpi state.cpt -cpt 15 -nt 16
04:00:03:WU01:FS00:0xa7:Steps: first=92000000 total=500000
04:00:05:WU00:FS01:0x22:  Found a checkpoint file
<FS00 entried redacted to shorten post>
******************************* Date: 2020-06-14 *******************************
<FS00 entried redacted to shorten post>
******************************* Date: 2020-06-14 *******************************
<FS00 entried redacted to shorten post>
******************************* Date: 2020-06-14 *******************************
<FS00 entried redacted to shorten post>
19:27:56:FS01:Shutting core down
19:27:56:WU01:FS00:0xa7:WARNING:Console control signal 1 on PID 2776
19:27:56:WU00:FS01:0x22:WARNING:Console control signal 1 on PID 20964
19:27:56:WU01:FS00:0xa7:Exiting, please wait. . .
19:27:56:WU00:FS01:0x22:Exiting, please wait. . .
19:28:08:WU01:FS00:0xa7:Folding@home Core Shutdown: INTERRUPTED
19:28:22:WU00:FS01:0x22:Completed 340000 out of 500000 steps (68%)
19:28:23:WU00:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
19:28:23:WU00:FS01:0x22:Folding@home Core Shutdown: INTERRUPTED
19:28:24:Clean exit
...here's the current log from after I killed the client and restarted it. This time, it finds the checkpoint, reports the 68% progress, then continues to actually make progress:

Code: Select all

*********************** Log Started 2020-06-14T19:28:31Z ***********************
19:28:34:WU00:FS01:Starting
19:28:34:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\XXX\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 20272 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
19:28:34:WU00:FS01:Started FahCore on PID 6736
19:28:34:WU00:FS01:Core PID:22252
19:28:34:WU00:FS01:FahCore 0x22 started
19:28:35:WU00:FS01:0x22:*********************** Log Started 2020-06-14T19:28:34Z ***********************
19:28:35:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
19:28:35:WU00:FS01:0x22:       Type: 0x22
19:28:35:WU00:FS01:0x22:       Core: Core22
19:28:35:WU00:FS01:0x22:    Website: https://foldingathome.org/
19:28:35:WU00:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
19:28:35:WU00:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
19:28:35:WU00:FS01:0x22:             <rafal.wiewiora@choderalab.org>
19:28:35:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 6736 -checkpoint 15
19:28:35:WU00:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
19:28:35:WU00:FS01:0x22:     Config: <none>
19:28:35:WU00:FS01:0x22:************************************ Build *************************************
19:28:35:WU00:FS01:0x22:    Version: 0.0.5
19:28:35:WU00:FS01:0x22:       Date: Apr 22 2020
19:28:35:WU00:FS01:0x22:       Time: 04:42:59
19:28:35:WU00:FS01:0x22: Repository: Git
19:28:35:WU00:FS01:0x22:   Revision: 2d69202c898bd9bb3e093f51cd32bf411c2a0388
19:28:35:WU00:FS01:0x22:     Branch: HEAD
19:28:35:WU00:FS01:0x22:   Compiler: Visual C++ 2008
19:28:35:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
19:28:35:WU00:FS01:0x22:   Platform: win32 10
19:28:35:WU00:FS01:0x22:       Bits: 64
19:28:35:WU00:FS01:0x22:       Mode: Release
19:28:35:WU00:FS01:0x22:************************************ System ************************************
19:28:35:WU00:FS01:0x22:        CPU: Intel(R) Xeon(R) CPU E5-2660 v2 @ 2.20GHz
19:28:35:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
19:28:35:WU00:FS01:0x22:       CPUs: 18
19:28:35:WU00:FS01:0x22:     Memory: 32.00GiB
19:28:35:WU00:FS01:0x22:Free Memory: 27.75GiB
19:28:35:WU00:FS01:0x22:    Threads: WINDOWS_THREADS
19:28:35:WU00:FS01:0x22: OS Version: 6.2
19:28:35:WU00:FS01:0x22:Has Battery: false
19:28:35:WU00:FS01:0x22: On Battery: false
19:28:35:WU00:FS01:0x22: UTC Offset: -7
19:28:35:WU00:FS01:0x22:        PID: 22252
19:28:35:WU00:FS01:0x22:        CWD: C:\Users\XXX\AppData\Roaming\FAHClient\work
19:28:35:WU00:FS01:0x22:         OS: Windows 10 Enterprise
19:28:35:WU00:FS01:0x22:    OS Arch: AMD64
19:28:35:WU00:FS01:0x22:********************************************************************************
19:28:35:WU00:FS01:0x22:Project: 14561 (Run 0, Clone 1355, Gen 117)
19:28:35:WU00:FS01:0x22:Unit: 0x000000a980fccb025e9615bf10c2c7a8
19:28:35:WU00:FS01:0x22:Digital signatures verified
19:28:35:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
19:28:35:WU00:FS01:0x22:Version 0.0.5
19:28:38:WU00:FS01:0x22:  Found a checkpoint file
19:30:25:WU00:FS01:0x22:Completed 340000 out of 500000 steps (68%)
19:30:25:WU00:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
19:33:48:WU00:FS01:0x22:Completed 345000 out of 500000 steps (69%)
19:37:01:WU00:FS01:0x22:Completed 350000 out of 500000 steps (70%)
19:40:13:WU00:FS01:0x22:Completed 355000 out of 500000 steps (71%)
19:43:26:WU00:FS01:0x22:Completed 360000 out of 500000 steps (72%)
19:47:08:WU00:FS01:0x22:Completed 365000 out of 500000 steps (73%)
19:50:21:WU00:FS01:0x22:Completed 370000 out of 500000 steps (74%)
19:53:34:WU00:FS01:0x22:Completed 375000 out of 500000 steps (75%)
19:56:47:WU00:FS01:0x22:Completed 380000 out of 500000 steps (76%)
20:00:32:WU00:FS01:0x22:Completed 385000 out of 500000 steps (77%)
20:03:45:WU00:FS01:0x22:Completed 390000 out of 500000 steps (78%)
20:06:57:WU00:FS01:0x22:Completed 395000 out of 500000 steps (79%)
20:10:09:WU00:FS01:0x22:Completed 400000 out of 500000 steps (80%)
20:13:56:WU00:FS01:0x22:Completed 405000 out of 500000 steps (81%)
20:17:11:WU00:FS01:0x22:Completed 410000 out of 500000 steps (82%)
20:20:24:WU00:FS01:0x22:Completed 415000 out of 500000 steps (83%)
20:23:38:WU00:FS01:0x22:Completed 420000 out of 500000 steps (84%)
20:27:21:WU00:FS01:0x22:Completed 425000 out of 500000 steps (85%)
20:30:34:WU00:FS01:0x22:Completed 430000 out of 500000 steps (86%)
20:33:47:WU00:FS01:0x22:Completed 435000 out of 500000 steps (87%)
20:37:00:WU00:FS01:0x22:Completed 440000 out of 500000 steps (88%)
20:40:44:WU00:FS01:0x22:Completed 445000 out of 500000 steps (89%)
20:43:58:WU00:FS01:0x22:Completed 450000 out of 500000 steps (90%)
20:47:12:WU00:FS01:0x22:Completed 455000 out of 500000 steps (91%)
20:50:26:WU00:FS01:0x22:Completed 460000 out of 500000 steps (92%)
20:54:12:WU00:FS01:0x22:Completed 465000 out of 500000 steps (93%)
20:57:25:WU00:FS01:0x22:Completed 470000 out of 500000 steps (94%)
21:00:38:WU00:FS01:0x22:Completed 475000 out of 500000 steps (95%)
21:03:52:WU00:FS01:0x22:Completed 480000 out of 500000 steps (96%)
21:07:34:WU00:FS01:0x22:Completed 485000 out of 500000 steps (97%)
21:10:47:WU00:FS01:0x22:Completed 490000 out of 500000 steps (98%)
21:14:01:WU00:FS01:0x22:Completed 495000 out of 500000 steps (99%)
21:14:01:WU02:FS01:Connecting to assign1.foldingathome.org:80
21:14:01:WARNING:WU02:FS01:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
21:14:01:WU02:FS01:Connecting to assign2.foldingathome.org:80
21:14:02:WARNING:WU02:FS01:Failed to get assignment from 'assign2.foldingathome.org:80': No WUs available for this configuration
21:14:02:WU02:FS01:Connecting to assign3.foldingathome.org:80
21:14:02:WARNING:WU02:FS01:Failed to get assignment from 'assign3.foldingathome.org:80': No WUs available for this configuration
21:14:02:WU02:FS01:Connecting to assign4.foldingathome.org:80
21:14:03:WARNING:WU02:FS01:Failed to get assignment from 'assign4.foldingathome.org:80': No WUs available for this configuration
21:14:03:ERROR:WU02:FS01:Exception: Could not get an assignment
21:14:03:WU02:FS01:Connecting to assign1.foldingathome.org:80
21:14:03:WARNING:WU02:FS01:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
21:14:03:WU02:FS01:Connecting to assign2.foldingathome.org:80
21:14:04:WARNING:WU02:FS01:Failed to get assignment from 'assign2.foldingathome.org:80': No WUs available for this configuration
21:14:04:WU02:FS01:Connecting to assign3.foldingathome.org:80
21:14:04:WARNING:WU02:FS01:Failed to get assignment from 'assign3.foldingathome.org:80': No WUs available for this configuration
21:14:04:WU02:FS01:Connecting to assign4.foldingathome.org:80
21:14:04:WARNING:WU02:FS01:Failed to get assignment from 'assign4.foldingathome.org:80': No WUs available for this configuration
21:14:04:ERROR:WU02:FS01:Exception: Could not get an assignment
_r2w_ben
Posts: 285
Joined: Wed Apr 23, 2008 3:11 pm

Re: RX580 stalls at 0.00% or 99.99%

Post by _r2w_ben »

LoomisTowcar wrote:More logs. The first is an excerpt from %APPDATA%, from a stall at an indicated 99.99% again, where it seems like the GPU was paused for my peak utility window, then unpaused, found a checkpoint, but didn't make any progress (04:00:05:WU00:FS01:0x22: Found a checkpoint file). It appears to have actually stalled at 68%, indicated during the process of shutting down:
FAHControl keeps increasing the progress based on Estimated TPF. The actual progress is what's written to the log.
LoomisTowcar
Posts: 4
Joined: Fri Jun 12, 2020 10:59 pm

RX580 stalls; must restart client to get it going again.

Post by LoomisTowcar »

Right. Ok, so the progress reported by FAHControl isn't as relevant as the progress actually logged. Revised the subject line.
Post Reply