Client stuck on "cleaning up"

Moderators: Site Moderators, FAHC Science Team

Post Reply
FoldingAddict
Posts: 3
Joined: Fri Mar 31, 2023 1:01 am

Client stuck on "cleaning up"

Post by FoldingAddict »

This has been an ongoing issue I've been having with one particular system. It folds fine, anywhere between 2 to 20 units, but eventually, it just stops. Last log entry point will always be something like "23:30:38:WU00:FS01:Cleaning up". The advanced control shows the client as "running" but it just sits at 0.00% in perpetuity. It did this on Windows 10 on 5 or 6 different drivers I've tried. I got so annoyed I did a complete OS wipe and moved to Windows 11 as well as testing latest NVIDIA drivers, working backwards about 4 versions. Nothing I've done has fixed the problem. Also, rebooting does not reinitialize folding, the only fix is to nuke the work folder which I hate doing. The machine is a 4790K/RTX 4090 build that has one other program installed and running besides Windows itself, that's Reolink's camera client.

Full log:

Code: Select all

*********************** Log Started 2023-03-30T20:53:29Z ***********************
20:53:29:******************************* libFAH ********************************
20:53:29:           Date: Oct 20 2020
20:53:29:           Time: 13:36:55
20:53:29:       Revision: 5ca109d295a6245e2a2f590b3d0085ad5e567aeb
20:53:29:         Branch: master
20:53:29:       Compiler: Visual C++ 2015
20:53:29:        Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
20:53:29:       Platform: win32 10
20:53:29:           Bits: 32
20:53:29:           Mode: Release
20:53:29:****************************** FAHClient ******************************
20:53:29:        Version: 7.6.21
20:53:29:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
20:53:29:      Copyright: 2020 foldingathome.org
20:53:29:       Homepage: https://foldingathome.org/
20:53:29:           Date: Oct 20 2020
20:53:29:           Time: 13:41:04
20:53:29:       Revision: 6efbf0e138e22d3963e6a291f78dcb9c6422a278
20:53:29:         Branch: master
20:53:29:       Compiler: Visual C++ 2015
20:53:29:        Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
20:53:29:       Platform: win32 10
20:53:29:           Bits: 32
20:53:29:           Mode: Release
20:53:29:           Args: --open-web-control
20:53:29:         Config: C:\ProgramData\FAHClient\config.xml
20:53:29:******************************** CBang ********************************
20:53:29:           Date: Oct 20 2020
20:53:29:           Time: 11:36:18
20:53:29:       Revision: 7e4ce85225d7eaeb775e87c31740181ca603de60
20:53:29:         Branch: master
20:53:29:       Compiler: Visual C++ 2015
20:53:29:        Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
20:53:29:       Platform: win32 10
20:53:29:           Bits: 32
20:53:29:           Mode: Release
20:53:29:******************************* System ********************************
20:53:29:            CPU: Intel(R) Core(TM) i7-4790K CPU @ 4.00GHz
20:53:29:         CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
20:53:29:           CPUs: 8
20:53:29:         Memory: 15.94GiB
20:53:29:    Free Memory: 10.60GiB
20:53:29:        Threads: WINDOWS_THREADS
20:53:29:     OS Version: 6.2
20:53:29:    Has Battery: false
20:53:29:     On Battery: false
20:53:29:     UTC Offset: -5
20:53:29:            PID: 9720
20:53:29:            CWD: C:\ProgramData\FAHClient
20:53:29:  Win32 Service: false
20:53:29:             OS: Windows 10 Enterprise
20:53:29:        OS Arch: AMD64
20:53:29:           GPUs: 1
20:53:29:          GPU 0: Bus:1 Slot:0 Func:0 NVIDIA:9 AD102 [GeForce RTX 4090]
20:53:29:  CUDA Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:8.9 Driver:12.1
20:53:29:OpenCL Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:3.0 Driver:531.18
20:53:29:***********************************************************************
20:53:29:<config>
20:53:29:  <!-- Folding Slot Configuration -->
20:53:29:  <cause v='ALZHEIMERS'/>
20:53:29:
20:53:29:  <!-- HTTP Server -->
20:53:29:  <allow v='127.0.0.1 192.168.1.147'/>
20:53:29:
20:53:29:  <!-- Network -->
20:53:29:  <proxy v=':8080'/>
20:53:29:
20:53:29:  <!-- Remote Command Server -->
20:53:29:  <command-allow-no-pass v='127.0.0.1 192.168.1.147'/>
20:53:29:  <password v='*****'/>
20:53:29:
20:53:29:  <!-- User Information -->
20:53:29:  <passkey v='*****'/>
20:53:29:  <team v='32'/>
20:53:29:  <user v='FoldingAddict'/>
20:53:29:
20:53:29:  <!-- Folding Slots -->
20:53:29:  <slot id='1' type='GPU'>
20:53:29:    <paused v='true'/>
20:53:29:    <pci-bus v='1'/>
20:53:29:    <pci-slot v='0'/>
20:53:29:  </slot>
20:53:29:</config>
20:53:29:Trying to access database...
20:53:29:Successfully acquired database lock
20:53:29:FS01:Initialized folding slot 01: gpu:1:0 AD102 [GeForce RTX 4090]
20:53:29:Set client configured
20:53:31:4:127.0.0.1:New Web session
20:53:49:FS01:Unpaused
20:53:49:WU00:FS01:Connecting to assign1.foldingathome.org:80
20:53:50:WU00:FS01:Connecting to assign1.foldingathome.org:80
20:53:50:WU00:FS01:Assigned to work server 206.223.170.146
20:53:50:WU00:FS01:Requesting new work unit for slot 01: gpu:1:0 AD102 [GeForce RTX 4090] from 206.223.170.146
20:53:50:WU00:FS01:Connecting to 206.223.170.146:8080
20:54:01:WU00:FS01:Downloading 26.57MiB
20:54:06:WU00:FS01:Download complete
20:54:06:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:18213 run:20234 clone:1 gen:37 core:0x22 unit:0x00000001000000250000472500004f0a
20:54:06:WU00:FS01:Downloading core from http://cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah
20:54:06:WU00:FS01:Connecting to cores.foldingathome.org:80
20:54:06:WU00:FS01:FahCore 22: Downloading 156.61MiB
20:54:12:WU00:FS01:FahCore 22: 26.10%
20:54:18:WU00:FS01:FahCore 22: 42.06%
20:54:24:WU00:FS01:FahCore 22: 54.44%
20:54:30:WU00:FS01:FahCore 22: 69.36%
20:54:30:Saving configuration to config.xml
20:54:30:<config>
20:54:30:  <!-- Folding Slot Configuration -->
20:54:30:  <cause v='ALZHEIMERS'/>
20:54:30:
20:54:30:  <!-- HTTP Server -->
20:54:30:  <allow v='127.0.0.1 192.168.1.147'/>
20:54:30:
20:54:30:  <!-- Network -->
20:54:30:  <proxy v=':8080'/>
20:54:30:
20:54:30:  <!-- Remote Command Server -->
20:54:30:  <command-allow-no-pass v='127.0.0.1 192.168.1.147'/>
20:54:30:  <password v='*****'/>
20:54:30:
20:54:30:  <!-- User Information -->
20:54:30:  <passkey v='*****'/>
20:54:30:  <team v='32'/>
20:54:30:  <user v='FoldingAddict'/>
20:54:30:
20:54:30:  <!-- Folding Slots -->
20:54:30:  <slot id='1' type='GPU'>
20:54:30:    <pci-bus v='1'/>
20:54:30:    <pci-slot v='0'/>
20:54:30:  </slot>
20:54:30:</config>
20:54:36:WU00:FS01:FahCore 22: 77.94%
20:54:42:WU00:FS01:FahCore 22: 89.55%
20:54:47:WU00:FS01:FahCore 22: Download complete
20:54:48:WU00:FS01:Valid core signature
20:54:48:WU00:FS01:Unpacked 5.52MiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/FahCore_22.exe
20:54:48:WU00:FS01:Unpacked 24.45KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/api-ms-win-crt-runtime-l1-1-0.dll
20:54:48:WU00:FS01:Unpacked 179.58MiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/cufft64_10.dll
20:54:48:WU00:FS01:Unpacked 3.25MiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/libcrypto-1_1-x64.dll
20:54:48:WU00:FS01:Unpacked 667.00KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/libssl-1_1-x64.dll
20:54:48:WU00:FS01:Unpacked 552.38KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/msvcp140.dll
20:54:48:WU00:FS01:Unpacked 23.38KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/msvcp140_1.dll
20:54:48:WU00:FS01:Unpacked 181.38KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/msvcp140_2.dll
20:54:48:WU00:FS01:Unpacked 54.88KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/msvcp140_atomic_wait.dll
20:54:48:WU00:FS01:Unpacked 19.88KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/msvcp140_codecvt_ids.dll
20:54:48:WU00:FS01:Unpacked 5.29MiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/nvrtc-builtins64_112.dll
20:54:48:WU00:FS01:Unpacked 30.51MiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/nvrtc64_112_0.dll
20:54:48:WU00:FS01:Unpacked 2.81MiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/OpenMM.dll
20:54:48:WU00:FS01:Unpacked 302.00KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/OpenMMAmoeba.dll
20:54:48:WU00:FS01:Unpacked 1.04MiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/OpenMMAmoebaCUDA.dll
20:54:48:WU00:FS01:Unpacked 952.00KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/OpenMMAmoebaOpenCL.dll
20:54:48:WU00:FS01:Unpacked 458.50KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/OpenMMAmoebaReference.dll
20:54:48:WU00:FS01:Unpacked 517.50KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/OpenMMCPU.dll
20:54:48:WU00:FS01:Unpacked 1.78MiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/OpenMMCUDA.dll
20:54:48:WU00:FS01:Unpacked 60.50KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/OpenMMCudaCompiler.dll
20:54:48:WU00:FS01:Unpacked 99.50KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/OpenMMDrude.dll
20:54:48:WU00:FS01:Unpacked 118.00KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/OpenMMDrudeCUDA.dll
20:54:48:WU00:FS01:Unpacked 118.00KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/OpenMMDrudeOpenCL.dll
20:54:48:WU00:FS01:Unpacked 87.00KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/OpenMMDrudeReference.dll
20:54:48:WU00:FS01:Unpacked 1.81MiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/OpenMMOpenCL.dll
20:54:48:WU00:FS01:Unpacked 61.00KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/OpenMMPME.dll
20:54:48:WU00:FS01:Unpacked 57.00KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/OpenMMRPMD.dll
20:54:48:WU00:FS01:Unpacked 138.50KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/OpenMMRPMDCUDA.dll
20:54:48:WU00:FS01:Unpacked 138.50KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/OpenMMRPMDOpenCL.dll
20:54:48:WU00:FS01:Unpacked 75.50KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/OpenMMRPMDReference.dll
20:54:48:WU00:FS01:Unpacked 94.88KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/vcruntime140.dll
20:54:48:WU00:FS01:Unpacked 36.38KiB to cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/vcruntime140_1.dll
20:54:48:WU00:FS01:Starting
20:54:48:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\ProgramData\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 9720 -checkpoint 15 -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor nvidia -gpu 0 -gpu-usage 100
20:54:48:WU00:FS01:Started FahCore on PID 8160
20:54:48:WU00:FS01:Core PID:400
20:54:48:WU00:FS01:FahCore 0x22 started
21:47:14:WU01:FS01:0x22:*********************** Log Started 2023-03-30T21:47:14Z ***********************
21:47:14:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
21:47:14:WU01:FS01:0x22:       Core: Core22
21:47:14:WU01:FS01:0x22:       Type: 0x22
21:47:14:WU01:FS01:0x22:    Version: 0.0.20
21:47:14:WU01:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
21:47:14:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
21:47:14:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
21:47:14:WU01:FS01:0x22:       Date: Jan 20 2022
21:47:14:WU01:FS01:0x22:       Time: 01:15:36
21:47:14:WU01:FS01:0x22:   Revision: 3f211b8a4346514edbff34e3cb1c0e0ec951373c
21:47:14:WU01:FS01:0x22:     Branch: HEAD
21:47:14:WU01:FS01:0x22:   Compiler: Visual C++
21:47:14:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
21:47:14:WU01:FS01:0x22:             -DOPENMM_VERSION="\"7.7.0\""
21:47:14:WU01:FS01:0x22:   Platform: win32 10
21:47:14:WU01:FS01:0x22:       Bits: 64
21:47:14:WU01:FS01:0x22:       Mode: Release
21:47:14:WU01:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
21:47:14:WU01:FS01:0x22:             <peastman@stanford.edu>
21:47:14:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 5696 -checkpoint 15
21:47:14:WU01:FS01:0x22:             -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor
21:47:14:WU01:FS01:0x22:             nvidia -gpu 0 -gpu-usage 100
21:47:14:WU01:FS01:0x22:************************************ libFAH ************************************
21:47:14:WU01:FS01:0x22:       Date: Jan 20 2022
21:47:14:WU01:FS01:0x22:       Time: 01:14:17
21:47:14:WU01:FS01:0x22:   Revision: 9f4ad694e75c2350d4bb6b8b5b769ba27e483a2f
21:47:14:WU01:FS01:0x22:     Branch: HEAD
21:47:14:WU01:FS01:0x22:   Compiler: Visual C++
21:47:14:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
21:47:14:WU01:FS01:0x22:   Platform: win32 10
21:47:14:WU01:FS01:0x22:       Bits: 64
21:47:14:WU01:FS01:0x22:       Mode: Release
21:47:14:WU01:FS01:0x22:************************************ CBang *************************************
21:47:14:WU01:FS01:0x22:       Date: Jan 20 2022
21:47:14:WU01:FS01:0x22:       Time: 01:13:20
21:47:14:WU01:FS01:0x22:   Revision: ab023d155b446906d55b0f6c9a1eedeea04f7a1a
21:47:14:WU01:FS01:0x22:     Branch: HEAD
21:47:14:WU01:FS01:0x22:   Compiler: Visual C++
21:47:14:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
21:47:14:WU01:FS01:0x22:   Platform: win32 10
21:47:14:WU01:FS01:0x22:       Bits: 64
21:47:14:WU01:FS01:0x22:       Mode: Release
21:47:14:WU01:FS01:0x22:************************************ System ************************************
21:47:14:WU01:FS01:0x22:        CPU: Intel(R) Core(TM) i7-4790K CPU @ 4.00GHz
21:47:14:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
21:47:14:WU01:FS01:0x22:       CPUs: 8
21:47:14:WU01:FS01:0x22:     Memory: 15.94GiB
21:47:14:WU01:FS01:0x22:Free Memory: 11.36GiB
21:47:14:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
21:47:14:WU01:FS01:0x22: OS Version: 6.2
21:47:14:WU01:FS01:0x22:Has Battery: false
21:47:14:WU01:FS01:0x22: On Battery: false
21:47:14:WU01:FS01:0x22: UTC Offset: -5
21:47:14:WU01:FS01:0x22:        PID: 8476
21:47:14:WU01:FS01:0x22:        CWD: C:\ProgramData\FAHClient\work
21:47:14:WU01:FS01:0x22:************************************ OpenMM ************************************
21:47:14:WU01:FS01:0x22:    Version: 7.7.0
21:47:14:WU01:FS01:0x22:********************************************************************************
21:47:14:WU01:FS01:0x22:Project: 18213 (Run 20949, Clone 1, Gen 37)
21:47:14:WU01:FS01:0x22:Reading tar file core.xml
21:47:14:WU01:FS01:0x22:Reading tar file integrator.xml
21:47:14:WU01:FS01:0x22:Reading tar file state.xml
21:47:15:WU01:FS01:0x22:Reading tar file system.xml
21:47:15:WU01:FS01:0x22:Digital signatures verified
21:47:15:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
21:47:15:WU01:FS01:0x22:Version 0.0.20
21:47:15:WU01:FS01:0x22:  Checkpoint write interval: 25000 steps (2%) [50 total]
21:47:15:WU01:FS01:0x22:  JSON viewer frame write interval: 12500 steps (1%) [100 total]
21:47:15:WU01:FS01:0x22:  XTC frame write interval: 20000 steps (1.6%) [62 total]
21:47:15:WU01:FS01:0x22:  Global context and integrator variables write interval: disabled
21:47:17:WU01:FS01:0x22:There are 4 platforms available.
21:47:17:WU01:FS01:0x22:Platform 0: Reference
21:47:17:WU01:FS01:0x22:Platform 1: CPU
21:47:17:WU01:FS01:0x22:Platform 2: OpenCL
21:47:17:WU01:FS01:0x22:  opencl-device 0 specified
21:47:17:WU01:FS01:0x22:Platform 3: CUDA
21:47:17:WU01:FS01:0x22:  cuda-device 0 specified
21:47:19:WU00:FS01:Upload complete
21:47:19:WU00:FS01:Server responded WORK_ACK (400)
21:47:19:WU00:FS01:Final credit estimate, 703482.00 points
21:47:19:WU00:FS01:Cleaning up
21:47:36:WU01:FS01:0x22:Attempting to create CUDA context:
21:47:36:WU01:FS01:0x22:  Configuring platform CUDA
21:47:44:WU01:FS01:0x22:  Using CUDA and gpu 0
21:47:44:WU01:FS01:0x22:Completed 0 out of 1250000 steps (0%)
21:47:45:WU01:FS01:0x22:Checkpoint completed at step 0
21:48:15:WU01:FS01:0x22:Completed 12500 out of 1250000 steps (1%)
21:48:45:WU01:FS01:0x22:Completed 25000 out of 1250000 steps (2%)
21:48:46:WU01:FS01:0x22:Checkpoint completed at step 25000
21:49:16:WU01:FS01:0x22:Completed 37500 out of 1250000 steps (3%)
21:49:46:WU01:FS01:0x22:Completed 50000 out of 1250000 steps (4%)
21:49:47:WU01:FS01:0x22:Checkpoint completed at step 50000
21:50:17:WU01:FS01:0x22:Completed 62500 out of 1250000 steps (5%)
21:50:46:WU01:FS01:0x22:Completed 75000 out of 1250000 steps (6%)
21:50:48:WU01:FS01:0x22:Checkpoint completed at step 75000
21:51:18:WU01:FS01:0x22:Completed 87500 out of 1250000 steps (7%)
21:51:47:WU01:FS01:0x22:Completed 100000 out of 1250000 steps (8%)
21:51:49:WU01:FS01:0x22:Checkpoint completed at step 100000
21:52:19:WU01:FS01:0x22:Completed 112500 out of 1250000 steps (9%)
21:52:48:WU01:FS01:0x22:Completed 125000 out of 1250000 steps (10%)
21:52:50:WU01:FS01:0x22:Checkpoint completed at step 125000
21:53:20:WU01:FS01:0x22:Completed 137500 out of 1250000 steps (11%)
21:53:49:WU01:FS01:0x22:Completed 150000 out of 1250000 steps (12%)
21:53:51:WU01:FS01:0x22:Checkpoint completed at step 150000
21:54:21:WU01:FS01:0x22:Completed 162500 out of 1250000 steps (13%)
21:54:51:WU01:FS01:0x22:Completed 175000 out of 1250000 steps (14%)
21:54:53:WU01:FS01:0x22:Checkpoint completed at step 175000
21:55:22:WU01:FS01:0x22:Completed 187500 out of 1250000 steps (15%)
21:55:52:WU01:FS01:0x22:Completed 200000 out of 1250000 steps (16%)
21:55:54:WU01:FS01:0x22:Checkpoint completed at step 200000
21:56:23:WU01:FS01:0x22:Completed 212500 out of 1250000 steps (17%)
21:56:53:WU01:FS01:0x22:Completed 225000 out of 1250000 steps (18%)
21:56:55:WU01:FS01:0x22:Checkpoint completed at step 225000
21:57:25:WU01:FS01:0x22:Completed 237500 out of 1250000 steps (19%)
21:57:54:WU01:FS01:0x22:Completed 250000 out of 1250000 steps (20%)
21:57:56:WU01:FS01:0x22:Checkpoint completed at step 250000
21:58:26:WU01:FS01:0x22:Completed 262500 out of 1250000 steps (21%)
21:58:56:WU01:FS01:0x22:Completed 275000 out of 1250000 steps (22%)
21:58:58:WU01:FS01:0x22:Checkpoint completed at step 275000
21:59:27:WU01:FS01:0x22:Completed 287500 out of 1250000 steps (23%)
21:59:57:WU01:FS01:0x22:Completed 300000 out of 1250000 steps (24%)
21:59:59:WU01:FS01:0x22:Checkpoint completed at step 300000
22:00:28:WU01:FS01:0x22:Completed 312500 out of 1250000 steps (25%)
22:00:58:WU01:FS01:0x22:Completed 325000 out of 1250000 steps (26%)
22:01:00:WU01:FS01:0x22:Checkpoint completed at step 325000
22:01:30:WU01:FS01:0x22:Completed 337500 out of 1250000 steps (27%)
22:01:59:WU01:FS01:0x22:Completed 350000 out of 1250000 steps (28%)
22:02:01:WU01:FS01:0x22:Checkpoint completed at step 350000
22:02:31:WU01:FS01:0x22:Completed 362500 out of 1250000 steps (29%)
22:03:01:WU01:FS01:0x22:Completed 375000 out of 1250000 steps (30%)
22:03:03:WU01:FS01:0x22:Checkpoint completed at step 375000
22:03:32:WU01:FS01:0x22:Completed 387500 out of 1250000 steps (31%)
22:04:02:WU01:FS01:0x22:Completed 400000 out of 1250000 steps (32%)
22:04:04:WU01:FS01:0x22:Checkpoint completed at step 400000
22:04:34:WU01:FS01:0x22:Completed 412500 out of 1250000 steps (33%)
22:05:03:WU01:FS01:0x22:Completed 425000 out of 1250000 steps (34%)
22:05:05:WU01:FS01:0x22:Checkpoint completed at step 425000
22:05:34:WU01:FS01:0x22:Completed 437500 out of 1250000 steps (35%)
22:06:04:WU01:FS01:0x22:Completed 450000 out of 1250000 steps (36%)
22:06:06:WU01:FS01:0x22:Checkpoint completed at step 450000
22:06:36:WU01:FS01:0x22:Completed 462500 out of 1250000 steps (37%)
22:07:05:WU01:FS01:0x22:Completed 475000 out of 1250000 steps (38%)
22:07:07:WU01:FS01:0x22:Checkpoint completed at step 475000
22:07:37:WU01:FS01:0x22:Completed 487500 out of 1250000 steps (39%)
22:08:06:WU01:FS01:0x22:Completed 500000 out of 1250000 steps (40%)
22:08:08:WU01:FS01:0x22:Checkpoint completed at step 500000
22:08:38:WU01:FS01:0x22:Completed 512500 out of 1250000 steps (41%)
22:09:07:WU01:FS01:0x22:Completed 525000 out of 1250000 steps (42%)
22:09:09:WU01:FS01:0x22:Checkpoint completed at step 525000
22:09:39:WU01:FS01:0x22:Completed 537500 out of 1250000 steps (43%)
22:10:08:WU01:FS01:0x22:Completed 550000 out of 1250000 steps (44%)
22:10:10:WU01:FS01:0x22:Checkpoint completed at step 550000
22:10:40:WU01:FS01:0x22:Completed 562500 out of 1250000 steps (45%)
22:11:09:WU01:FS01:0x22:Completed 575000 out of 1250000 steps (46%)
22:11:11:WU01:FS01:0x22:Checkpoint completed at step 575000
22:11:41:WU01:FS01:0x22:Completed 587500 out of 1250000 steps (47%)
22:12:11:WU01:FS01:0x22:Completed 600000 out of 1250000 steps (48%)
22:12:13:WU01:FS01:0x22:Checkpoint completed at step 600000
22:12:42:WU01:FS01:0x22:Completed 612500 out of 1250000 steps (49%)
22:13:11:WU01:FS01:0x22:Completed 625000 out of 1250000 steps (50%)
22:13:14:WU01:FS01:0x22:Checkpoint completed at step 625000
22:13:43:WU01:FS01:0x22:Completed 637500 out of 1250000 steps (51%)
22:14:13:WU01:FS01:0x22:Completed 650000 out of 1250000 steps (52%)
22:14:15:WU01:FS01:0x22:Checkpoint completed at step 650000
22:14:44:WU01:FS01:0x22:Completed 662500 out of 1250000 steps (53%)
22:15:14:WU01:FS01:0x22:Completed 675000 out of 1250000 steps (54%)
22:15:16:WU01:FS01:0x22:Checkpoint completed at step 675000
22:15:45:WU01:FS01:0x22:Completed 687500 out of 1250000 steps (55%)
22:16:15:WU01:FS01:0x22:Completed 700000 out of 1250000 steps (56%)
22:16:17:WU01:FS01:0x22:Checkpoint completed at step 700000
22:16:46:WU01:FS01:0x22:Completed 712500 out of 1250000 steps (57%)
22:17:16:WU01:FS01:0x22:Completed 725000 out of 1250000 steps (58%)
22:17:18:WU01:FS01:0x22:Checkpoint completed at step 725000
22:17:47:WU01:FS01:0x22:Completed 737500 out of 1250000 steps (59%)
22:18:17:WU01:FS01:0x22:Completed 750000 out of 1250000 steps (60%)
22:18:19:WU01:FS01:0x22:Checkpoint completed at step 750000
22:18:48:WU01:FS01:0x22:Completed 762500 out of 1250000 steps (61%)
22:19:18:WU01:FS01:0x22:Completed 775000 out of 1250000 steps (62%)
22:19:20:WU01:FS01:0x22:Checkpoint completed at step 775000
22:19:49:WU01:FS01:0x22:Completed 787500 out of 1250000 steps (63%)
22:20:19:WU01:FS01:0x22:Completed 800000 out of 1250000 steps (64%)
22:20:21:WU01:FS01:0x22:Checkpoint completed at step 800000
22:20:50:WU01:FS01:0x22:Completed 812500 out of 1250000 steps (65%)
22:21:20:WU01:FS01:0x22:Completed 825000 out of 1250000 steps (66%)
22:21:22:WU01:FS01:0x22:Checkpoint completed at step 825000
22:21:51:WU01:FS01:0x22:Completed 837500 out of 1250000 steps (67%)
22:22:21:WU01:FS01:0x22:Completed 850000 out of 1250000 steps (68%)
22:22:23:WU01:FS01:0x22:Checkpoint completed at step 850000
22:22:53:WU01:FS01:0x22:Completed 862500 out of 1250000 steps (69%)
22:23:22:WU01:FS01:0x22:Completed 875000 out of 1250000 steps (70%)
22:23:24:WU01:FS01:0x22:Checkpoint completed at step 875000
22:23:54:WU01:FS01:0x22:Completed 887500 out of 1250000 steps (71%)
22:24:23:WU01:FS01:0x22:Completed 900000 out of 1250000 steps (72%)
22:24:25:WU01:FS01:0x22:Checkpoint completed at step 900000
22:24:55:WU01:FS01:0x22:Completed 912500 out of 1250000 steps (73%)
22:25:24:WU01:FS01:0x22:Completed 925000 out of 1250000 steps (74%)
22:25:26:WU01:FS01:0x22:Checkpoint completed at step 925000
22:25:56:WU01:FS01:0x22:Completed 937500 out of 1250000 steps (75%)
22:26:25:WU01:FS01:0x22:Completed 950000 out of 1250000 steps (76%)
22:26:27:WU01:FS01:0x22:Checkpoint completed at step 950000
22:26:57:WU01:FS01:0x22:Completed 962500 out of 1250000 steps (77%)
22:27:26:WU01:FS01:0x22:Completed 975000 out of 1250000 steps (78%)
22:27:28:WU01:FS01:0x22:Checkpoint completed at step 975000
22:27:58:WU01:FS01:0x22:Completed 987500 out of 1250000 steps (79%)
22:28:27:WU01:FS01:0x22:Completed 1000000 out of 1250000 steps (80%)
22:28:29:WU01:FS01:0x22:Checkpoint completed at step 1000000
22:28:59:WU01:FS01:0x22:Completed 1012500 out of 1250000 steps (81%)
22:29:28:WU01:FS01:0x22:Completed 1025000 out of 1250000 steps (82%)
22:29:30:WU01:FS01:0x22:Checkpoint completed at step 1025000
22:30:00:WU01:FS01:0x22:Completed 1037500 out of 1250000 steps (83%)
22:30:29:WU01:FS01:0x22:Completed 1050000 out of 1250000 steps (84%)
22:30:31:WU01:FS01:0x22:Checkpoint completed at step 1050000
22:31:01:WU01:FS01:0x22:Completed 1062500 out of 1250000 steps (85%)
22:31:30:WU01:FS01:0x22:Completed 1075000 out of 1250000 steps (86%)
22:31:32:WU01:FS01:0x22:Checkpoint completed at step 1075000
22:32:02:WU01:FS01:0x22:Completed 1087500 out of 1250000 steps (87%)
22:32:31:WU01:FS01:0x22:Completed 1100000 out of 1250000 steps (88%)
22:32:33:WU01:FS01:0x22:Checkpoint completed at step 1100000
22:33:03:WU01:FS01:0x22:Completed 1112500 out of 1250000 steps (89%)
22:33:32:WU01:FS01:0x22:Completed 1125000 out of 1250000 steps (90%)
22:33:34:WU01:FS01:0x22:Checkpoint completed at step 1125000
22:34:04:WU01:FS01:0x22:Completed 1137500 out of 1250000 steps (91%)
22:34:33:WU01:FS01:0x22:Completed 1150000 out of 1250000 steps (92%)
22:34:35:WU01:FS01:0x22:Checkpoint completed at step 1150000
22:35:05:WU01:FS01:0x22:Completed 1162500 out of 1250000 steps (93%)
22:35:34:WU01:FS01:0x22:Completed 1175000 out of 1250000 steps (94%)
22:35:36:WU01:FS01:0x22:Checkpoint completed at step 1175000
22:36:06:WU01:FS01:0x22:Completed 1187500 out of 1250000 steps (95%)
22:36:35:WU01:FS01:0x22:Completed 1200000 out of 1250000 steps (96%)
22:36:37:WU01:FS01:0x22:Checkpoint completed at step 1200000
22:37:06:WU01:FS01:0x22:Completed 1212500 out of 1250000 steps (97%)
22:37:36:WU01:FS01:0x22:Completed 1225000 out of 1250000 steps (98%)
22:37:38:WU01:FS01:0x22:Checkpoint completed at step 1225000
22:38:08:WU01:FS01:0x22:Completed 1237500 out of 1250000 steps (99%)
22:38:08:WU00:FS01:Connecting to assign1.foldingathome.org:80
22:38:08:WU00:FS01:Assigned to work server 206.223.170.146
22:38:08:WU00:FS01:Requesting new work unit for slot 01: gpu:1:0 AD102 [GeForce RTX 4090] from 206.223.170.146
22:38:08:WU00:FS01:Connecting to 206.223.170.146:8080
22:38:19:WU00:FS01:Downloading 26.58MiB
22:38:25:WU00:FS01:Download 39.03%
22:38:31:WU00:FS01:Download 74.06%
22:38:35:WU00:FS01:Download complete
22:38:35:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:18213 run:20374 clone:1 gen:37 core:0x22 unit:0x00000001000000250000472500004f96
22:38:37:WU01:FS01:0x22:Completed 1250000 out of 1250000 steps (100%)
22:38:37:WU01:FS01:0x22:Average performance: 73.2203 ns/day
22:38:39:WU01:FS01:0x22:Checkpoint completed at step 1250000
22:38:46:WU01:FS01:0x22:Saving result file ..\logfile_01.txt
22:38:46:WU01:FS01:0x22:Saving result file checkpointIntegrator.xml
22:38:46:WU01:FS01:0x22:Saving result file checkpointState.xml
22:38:50:WU01:FS01:0x22:Saving result file positions.xtc
22:38:50:WU01:FS01:0x22:Saving result file science.log
22:38:50:WU01:FS01:0x22:Saving result file xtcAtoms.csv.bz2
22:38:50:WU01:FS01:0x22:Folding@home Core Shutdown: FINISHED_UNIT
22:38:51:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
22:38:51:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:18213 run:20949 clone:1 gen:37 core:0x22 unit:0x000000010000002500004725000051d5
22:38:51:WU01:FS01:Uploading 27.50MiB to 206.223.170.146
22:38:51:WU01:FS01:Connecting to 206.223.170.146:8080
22:38:52:WU00:FS01:Starting
22:38:52:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\ProgramData\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 9720 -checkpoint 15 -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor nvidia -gpu 0 -gpu-usage 100
22:38:52:WU00:FS01:Started FahCore on PID 1424
22:38:52:WU00:FS01:Core PID:10708
22:38:52:WU00:FS01:FahCore 0x22 started
22:38:52:WU00:FS01:0x22:*********************** Log Started 2023-03-30T22:38:52Z ***********************
22:38:52:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
22:38:52:WU00:FS01:0x22:       Core: Core22
22:38:52:WU00:FS01:0x22:       Type: 0x22
22:38:52:WU00:FS01:0x22:    Version: 0.0.20
22:38:52:WU00:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
22:38:52:WU00:FS01:0x22:  Copyright: 2020 foldingathome.org
22:38:52:WU00:FS01:0x22:   Homepage: https://foldingathome.org/
22:38:52:WU00:FS01:0x22:       Date: Jan 20 2022
22:38:52:WU00:FS01:0x22:       Time: 01:15:36
22:38:52:WU00:FS01:0x22:   Revision: 3f211b8a4346514edbff34e3cb1c0e0ec951373c
22:38:52:WU00:FS01:0x22:     Branch: HEAD
22:38:52:WU00:FS01:0x22:   Compiler: Visual C++
22:38:52:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
22:38:52:WU00:FS01:0x22:             -DOPENMM_VERSION="\"7.7.0\""
22:38:52:WU00:FS01:0x22:   Platform: win32 10
22:38:52:WU00:FS01:0x22:       Bits: 64
22:38:52:WU00:FS01:0x22:       Mode: Release
22:38:52:WU00:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
22:38:52:WU00:FS01:0x22:             <peastman@stanford.edu>
22:38:52:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 1424 -checkpoint 15
22:38:52:WU00:FS01:0x22:             -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor
22:38:52:WU00:FS01:0x22:             nvidia -gpu 0 -gpu-usage 100
22:38:52:WU00:FS01:0x22:************************************ libFAH ************************************
22:38:52:WU00:FS01:0x22:       Date: Jan 20 2022
22:38:52:WU00:FS01:0x22:       Time: 01:14:17
22:38:52:WU00:FS01:0x22:   Revision: 9f4ad694e75c2350d4bb6b8b5b769ba27e483a2f
22:38:52:WU00:FS01:0x22:     Branch: HEAD
22:38:52:WU00:FS01:0x22:   Compiler: Visual C++
22:38:52:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
22:38:52:WU00:FS01:0x22:   Platform: win32 10
22:38:52:WU00:FS01:0x22:       Bits: 64
22:38:52:WU00:FS01:0x22:       Mode: Release
22:38:52:WU00:FS01:0x22:************************************ CBang *************************************
22:38:52:WU00:FS01:0x22:       Date: Jan 20 2022
22:38:52:WU00:FS01:0x22:       Time: 01:13:20
22:38:52:WU00:FS01:0x22:   Revision: ab023d155b446906d55b0f6c9a1eedeea04f7a1a
22:38:52:WU00:FS01:0x22:     Branch: HEAD
22:38:52:WU00:FS01:0x22:   Compiler: Visual C++
22:38:52:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
22:38:52:WU00:FS01:0x22:   Platform: win32 10
22:38:52:WU00:FS01:0x22:       Bits: 64
22:38:52:WU00:FS01:0x22:       Mode: Release
22:38:52:WU00:FS01:0x22:************************************ System ************************************
22:38:52:WU00:FS01:0x22:        CPU: Intel(R) Core(TM) i7-4790K CPU @ 4.00GHz
22:38:52:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
22:38:52:WU00:FS01:0x22:       CPUs: 8
22:38:52:WU00:FS01:0x22:     Memory: 15.94GiB
22:38:52:WU00:FS01:0x22:Free Memory: 11.37GiB
22:38:52:WU00:FS01:0x22:    Threads: WINDOWS_THREADS
22:38:52:WU00:FS01:0x22: OS Version: 6.2
22:38:52:WU00:FS01:0x22:Has Battery: false
22:38:52:WU00:FS01:0x22: On Battery: false
22:38:52:WU00:FS01:0x22: UTC Offset: -5
22:38:52:WU00:FS01:0x22:        PID: 10708
22:38:52:WU00:FS01:0x22:        CWD: C:\ProgramData\FAHClient\work
22:38:52:WU00:FS01:0x22:************************************ OpenMM ************************************
22:38:52:WU00:FS01:0x22:    Version: 7.7.0
22:38:52:WU00:FS01:0x22:********************************************************************************
22:38:52:WU00:FS01:0x22:Project: 18213 (Run 20374, Clone 1, Gen 37)
22:38:52:WU00:FS01:0x22:Reading tar file core.xml
22:38:52:WU00:FS01:0x22:Reading tar file integrator.xml
22:38:52:WU00:FS01:0x22:Reading tar file state.xml
22:38:53:WU00:FS01:0x22:Reading tar file system.xml
22:38:53:WU00:FS01:0x22:Digital signatures verified
22:38:53:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
22:38:53:WU00:FS01:0x22:Version 0.0.20
22:38:53:WU00:FS01:0x22:  Checkpoint write interval: 25000 steps (2%) [50 total]
22:38:53:WU00:FS01:0x22:  JSON viewer frame write interval: 12500 steps (1%) [100 total]
22:38:53:WU00:FS01:0x22:  XTC frame write interval: 20000 steps (1.6%) [62 total]
22:38:53:WU00:FS01:0x22:  Global context and integrator variables write interval: disabled
22:38:54:WU00:FS01:0x22:There are 4 platforms available.
22:38:54:WU00:FS01:0x22:Platform 0: Reference
22:38:54:WU00:FS01:0x22:Platform 1: CPU
22:38:54:WU00:FS01:0x22:Platform 2: OpenCL
22:38:54:WU00:FS01:0x22:  opencl-device 0 specified
22:38:54:WU00:FS01:0x22:Platform 3: CUDA
22:38:54:WU00:FS01:0x22:  cuda-device 0 specified
22:38:58:WU01:FS01:Upload complete
22:38:58:WU01:FS01:Server responded WORK_ACK (400)
22:38:58:WU01:FS01:Final credit estimate, 710155.00 points
22:38:58:WU01:FS01:Cleaning up
22:39:14:WU00:FS01:0x22:Attempting to create CUDA context:
22:39:14:WU00:FS01:0x22:  Configuring platform CUDA
22:39:19:WU00:FS01:0x22:  Using CUDA and gpu 0
22:39:19:WU00:FS01:0x22:Completed 0 out of 1250000 steps (0%)
22:39:20:WU00:FS01:0x22:Checkpoint completed at step 0
22:39:50:WU00:FS01:0x22:Completed 12500 out of 1250000 steps (1%)
22:40:19:WU00:FS01:0x22:Completed 25000 out of 1250000 steps (2%)
22:40:21:WU00:FS01:0x22:Checkpoint completed at step 25000
22:40:50:WU00:FS01:0x22:Completed 37500 out of 1250000 steps (3%)
22:41:19:WU00:FS01:0x22:Completed 50000 out of 1250000 steps (4%)
22:41:21:WU00:FS01:0x22:Checkpoint completed at step 50000
22:41:51:WU00:FS01:0x22:Completed 62500 out of 1250000 steps (5%)
22:42:20:WU00:FS01:0x22:Completed 75000 out of 1250000 steps (6%)
22:42:22:WU00:FS01:0x22:Checkpoint completed at step 75000
22:42:51:WU00:FS01:0x22:Completed 87500 out of 1250000 steps (7%)
22:43:21:WU00:FS01:0x22:Completed 100000 out of 1250000 steps (8%)
22:43:23:WU00:FS01:0x22:Checkpoint completed at step 100000
22:43:52:WU00:FS01:0x22:Completed 112500 out of 1250000 steps (9%)
22:44:22:WU00:FS01:0x22:Completed 125000 out of 1250000 steps (10%)
22:44:24:WU00:FS01:0x22:Checkpoint completed at step 125000
22:44:53:WU00:FS01:0x22:Completed 137500 out of 1250000 steps (11%)
22:45:22:WU00:FS01:0x22:Completed 150000 out of 1250000 steps (12%)
22:45:24:WU00:FS01:0x22:Checkpoint completed at step 150000
22:45:54:WU00:FS01:0x22:Completed 162500 out of 1250000 steps (13%)
22:46:23:WU00:FS01:0x22:Completed 175000 out of 1250000 steps (14%)
22:46:25:WU00:FS01:0x22:Checkpoint completed at step 175000
22:46:55:WU00:FS01:0x22:Completed 187500 out of 1250000 steps (15%)
22:47:24:WU00:FS01:0x22:Completed 200000 out of 1250000 steps (16%)
22:47:26:WU00:FS01:0x22:Checkpoint completed at step 200000
22:47:56:WU00:FS01:0x22:Completed 212500 out of 1250000 steps (17%)
22:48:25:WU00:FS01:0x22:Completed 225000 out of 1250000 steps (18%)
22:48:27:WU00:FS01:0x22:Checkpoint completed at step 225000
22:48:57:WU00:FS01:0x22:Completed 237500 out of 1250000 steps (19%)
22:49:26:WU00:FS01:0x22:Completed 250000 out of 1250000 steps (20%)
22:49:28:WU00:FS01:0x22:Checkpoint completed at step 250000
22:49:58:WU00:FS01:0x22:Completed 262500 out of 1250000 steps (21%)
22:50:27:WU00:FS01:0x22:Completed 275000 out of 1250000 steps (22%)
22:50:29:WU00:FS01:0x22:Checkpoint completed at step 275000
22:50:59:WU00:FS01:0x22:Completed 287500 out of 1250000 steps (23%)
22:51:28:WU00:FS01:0x22:Completed 300000 out of 1250000 steps (24%)
22:51:30:WU00:FS01:0x22:Checkpoint completed at step 300000
22:52:00:WU00:FS01:0x22:Completed 312500 out of 1250000 steps (25%)
22:52:29:WU00:FS01:0x22:Completed 325000 out of 1250000 steps (26%)
22:52:31:WU00:FS01:0x22:Checkpoint completed at step 325000
22:53:01:WU00:FS01:0x22:Completed 337500 out of 1250000 steps (27%)
22:53:30:WU00:FS01:0x22:Completed 350000 out of 1250000 steps (28%)
22:53:32:WU00:FS01:0x22:Checkpoint completed at step 350000
22:54:02:WU00:FS01:0x22:Completed 362500 out of 1250000 steps (29%)
22:54:31:WU00:FS01:0x22:Completed 375000 out of 1250000 steps (30%)
22:54:33:WU00:FS01:0x22:Checkpoint completed at step 375000
22:55:03:WU00:FS01:0x22:Completed 387500 out of 1250000 steps (31%)
22:55:32:WU00:FS01:0x22:Completed 400000 out of 1250000 steps (32%)
22:55:34:WU00:FS01:0x22:Checkpoint completed at step 400000
22:56:04:WU00:FS01:0x22:Completed 412500 out of 1250000 steps (33%)
22:56:33:WU00:FS01:0x22:Completed 425000 out of 1250000 steps (34%)
22:56:35:WU00:FS01:0x22:Checkpoint completed at step 425000
22:57:05:WU00:FS01:0x22:Completed 437500 out of 1250000 steps (35%)
22:57:35:WU00:FS01:0x22:Completed 450000 out of 1250000 steps (36%)
22:57:37:WU00:FS01:0x22:Checkpoint completed at step 450000
22:58:06:WU00:FS01:0x22:Completed 462500 out of 1250000 steps (37%)
22:58:36:WU00:FS01:0x22:Completed 475000 out of 1250000 steps (38%)
22:58:38:WU00:FS01:0x22:Checkpoint completed at step 475000
22:59:07:WU00:FS01:0x22:Completed 487500 out of 1250000 steps (39%)
22:59:37:WU00:FS01:0x22:Completed 500000 out of 1250000 steps (40%)
22:59:38:WU00:FS01:0x22:Checkpoint completed at step 500000
23:00:08:WU00:FS01:0x22:Completed 512500 out of 1250000 steps (41%)
23:00:38:WU00:FS01:0x22:Completed 525000 out of 1250000 steps (42%)
23:00:40:WU00:FS01:0x22:Checkpoint completed at step 525000
23:01:09:WU00:FS01:0x22:Completed 537500 out of 1250000 steps (43%)
23:01:39:WU00:FS01:0x22:Completed 550000 out of 1250000 steps (44%)
23:01:41:WU00:FS01:0x22:Checkpoint completed at step 550000
23:02:10:WU00:FS01:0x22:Completed 562500 out of 1250000 steps (45%)
23:02:40:WU00:FS01:0x22:Completed 575000 out of 1250000 steps (46%)
23:02:42:WU00:FS01:0x22:Checkpoint completed at step 575000
23:03:11:WU00:FS01:0x22:Completed 587500 out of 1250000 steps (47%)
23:03:41:WU00:FS01:0x22:Completed 600000 out of 1250000 steps (48%)
23:03:43:WU00:FS01:0x22:Checkpoint completed at step 600000
23:04:13:WU00:FS01:0x22:Completed 612500 out of 1250000 steps (49%)
23:04:42:WU00:FS01:0x22:Completed 625000 out of 1250000 steps (50%)
23:04:44:WU00:FS01:0x22:Checkpoint completed at step 625000
23:05:14:WU00:FS01:0x22:Completed 637500 out of 1250000 steps (51%)
23:05:44:WU00:FS01:0x22:Completed 650000 out of 1250000 steps (52%)
23:05:46:WU00:FS01:0x22:Checkpoint completed at step 650000
23:06:15:WU00:FS01:0x22:Completed 662500 out of 1250000 steps (53%)
23:06:45:WU00:FS01:0x22:Completed 675000 out of 1250000 steps (54%)
23:06:47:WU00:FS01:0x22:Checkpoint completed at step 675000
23:07:16:WU00:FS01:0x22:Completed 687500 out of 1250000 steps (55%)
23:07:46:WU00:FS01:0x22:Completed 700000 out of 1250000 steps (56%)
23:07:48:WU00:FS01:0x22:Checkpoint completed at step 700000
23:08:17:WU00:FS01:0x22:Completed 712500 out of 1250000 steps (57%)
23:08:47:WU00:FS01:0x22:Completed 725000 out of 1250000 steps (58%)
23:08:49:WU00:FS01:0x22:Checkpoint completed at step 725000
23:09:19:WU00:FS01:0x22:Completed 737500 out of 1250000 steps (59%)
23:09:48:WU00:FS01:0x22:Completed 750000 out of 1250000 steps (60%)
23:09:50:WU00:FS01:0x22:Checkpoint completed at step 750000
23:10:20:WU00:FS01:0x22:Completed 762500 out of 1250000 steps (61%)
23:10:49:WU00:FS01:0x22:Completed 775000 out of 1250000 steps (62%)
23:10:52:WU00:FS01:0x22:Checkpoint completed at step 775000
23:11:21:WU00:FS01:0x22:Completed 787500 out of 1250000 steps (63%)
23:11:51:WU00:FS01:0x22:Completed 800000 out of 1250000 steps (64%)
23:11:53:WU00:FS01:0x22:Checkpoint completed at step 800000
23:12:22:WU00:FS01:0x22:Completed 812500 out of 1250000 steps (65%)
23:12:52:WU00:FS01:0x22:Completed 825000 out of 1250000 steps (66%)
23:12:54:WU00:FS01:0x22:Checkpoint completed at step 825000
23:13:24:WU00:FS01:0x22:Completed 837500 out of 1250000 steps (67%)
23:13:53:WU00:FS01:0x22:Completed 850000 out of 1250000 steps (68%)
23:13:55:WU00:FS01:0x22:Checkpoint completed at step 850000
23:14:25:WU00:FS01:0x22:Completed 862500 out of 1250000 steps (69%)
23:14:54:WU00:FS01:0x22:Completed 875000 out of 1250000 steps (70%)
23:14:56:WU00:FS01:0x22:Checkpoint completed at step 875000
23:15:26:WU00:FS01:0x22:Completed 887500 out of 1250000 steps (71%)
23:15:56:WU00:FS01:0x22:Completed 900000 out of 1250000 steps (72%)
23:15:58:WU00:FS01:0x22:Checkpoint completed at step 900000
23:16:27:WU00:FS01:0x22:Completed 912500 out of 1250000 steps (73%)
23:16:57:WU00:FS01:0x22:Completed 925000 out of 1250000 steps (74%)
23:16:59:WU00:FS01:0x22:Checkpoint completed at step 925000
23:17:28:WU00:FS01:0x22:Completed 937500 out of 1250000 steps (75%)
23:17:58:WU00:FS01:0x22:Completed 950000 out of 1250000 steps (76%)
23:18:00:WU00:FS01:0x22:Checkpoint completed at step 950000
23:18:30:WU00:FS01:0x22:Completed 962500 out of 1250000 steps (77%)
23:18:59:WU00:FS01:0x22:Completed 975000 out of 1250000 steps (78%)
23:19:01:WU00:FS01:0x22:Checkpoint completed at step 975000
23:19:31:WU00:FS01:0x22:Completed 987500 out of 1250000 steps (79%)
23:20:01:WU00:FS01:0x22:Completed 1000000 out of 1250000 steps (80%)
23:20:03:WU00:FS01:0x22:Checkpoint completed at step 1000000
23:20:32:WU00:FS01:0x22:Completed 1012500 out of 1250000 steps (81%)
23:21:02:WU00:FS01:0x22:Completed 1025000 out of 1250000 steps (82%)
23:21:04:WU00:FS01:0x22:Checkpoint completed at step 1025000
23:21:34:WU00:FS01:0x22:Completed 1037500 out of 1250000 steps (83%)
23:22:03:WU00:FS01:0x22:Completed 1050000 out of 1250000 steps (84%)
23:22:05:WU00:FS01:0x22:Checkpoint completed at step 1050000
23:22:35:WU00:FS01:0x22:Completed 1062500 out of 1250000 steps (85%)
23:23:04:WU00:FS01:0x22:Completed 1075000 out of 1250000 steps (86%)
23:23:06:WU00:FS01:0x22:Checkpoint completed at step 1075000
23:23:36:WU00:FS01:0x22:Completed 1087500 out of 1250000 steps (87%)
23:24:05:WU00:FS01:0x22:Completed 1100000 out of 1250000 steps (88%)
23:24:07:WU00:FS01:0x22:Checkpoint completed at step 1100000
23:24:37:WU00:FS01:0x22:Completed 1112500 out of 1250000 steps (89%)
23:25:06:WU00:FS01:0x22:Completed 1125000 out of 1250000 steps (90%)
23:25:08:WU00:FS01:0x22:Checkpoint completed at step 1125000
23:25:38:WU00:FS01:0x22:Completed 1137500 out of 1250000 steps (91%)
23:26:07:WU00:FS01:0x22:Completed 1150000 out of 1250000 steps (92%)
23:26:10:WU00:FS01:0x22:Checkpoint completed at step 1150000
23:26:39:WU00:FS01:0x22:Completed 1162500 out of 1250000 steps (93%)
23:27:09:WU00:FS01:0x22:Completed 1175000 out of 1250000 steps (94%)
23:27:11:WU00:FS01:0x22:Checkpoint completed at step 1175000
23:27:40:WU00:FS01:0x22:Completed 1187500 out of 1250000 steps (95%)
23:28:10:WU00:FS01:0x22:Completed 1200000 out of 1250000 steps (96%)
23:28:12:WU00:FS01:0x22:Checkpoint completed at step 1200000
23:28:41:WU00:FS01:0x22:Completed 1212500 out of 1250000 steps (97%)
23:29:11:WU00:FS01:0x22:Completed 1225000 out of 1250000 steps (98%)
23:29:13:WU00:FS01:0x22:Checkpoint completed at step 1225000
23:29:43:WU00:FS01:0x22:Completed 1237500 out of 1250000 steps (99%)
23:29:43:WU01:FS01:Connecting to assign1.foldingathome.org:80
23:29:43:WU01:FS01:Assigned to work server 206.223.170.146
23:29:43:WU01:FS01:Requesting new work unit for slot 01: gpu:1:0 AD102 [GeForce RTX 4090] from 206.223.170.146
23:29:43:WU01:FS01:Connecting to 206.223.170.146:8080
23:29:55:WU01:FS01:Downloading 26.59MiB
23:30:01:WU01:FS01:Download 56.41%
23:30:07:WU01:FS01:Download 89.55%
23:30:10:WU01:FS01:Download complete
23:30:10:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:18213 run:22270 clone:1 gen:37 core:0x22 unit:0x000000010000002500004725000056fe
23:30:12:WU00:FS01:0x22:Completed 1250000 out of 1250000 steps (100%)
23:30:12:WU00:FS01:0x22:Average performance: 73.2203 ns/day
23:30:14:WU00:FS01:0x22:Checkpoint completed at step 1250000
23:30:21:WU00:FS01:0x22:Saving result file ..\logfile_01.txt
23:30:21:WU00:FS01:0x22:Saving result file checkpointIntegrator.xml
23:30:21:WU00:FS01:0x22:Saving result file checkpointState.xml
23:30:25:WU00:FS01:0x22:Saving result file positions.xtc
23:30:25:WU00:FS01:0x22:Saving result file science.log
23:30:25:WU00:FS01:0x22:Saving result file xtcAtoms.csv.bz2
23:30:25:WU00:FS01:0x22:Folding@home Core Shutdown: FINISHED_UNIT
23:30:26:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
23:30:26:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:18213 run:20374 clone:1 gen:37 core:0x22 unit:0x00000001000000250000472500004f96
23:30:26:WU00:FS01:Uploading 27.50MiB to 206.223.170.146
23:30:26:WU00:FS01:Connecting to 206.223.170.146:8080
23:30:26:WU01:FS01:Starting
23:30:26:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\ProgramData\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 706 -lifeline 9720 -checkpoint 15 -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor nvidia -gpu 0 -gpu-usage 100
23:30:26:WU01:FS01:Started FahCore on PID 3848
23:30:26:WU01:FS01:Core PID:1656
23:30:26:WU01:FS01:FahCore 0x22 started
23:30:27:WU01:FS01:0x22:*********************** Log Started 2023-03-30T23:30:27Z ***********************
23:30:27:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
23:30:27:WU01:FS01:0x22:       Core: Core22
23:30:27:WU01:FS01:0x22:       Type: 0x22
23:30:27:WU01:FS01:0x22:    Version: 0.0.20
23:30:27:WU01:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:30:27:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
23:30:27:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
23:30:27:WU01:FS01:0x22:       Date: Jan 20 2022
23:30:27:WU01:FS01:0x22:       Time: 01:15:36
23:30:27:WU01:FS01:0x22:   Revision: 3f211b8a4346514edbff34e3cb1c0e0ec951373c
23:30:27:WU01:FS01:0x22:     Branch: HEAD
23:30:27:WU01:FS01:0x22:   Compiler: Visual C++
23:30:27:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
23:30:27:WU01:FS01:0x22:             -DOPENMM_VERSION="\"7.7.0\""
23:30:27:WU01:FS01:0x22:   Platform: win32 10
23:30:27:WU01:FS01:0x22:       Bits: 64
23:30:27:WU01:FS01:0x22:       Mode: Release
23:30:27:WU01:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
23:30:27:WU01:FS01:0x22:             <peastman@stanford.edu>
23:30:27:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 3848 -checkpoint 15
23:30:27:WU01:FS01:0x22:             -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor
23:30:27:WU01:FS01:0x22:             nvidia -gpu 0 -gpu-usage 100
23:30:27:WU01:FS01:0x22:************************************ libFAH ************************************
23:30:27:WU01:FS01:0x22:       Date: Jan 20 2022
23:30:27:WU01:FS01:0x22:       Time: 01:14:17
23:30:27:WU01:FS01:0x22:   Revision: 9f4ad694e75c2350d4bb6b8b5b769ba27e483a2f
23:30:27:WU01:FS01:0x22:     Branch: HEAD
23:30:27:WU01:FS01:0x22:   Compiler: Visual C++
23:30:27:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
23:30:27:WU01:FS01:0x22:   Platform: win32 10
23:30:27:WU01:FS01:0x22:       Bits: 64
23:30:27:WU01:FS01:0x22:       Mode: Release
23:30:27:WU01:FS01:0x22:************************************ CBang *************************************
23:30:27:WU01:FS01:0x22:       Date: Jan 20 2022
23:30:27:WU01:FS01:0x22:       Time: 01:13:20
23:30:27:WU01:FS01:0x22:   Revision: ab023d155b446906d55b0f6c9a1eedeea04f7a1a
23:30:27:WU01:FS01:0x22:     Branch: HEAD
23:30:27:WU01:FS01:0x22:   Compiler: Visual C++
23:30:27:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
23:30:27:WU01:FS01:0x22:   Platform: win32 10
23:30:27:WU01:FS01:0x22:       Bits: 64
23:30:27:WU01:FS01:0x22:       Mode: Release
23:30:27:WU01:FS01:0x22:************************************ System ************************************
23:30:27:WU01:FS01:0x22:        CPU: Intel(R) Core(TM) i7-4790K CPU @ 4.00GHz
23:30:27:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
23:30:27:WU01:FS01:0x22:       CPUs: 8
23:30:27:WU01:FS01:0x22:     Memory: 15.94GiB
23:30:27:WU01:FS01:0x22:Free Memory: 11.28GiB
23:30:27:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
23:30:27:WU01:FS01:0x22: OS Version: 6.2
23:30:27:WU01:FS01:0x22:Has Battery: false
23:30:27:WU01:FS01:0x22: On Battery: false
23:30:27:WU01:FS01:0x22: UTC Offset: -5
23:30:27:WU01:FS01:0x22:        PID: 1656
23:30:27:WU01:FS01:0x22:        CWD: C:\ProgramData\FAHClient\work
23:30:27:WU01:FS01:0x22:************************************ OpenMM ************************************
23:30:27:WU01:FS01:0x22:    Version: 7.7.0
23:30:27:WU01:FS01:0x22:********************************************************************************
23:30:27:WU01:FS01:0x22:Project: 18213 (Run 22270, Clone 1, Gen 37)
23:30:27:WU01:FS01:0x22:Reading tar file core.xml
23:30:27:WU01:FS01:0x22:Reading tar file integrator.xml
23:30:27:WU01:FS01:0x22:Reading tar file state.xml
23:30:32:WU00:FS01:Upload 27.50%
23:30:38:WU00:FS01:Upload complete
23:30:38:WU00:FS01:Server responded WORK_ACK (400)
23:30:38:WU00:FS01:Final credit estimate, 709929.00 points
23:30:38:WU00:FS01:Cleaning up
bikeaddict
Posts: 187
Joined: Sun May 03, 2020 1:20 am

Re: Client stuck on "cleaning up"

Post by bikeaddict »

It doesn't look like "Cleaning up" is what stalls. The WU01 lines after reading state.xml should continue with something like this:

Code: Select all

00:28:47:WU01:FS00:0x22:Reading tar file system.xml
00:28:47:WU01:FS00:0x22:Digital signatures verified
00:28:47:WU01:FS00:0x22:Folding@home GPU Core22 Folding@home Core
Could maybe look for something in Event Viewer.
FoldingAddict
Posts: 3
Joined: Fri Mar 31, 2023 1:01 am

Re: Client stuck on "cleaning up"

Post by FoldingAddict »

Nothing in event viewer that stands out. Also forgot to mention that there is no noticeable stability issues with the machine. Never crashes, never hangs, never spontaneously reboots, no BSOD, GPU temps sit around 50c.

You are correct though, when I shutdown the client and delete the core, the log stops where you said it would after it downloads the core.
toTOW
Site Moderator
Posts: 6296
Joined: Sun Dec 02, 2007 10:38 am
Location: Bordeaux, France
Contact:

Re: Client stuck on "cleaning up"

Post by toTOW »

How long did you wait ?

It's not stuck on WU clean up, it's "stuck" on reading the files of the next WU ... but it might not be an issue, it can take some time ...

It could be an antivirus or a security suite interfering with FAH ...
Image

Folding@Home beta tester since 2002. Folding Forum moderator since July 2008.
FoldingAddict
Posts: 3
Joined: Fri Mar 31, 2023 1:01 am

Re: Client stuck on "cleaning up"

Post by FoldingAddict »

Waited multiple days.
Post Reply