FAH Client GPU Slot Continously failing

If you're new to FAH and need help getting started or you have very basic questions, start here.

Moderators: Site Moderators, FAHC Science Team

Post Reply
steviejason6
Posts: 6
Joined: Thu Aug 27, 2020 7:27 pm

FAH Client GPU Slot Continously failing

Post by steviejason6 »

I have re-installed, cleared appdata FAHCLIENT folder, etc. I don't know what happened but I can't complete even 1 WU with my GPU slot, it just fails over and over. PLEASE HELP!

Here is my current log

Code: Select all

19:20:06:WU06:FS01:0x22:*********************** Log Started 2020-08-27T19:20:06Z ***********************
19:20:06:WU06:FS01:0x22:*************************** Core22 Folding@home Core ***************************
19:20:06:WU06:FS01:0x22:       Core: Core22
19:20:06:WU06:FS01:0x22:       Type: 0x22
19:20:06:WU06:FS01:0x22:    Version: 0.0.11
19:20:06:WU06:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
19:20:06:WU06:FS01:0x22:  Copyright: 2020 foldingathome.org
19:20:06:WU06:FS01:0x22:   Homepage: https://foldingathome.org/
19:20:06:WU06:FS01:0x22:       Date: Jun 26 2020
19:20:06:WU06:FS01:0x22:       Time: 19:49:16
19:20:06:WU06:FS01:0x22:   Revision: 22010df8a4db48db1b35d33e666b64d8ce48689d
19:20:06:WU06:FS01:0x22:     Branch: core22-0.0.11
19:20:06:WU06:FS01:0x22:   Compiler: Visual C++ 2015
19:20:06:WU06:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
19:20:06:WU06:FS01:0x22:   Platform: win32 10
19:20:06:WU06:FS01:0x22:       Bits: 64
19:20:06:WU06:FS01:0x22:       Mode: Release
19:20:06:WU06:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
19:20:06:WU06:FS01:0x22:             <peastman@stanford.edu>
19:20:06:WU06:FS01:0x22:       Args: -dir 06 -suffix 01 -version 706 -lifeline 1788 -checkpoint 3
19:20:06:WU06:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
19:20:06:WU06:FS01:0x22:             0 -gpu 0
19:20:06:WU06:FS01:0x22:************************************ libFAH ************************************
19:20:06:WU06:FS01:0x22:       Date: Jun 26 2020
19:20:06:WU06:FS01:0x22:       Time: 19:47:12
19:20:06:WU06:FS01:0x22:   Revision: 2b383f4f04f38511dff592885d7c0400e72bdf43
19:20:06:WU06:FS01:0x22:     Branch: HEAD
19:20:06:WU06:FS01:0x22:   Compiler: Visual C++ 2015
19:20:06:WU06:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
19:20:07:WU06:FS01:0x22:   Platform: win32 10
19:20:07:WU06:FS01:0x22:       Bits: 64
19:20:07:WU06:FS01:0x22:       Mode: Release
19:20:07:WU06:FS01:0x22:************************************ CBang *************************************
19:20:07:WU06:FS01:0x22:       Date: Jun 26 2020
19:20:07:WU06:FS01:0x22:       Time: 19:46:11
19:20:07:WU06:FS01:0x22:   Revision: f8529962055b0e7bde23e429f5072ff758089dee
19:20:07:WU06:FS01:0x22:     Branch: master
19:20:07:WU06:FS01:0x22:   Compiler: Visual C++ 2015
19:20:07:WU06:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
19:20:07:WU06:FS01:0x22:   Platform: win32 10
19:20:07:WU06:FS01:0x22:       Bits: 64
19:20:07:WU06:FS01:0x22:       Mode: Release
19:20:07:WU06:FS01:0x22:************************************ System ************************************
19:20:07:WU06:FS01:0x22:        CPU: Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz
19:20:07:WU06:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 9
19:20:07:WU06:FS01:0x22:       CPUs: 8
19:20:07:WU06:FS01:0x22:     Memory: 39.94GiB
19:20:07:WU06:FS01:0x22:Free Memory: 30.01GiB
19:20:07:WU06:FS01:0x22:    Threads: WINDOWS_THREADS
19:20:07:WU06:FS01:0x22: OS Version: 6.2
19:20:07:WU06:FS01:0x22:Has Battery: false
19:20:07:WU01:FS01:Upload 83.59%
19:20:07:WU06:FS01:0x22: On Battery: false
19:20:07:WU06:FS01:0x22: UTC Offset: -7
19:20:07:WU06:FS01:0x22:        PID: 18032
19:20:07:WU06:FS01:0x22:        CWD: C:\Users\Stevi\AppData\Roaming\FAHClient\work
19:20:07:WU06:FS01:0x22:********************************************************************************
19:20:07:WU06:FS01:0x22:Project: 13422 (Run 5464, Clone 74, Gen 0)
19:20:07:WU06:FS01:0x22:Unit: 0x0000000012bc7d9a5f3a1748367b52c5
19:20:07:WU06:FS01:0x22:Reading tar file core.xml
19:20:07:WU06:FS01:0x22:Reading tar file integrator.xml
19:20:07:WU06:FS01:0x22:Reading tar file state.xml.bz2
19:20:07:WU06:FS01:0x22:Reading tar file system.xml.bz2
19:20:07:WU06:FS01:0x22:Digital signatures verified
19:20:07:WU06:FS01:0x22:Folding@home GPU Core22 Folding@home Core
19:20:07:WU06:FS01:0x22:Version 0.0.11
19:20:07:WU06:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
19:20:07:WU06:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
19:20:07:WU06:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
19:20:07:WU06:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
19:20:10:WU01:FS01:Upload complete
19:20:11:WU01:FS01:Server responded WORK_ACK (400)
19:20:11:WU01:FS01:Cleaning up
19:20:24:WU06:FS01:0x22:Completed 0 out of 1000000 steps (0%)
19:21:03:WU06:FS01:0x22:An exception occurred at step 2643: Error downloading array energySum: clEnqueueReadBuffer (-5)
19:21:03:WU06:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
19:21:03:WU06:FS01:0x22:Folding@home Core Shutdown: CORE_RESTART
19:21:04:WARNING:WU06:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
19:21:05:WU06:FS01:Starting
19:21:05:WU06:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Stevi\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.11/Core_22.fah/FahCore_22.exe -dir 06 -suffix 01 -version 706 -lifeline 24592 -checkpoint 3 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
19:21:05:WU06:FS01:Started FahCore on PID 4112
19:21:05:WU06:FS01:Core PID:24196
19:21:05:WU06:FS01:FahCore 0x22 started
19:21:05:WU06:FS01:0x22:*********************** Log Started 2020-08-27T19:21:05Z ***********************
19:21:05:WU06:FS01:0x22:*************************** Core22 Folding@home Core ***************************
19:21:05:WU06:FS01:0x22:       Core: Core22
19:21:05:WU06:FS01:0x22:       Type: 0x22
19:21:05:WU06:FS01:0x22:    Version: 0.0.11
19:21:05:WU06:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
19:21:05:WU06:FS01:0x22:  Copyright: 2020 foldingathome.org
19:21:05:WU06:FS01:0x22:   Homepage: https://foldingathome.org/
19:21:05:WU06:FS01:0x22:       Date: Jun 26 2020
19:21:05:WU06:FS01:0x22:       Time: 19:49:16
19:21:05:WU06:FS01:0x22:   Revision: 22010df8a4db48db1b35d33e666b64d8ce48689d
19:21:05:WU06:FS01:0x22:     Branch: core22-0.0.11
19:21:05:WU06:FS01:0x22:   Compiler: Visual C++ 2015
19:21:05:WU06:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
19:21:05:WU06:FS01:0x22:   Platform: win32 10
19:21:05:WU06:FS01:0x22:       Bits: 64
19:21:05:WU06:FS01:0x22:       Mode: Release
19:21:05:WU06:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
19:21:05:WU06:FS01:0x22:             <peastman@stanford.edu>
19:21:05:WU06:FS01:0x22:       Args: -dir 06 -suffix 01 -version 706 -lifeline 4112 -checkpoint 3
19:21:05:WU06:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
19:21:05:WU06:FS01:0x22:             0 -gpu 0
19:21:05:WU06:FS01:0x22:************************************ libFAH ************************************
19:21:05:WU06:FS01:0x22:       Date: Jun 26 2020
19:21:05:WU06:FS01:0x22:       Time: 19:47:12
19:21:05:WU06:FS01:0x22:   Revision: 2b383f4f04f38511dff592885d7c0400e72bdf43
19:21:05:WU06:FS01:0x22:     Branch: HEAD
19:21:05:WU06:FS01:0x22:   Compiler: Visual C++ 2015
19:21:05:WU06:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
19:21:05:WU06:FS01:0x22:   Platform: win32 10
19:21:05:WU06:FS01:0x22:       Bits: 64
19:21:05:WU06:FS01:0x22:       Mode: Release
19:21:05:WU06:FS01:0x22:************************************ CBang *************************************
19:21:05:WU06:FS01:0x22:       Date: Jun 26 2020
19:21:05:WU06:FS01:0x22:       Time: 19:46:11
19:21:05:WU06:FS01:0x22:   Revision: f8529962055b0e7bde23e429f5072ff758089dee
19:21:05:WU06:FS01:0x22:     Branch: master
19:21:05:WU06:FS01:0x22:   Compiler: Visual C++ 2015
19:21:05:WU06:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
19:21:05:WU06:FS01:0x22:   Platform: win32 10
19:21:05:WU06:FS01:0x22:       Bits: 64
19:21:05:WU06:FS01:0x22:       Mode: Release
19:21:05:WU06:FS01:0x22:************************************ System ************************************
19:21:05:WU06:FS01:0x22:        CPU: Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz
19:21:05:WU06:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 9
19:21:05:WU06:FS01:0x22:       CPUs: 8
19:21:05:WU06:FS01:0x22:     Memory: 39.94GiB
19:21:05:WU06:FS01:0x22:Free Memory: 29.99GiB
19:21:05:WU06:FS01:0x22:    Threads: WINDOWS_THREADS
19:21:05:WU06:FS01:0x22: OS Version: 6.2
19:21:05:WU06:FS01:0x22:Has Battery: false
19:21:05:WU06:FS01:0x22: On Battery: false
19:21:05:WU06:FS01:0x22: UTC Offset: -7
19:21:05:WU06:FS01:0x22:        PID: 24196
19:21:05:WU06:FS01:0x22:        CWD: C:\Users\Stevi\AppData\Roaming\FAHClient\work
19:21:05:WU06:FS01:0x22:********************************************************************************
19:21:05:WU06:FS01:0x22:Project: 13422 (Run 5464, Clone 74, Gen 0)
19:21:05:WU06:FS01:0x22:Unit: 0x0000000012bc7d9a5f3a1748367b52c5
19:21:05:WU06:FS01:0x22:Digital signatures verified
19:21:05:WU06:FS01:0x22:Folding@home GPU Core22 Folding@home Core
19:21:05:WU06:FS01:0x22:Version 0.0.11
19:21:05:WU06:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
19:21:05:WU06:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
19:21:05:WU06:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
19:21:05:WU06:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
19:21:23:WU06:FS01:0x22:Completed 0 out of 1000000 steps (0%)
19:22:39:WU06:FS01:0x22:An exception occurred at step 5252: Error downloading array energySum: clEnqueueReadBuffer (-5)
19:22:39:WU06:FS01:0x22:Max number of attempts to resume from last checkpoint (2) reached. Aborting.
19:22:39:WU06:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
19:22:39:WU06:FS01:0x22:Saving result file ..\logfile_01.txt
19:22:39:WU06:FS01:0x22:Saving result file globals.csv
19:22:39:WU06:FS01:0x22:Saving result file science.log
19:22:39:WU06:FS01:0x22:Saving result file state.xml.bz2
19:22:40:WU06:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
19:22:40:WARNING:WU06:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
19:22:40:WU06:FS01:Sending unit results: id:06 state:SEND error:FAULTY project:13422 run:5464 clone:74 gen:0 core:0x22 unit:0x0000000012bc7d9a5f3a1748367b52c5
19:22:40:WU06:FS01:Uploading 5.60MiB to 18.188.125.154
19:22:40:WU06:FS01:Connecting to 18.188.125.154:8080
19:22:46:WU06:FS01:Upload 66.98%
19:22:51:WU06:FS01:Upload complete
19:22:51:WU06:FS01:Server responded WORK_ACK (400)
19:22:51:WU06:FS01:Cleaning up
Top
steviejason6
Posts: 6
Joined: Thu Aug 27, 2020 7:27 pm

FAH Client GPU Slot Continously failing

Post by steviejason6 »

I'm not sure why but my GPU slot fails everyday now. I've validated temps, and it never gets anywhere close to max. I've uninstalled/re-installed software. Are there any experts out there that can look at the logs?
Top
gunnarre
Posts: 567
Joined: Sun May 24, 2020 7:23 pm
Location: Norway

Re: FAH Client GPU Slot Continously failing

Post by gunnarre »

Can you log out and in again and post the first 200 so lines of the log where it says stuff like this:

Code: Select all

22:54:30:******************************* System ********************************
22:54:30:        CPU: Intel(R) Core(TM) i5-4278U CPU @ 2.60GHz
22:54:30:     CPU ID: GenuineIntel Family 6 Model 69 Stepping 1
22:54:30:       CPUs: 4
22:54:30:     Memory: 8.00GiB
22:54:30:Free Memory: 4.90GiB
22:54:30:    Threads: POSIX_THREADS
22:54:30: OS Version: ?????????
22:54:30:Has Battery: true
22:54:30: On Battery: false
22:54:30: UTC Offset: 2
22:54:30:        PID: ????
22:54:30:        CWD: ?????????
22:54:30:         OS: ?????????????
22:54:30:    OS Arch: ????????????
22:54:30:       GPUs: ?????????????
22:54:30:       CUDA: ??????????????????
22:54:30:     OpenCL: ??????????????
The logs you've posted so far is only from the folding core, not from the client, and we need to see the GPU, CUDA and OpenCL lines in the System section in particular, as well as the config lines that look like this

Code: Select all

22:54:30:  <!-- Folding Slots -->
22:54:30:  <slot id='0' type='CPU'>
22:54:30:    <cpus v='2'/>
22:54:30:    <paused v='true'/>
22:54:30:  </slot>
Image
Online: GTX 1660 Super, GTX 1080, GTX 1050 Ti 4G OC, RX580 + occasional CPU folding in the cold.
Offline: Radeon HD 7770, GTX 960, GTX 950
Top
steviejason6
Posts: 6
Joined: Thu Aug 27, 2020 7:27 pm

Re: FAH Client GPU Slot Continously failing

Post by steviejason6 »

ok

Code: Select all

*********************** Log Started 2020-08-27T21:25:56Z ***********************
21:25:56:Trying to access database...
21:25:56:Successfully acquired database lock
21:25:56:Read GPUs.txt
21:25:56:Enabled folding slot 00: READY cpu:1
21:25:56:Enabled folding slot 01: READY gpu:0:GP104 [GeForce GTX 1070] 6463
21:25:56:Enabled folding slot 02: READY cpu:1
21:25:56:Enabled folding slot 03: READY cpu:1
21:25:56:Enabled folding slot 04: READY cpu:1
21:25:56:Enabled folding slot 05: READY cpu:1
21:25:56:****************************** FAHClient ******************************
21:25:56:        Version: 7.6.13
21:25:56:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
21:25:56:      Copyright: 2020 foldingathome.org
21:25:56:       Homepage: https://foldingathome.org/
21:25:56:           Date: Apr 27 2020
21:25:56:           Time: 21:21:01
21:25:56:       Revision: 5a652817f46116b6e135503af97f18e094414e3b
21:25:56:         Branch: master
21:25:56:       Compiler: Visual C++ 2008
21:25:56:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
21:25:56:       Platform: win32 10
21:25:56:           Bits: 32
21:25:56:           Mode: Release
21:25:56:           Args: --open-web-control
21:25:56:         Config: C:\Users\Stevi\AppData\Roaming\FAHClient\config.xml
21:25:56:******************************** CBang ********************************
21:25:56:           Date: Apr 24 2020
21:25:56:           Time: 17:07:55
21:25:56:       Revision: ea081a3b3b0f4a37c4d0440b4f1bc184197c7797
21:25:56:         Branch: master
21:25:56:       Compiler: Visual C++ 2008
21:25:56:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
21:25:56:       Platform: win32 10
21:25:56:           Bits: 32
21:25:56:           Mode: Release
21:25:56:******************************* System ********************************
21:25:56:            CPU: Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz
21:25:56:         CPU ID: GenuineIntel Family 6 Model 158 Stepping 9
21:25:56:           CPUs: 8
21:25:56:         Memory: 39.94GiB
21:25:56:    Free Memory: 29.01GiB
21:25:56:        Threads: WINDOWS_THREADS
21:25:56:     OS Version: 6.2
21:25:56:    Has Battery: false
21:25:56:     On Battery: false
21:25:56:     UTC Offset: -7
21:25:56:            PID: 25136
21:25:56:            CWD: C:\Users\Stevi\AppData\Roaming\FAHClient
21:25:56:  Win32 Service: false
21:25:56:             OS: Windows 10 Enterprise
21:25:56:        OS Arch: AMD64
21:25:56:           GPUs: 1
21:25:56:          GPU 0: Bus:1 Slot:0 Func:0 NVIDIA:7 GP104 [GeForce GTX 1070] 6463
21:25:56:  CUDA Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:6.1 Driver:11.0
21:25:56:OpenCL Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:1.2 Driver:452.6
21:25:56:******************************* libFAH ********************************
21:25:56:           Date: Apr 15 2020
21:25:56:           Time: 14:53:14
21:25:56:       Revision: 216968bc7025029c841ed6e36e81a03a316890d3
21:25:56:         Branch: master
21:25:56:       Compiler: Visual C++ 2008
21:25:56:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
21:25:56:       Platform: win32 10
21:25:56:           Bits: 32
21:25:56:           Mode: Release
21:25:56:***********************************************************************
21:25:57:<config>
21:25:57:  <!-- Folding Core -->
21:25:57:  <checkpoint v='3'/>
21:25:57:
21:25:57:  <!-- Folding Slot Configuration -->
21:25:57:  <cause v='COVID_19'/>
21:25:57:
21:25:57:  <!-- Network -->
21:25:57:  <proxy v=':8080'/>
21:25:57:
21:25:57:  <!-- Slot Control -->
21:25:57:  <pause-on-battery v='false'/>
21:25:57:  <power v='FULL'/>
21:25:57:
21:25:57:  <!-- User Information -->
21:25:57:  <passkey v='*****'/>
21:25:57:  <team v='246129'/>
21:25:57:  <user v='StevieJasonW'/>
21:25:57:
21:25:57:  <!-- Folding Slots -->
21:25:57:  <slot id='0' type='CPU'/>
21:25:57:  <slot id='1' type='GPU'/>
21:25:57:  <slot id='2' type='CPU'/>
21:25:57:  <slot id='3' type='CPU'/>
21:25:57:  <slot id='4' type='CPU'/>
21:25:57:  <slot id='5' type='CPU'/>
21:25:57:</config>
21:25:57:WU03:FS03:Starting
21:25:57:WU03:FS03:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Stevi\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7.exe -dir 03 -suffix 01 -version 706 -lifeline 25136 -checkpoint 3 -np 1
21:25:57:WU03:FS03:Started FahCore on PID 19980
21:25:57:WU03:FS03:Core PID:10920
21:25:57:WU03:FS03:FahCore 0xa7 started
21:25:57:WU02:FS02:Starting
21:25:57:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Stevi\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7.exe -dir 02 -suffix 01 -version 706 -lifeline 25136 -checkpoint 3 -np 1
21:25:57:WU02:FS02:Started FahCore on PID 22080
21:25:57:WU02:FS02:Core PID:18428
21:25:57:WU02:FS02:FahCore 0xa7 started
21:25:57:WU00:FS00:Starting
21:25:57:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Stevi\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7.exe -dir 00 -suffix 01 -version 706 -lifeline 25136 -checkpoint 3 -np 1
21:25:57:WU00:FS00:Started FahCore on PID 1636
21:25:57:WU00:FS00:Core PID:27404
21:25:57:WU00:FS00:FahCore 0xa7 started
21:25:57:WU03:FS03:0xa7:*********************** Log Started 2020-08-27T21:25:57Z ***********************
21:25:57:WU03:FS03:0xa7:************************** Gromacs Folding@home Core ***************************
21:25:57:WU03:FS03:0xa7:       Type: 0xa7
21:25:57:WU03:FS03:0xa7:       Core: Gromacs
21:25:57:WU03:FS03:0xa7:       Args: -dir 03 -suffix 01 -version 706 -lifeline 19980 -checkpoint 3 -np 1
21:25:57:WU03:FS03:0xa7:************************************ CBang *************************************
21:25:57:WU03:FS03:0xa7:       Date: Nov 27 2019
21:25:57:WU03:FS03:0xa7:       Time: 03:40:09
21:25:57:WU03:FS03:0xa7:   Revision: d25803215b59272441049dfa05a0a9bf7a6e3c48
21:25:57:WU03:FS03:0xa7:     Branch: master
21:25:57:WU04:FS04:Starting
21:25:57:WU03:FS03:0xa7:   Compiler: Visual C++ 2008
21:25:57:WU04:FS04:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Stevi\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7.exe -dir 04 -suffix 01 -version 706 -lifeline 25136 -checkpoint 3 -np 1
21:25:57:WU03:FS03:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
21:25:57:WU03:FS03:0xa7:   Platform: win32 10
21:25:57:WU03:FS03:0xa7:       Bits: 64
21:25:57:WU03:FS03:0xa7:       Mode: Release
21:25:57:WU03:FS03:0xa7:************************************ System ************************************
21:25:57:WU04:FS04:Started FahCore on PID 10596
21:25:57:WU03:FS03:0xa7:        CPU: Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz
21:25:57:WU03:FS03:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 9
21:25:57:WU03:FS03:0xa7:       CPUs: 8
21:25:57:WU03:FS03:0xa7:     Memory: 39.94GiB
21:25:57:WU03:FS03:0xa7:Free Memory: 29.00GiB
21:25:57:WU03:FS03:0xa7:    Threads: WINDOWS_THREADS
21:25:57:WU03:FS03:0xa7: OS Version: 6.2
21:25:57:WU03:FS03:0xa7:Has Battery: false
21:25:57:WU03:FS03:0xa7: On Battery: false
21:25:57:WU03:FS03:0xa7: UTC Offset: -7
21:25:57:WU03:FS03:0xa7:        PID: 10920
21:25:57:WU04:FS04:Core PID:24356
21:25:57:WU03:FS03:0xa7:        CWD: C:\Users\Stevi\AppData\Roaming\FAHClient\work
21:25:57:WU04:FS04:FahCore 0xa7 started
21:25:57:WU03:FS03:0xa7:******************************** Build - libFAH ********************************
21:25:57:WU03:FS03:0xa7:    Version: 0.0.19
21:25:57:WU03:FS03:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
21:25:57:WU03:FS03:0xa7:  Copyright: 2019 foldingathome.org
21:25:57:WU03:FS03:0xa7:   Homepage: https://foldingathome.org/
21:25:57:WU03:FS03:0xa7:       Date: Nov 25 2019
21:25:57:WU03:FS03:0xa7:       Time: 17:12:41
21:25:57:WU03:FS03:0xa7:   Revision: d5b5c747532224f986b7cd02c968ed9a20c16d6e
21:25:57:WU03:FS03:0xa7:     Branch: master
21:25:57:WU03:FS03:0xa7:   Compiler: Visual C++ 2008
21:25:57:WU03:FS03:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
21:25:57:WU03:FS03:0xa7:   Platform: win32 10
21:25:57:WU03:FS03:0xa7:       Bits: 64
21:25:57:WU03:FS03:0xa7:       Mode: Release
21:25:57:WU03:FS03:0xa7:************************************ Build *************************************
21:25:57:WU03:FS03:0xa7:       SIMD: avx_256
21:25:57:WU03:FS03:0xa7:********************************************************************************
21:25:57:WU03:FS03:0xa7:Project: 14803 (Run 1659, Clone 0, Gen 154)
21:25:57:WU03:FS03:0xa7:Unit: 0x000000b703159d0b5eb38356d350567b
21:25:57:WU03:FS03:0xa7:Digital signatures verified
21:25:57:WU03:FS03:0xa7:Calling: mdrun -s frame154.tpr -o frame154.trr -cpi state.cpt -cpt 3 -nt 1
21:25:57:WU03:FS03:0xa7:Steps: first=0 total=250000
21:25:57:WU02:FS02:0xa7:*********************** Log Started 2020-08-27T21:25:57Z ***********************
21:25:57:WU02:FS02:0xa7:************************** Gromacs Folding@home Core ***************************
21:25:57:WU02:FS02:0xa7:       Type: 0xa7
21:25:57:WU02:FS02:0xa7:       Core: Gromacs
21:25:57:WU02:FS02:0xa7:       Args: -dir 02 -suffix 01 -version 706 -lifeline 22080 -checkpoint 3 -np 1
21:25:57:WU02:FS02:0xa7:************************************ CBang *************************************
21:25:57:WU05:FS05:Starting
21:25:57:WU02:FS02:0xa7:       Date: Nov 27 2019
21:25:57:WU02:FS02:0xa7:       Time: 03:40:09
21:25:57:WU05:FS05:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Stevi\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7.exe -dir 05 -suffix 01 -version 706 -lifeline 25136 -checkpoint 3 -np 1
21:25:57:WU02:FS02:0xa7:   Revision: d25803215b59272441049dfa05a0a9bf7a6e3c48
21:25:57:WU02:FS02:0xa7:     Branch: master
21:25:57:WU02:FS02:0xa7:   Compiler: Visual C++ 2008
21:25:57:WU02:FS02:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
21:25:57:WU02:FS02:0xa7:   Platform: win32 10
21:25:57:WU02:FS02:0xa7:       Bits: 64
21:25:57:WU05:FS05:Started FahCore on PID 24496
21:25:57:WU02:FS02:0xa7:       Mode: Release
21:25:57:WU02:FS02:0xa7:************************************ System ************************************
21:25:57:WU02:FS02:0xa7:        CPU: Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz
21:25:57:WU02:FS02:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 9
21:25:57:WU02:FS02:0xa7:       CPUs: 8
21:25:57:WU02:FS02:0xa7:     Memory: 39.94GiB
21:25:57:WU02:FS02:0xa7:Free Memory: 28.96GiB
21:25:57:WU02:FS02:0xa7:    Threads: WINDOWS_THREADS
21:25:57:WU02:FS02:0xa7: OS Version: 6.2
21:25:57:WU02:FS02:0xa7:Has Battery: false
21:25:57:WU02:FS02:0xa7: On Battery: false
21:25:57:WU02:FS02:0xa7: UTC Offset: -7
21:25:57:WU02:FS02:0xa7:        PID: 18428
21:25:57:WU05:FS05:Core PID:10832
21:25:57:WU02:FS02:0xa7:        CWD: C:\Users\Stevi\AppData\Roaming\FAHClient\work
21:25:57:WU05:FS05:FahCore 0xa7 started
21:25:57:WU02:FS02:0xa7:******************************** Build - libFAH ********************************
21:25:57:WU02:FS02:0xa7:    Version: 0.0.19
21:25:57:WU02:FS02:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
21:25:57:WU02:FS02:0xa7:  Copyright: 2019 foldingathome.org
21:25:57:WU02:FS02:0xa7:   Homepage: https://foldingathome.org/
21:25:57:WU02:FS02:0xa7:       Date: Nov 25 2019
21:25:57:WU02:FS02:0xa7:       Time: 17:12:41
21:25:57:WU02:FS02:0xa7:   Revision: d5b5c747532224f986b7cd02c968ed9a20c16d6e
21:25:57:WU02:FS02:0xa7:     Branch: master
21:25:57:WU02:FS02:0xa7:   Compiler: Visual C++ 2008
21:25:57:WU02:FS02:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
21:25:57:WU02:FS02:0xa7:   Platform: win32 10
21:25:57:WU02:FS02:0xa7:       Bits: 64
21:25:57:WU02:FS02:0xa7:       Mode: Release
21:25:57:WU02:FS02:0xa7:************************************ Build *************************************
21:25:57:WU02:FS02:0xa7:       SIMD: avx_256
21:25:57:WU02:FS02:0xa7:********************************************************************************
21:25:57:WU02:FS02:0xa7:Project: 14703 (Run 2630, Clone 0, Gen 143)
21:25:57:WU02:FS02:0xa7:Unit: 0x000000a803159d0b5eb157c33587b8d8
21:25:57:WU02:FS02:0xa7:Digital signatures verified
21:25:57:WU02:FS02:0xa7:Calling: mdrun -s frame143.tpr -o frame143.trr -cpi state.cpt -cpt 3 -nt 1
21:25:57:WU02:FS02:0xa7:Steps: first=0 total=250000
21:25:57:WU00:FS00:0xa7:*********************** Log Started 2020-08-27T21:25:57Z ***********************
21:25:57:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
21:25:57:WU00:FS00:0xa7:       Type: 0xa7
21:25:57:WU00:FS00:0xa7:       Core: Gromacs
21:25:57:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 706 -lifeline 1636 -checkpoint 3 -np 1
21:25:58:WU00:FS00:0xa7:************************************ CBang *************************************
21:25:58:WU00:FS00:0xa7:       Date: Nov 27 2019
21:25:58:WU00:FS00:0xa7:       Time: 03:40:09
21:25:58:WU00:FS00:0xa7:   Revision: d25803215b59272441049dfa05a0a9bf7a6e3c48
21:25:58:WU00:FS00:0xa7:     Branch: master
21:25:58:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
21:25:58:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
21:25:58:WU00:FS00:0xa7:   Platform: win32 10
21:25:58:WU00:FS00:0xa7:       Bits: 64
21:25:58:WU00:FS00:0xa7:       Mode: Release
21:25:58:WU00:FS00:0xa7:************************************ System ************************************
21:25:58:WU00:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz
21:25:58:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 9
21:25:58:WU00:FS00:0xa7:       CPUs: 8
21:25:58:WU00:FS00:0xa7:     Memory: 39.94GiB
21:25:58:WU00:FS00:0xa7:Free Memory: 28.92GiB
21:25:58:WU00:FS00:0xa7:    Threads: WINDOWS_THREADS
21:25:58:WU00:FS00:0xa7: OS Version: 6.2
21:25:58:WU00:FS00:0xa7:Has Battery: false
21:25:58:WU00:FS00:0xa7: On Battery: false
21:25:58:WU00:FS00:0xa7: UTC Offset: -7
21:25:58:WU00:FS00:0xa7:        PID: 27404
21:25:58:WU00:FS00:0xa7:        CWD: C:\Users\Stevi\AppData\Roaming\FAHClient\work
21:25:58:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
21:25:58:WU00:FS00:0xa7:    Version: 0.0.19
21:25:58:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
21:25:58:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
21:25:58:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
21:25:58:WU00:FS00:0xa7:       Date: Nov 25 2019
21:25:58:WU00:FS00:0xa7:       Time: 17:12:41
21:25:58:WU00:FS00:0xa7:   Revision: d5b5c747532224f986b7cd02c968ed9a20c16d6e
21:25:58:WU00:FS00:0xa7:     Branch: master
21:25:58:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
21:25:58:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
21:25:58:WU00:FS00:0xa7:   Platform: win32 10
21:25:58:WU00:FS00:0xa7:       Bits: 64
21:25:58:WU00:FS00:0xa7:       Mode: Release
21:25:58:WU00:FS00:0xa7:************************************ Build *************************************
21:25:58:WU00:FS00:0xa7:       SIMD: avx_256
21:25:58:WU00:FS00:0xa7:********************************************************************************
21:25:58:WU00:FS00:0xa7:Project: 14803 (Run 2432, Clone 0, Gen 131)
21:25:58:WU00:FS00:0xa7:Unit: 0x0000009d03159d0b5eb381a40d2f9c52
21:25:58:WU00:FS00:0xa7:Digital signatures verified
21:25:58:WU00:FS00:0xa7:Calling: mdrun -s frame131.tpr -o frame131.trr -cpi state.cpt -cpt 3 -nt 1
21:25:58:WU00:FS00:0xa7:Steps: first=0 total=250000
21:25:58:WU03:FS03:0xa7:Completed 87058 out of 250000 steps (34%)
21:25:58:WU04:FS04:0xa7:*********************** Log Started 2020-08-27T21:25:57Z ***********************
21:25:58:WU04:FS04:0xa7:************************** Gromacs Folding@home Core ***************************
21:25:58:WU04:FS04:0xa7:       Type: 0xa7
21:25:58:WU04:FS04:0xa7:       Core: Gromacs
21:25:58:WU04:FS04:0xa7:       Args: -dir 04 -suffix 01 -version 706 -lifeline 10596 -checkpoint 3 -np 1
21:25:58:WU04:FS04:0xa7:************************************ CBang *************************************
21:25:58:WU04:FS04:0xa7:       Date: Nov 27 2019
21:25:58:WU04:FS04:0xa7:       Time: 03:40:09
21:25:58:WU04:FS04:0xa7:   Revision: d25803215b59272441049dfa05a0a9bf7a6e3c48
21:25:58:WU04:FS04:0xa7:     Branch: master
21:25:58:WU04:FS04:0xa7:   Compiler: Visual C++ 2008
21:25:58:WU04:FS04:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
21:25:58:WU04:FS04:0xa7:   Platform: win32 10
21:25:58:WU04:FS04:0xa7:       Bits: 64
21:25:58:WU04:FS04:0xa7:       Mode: Release
21:25:58:WU04:FS04:0xa7:************************************ System ************************************
21:25:58:WU04:FS04:0xa7:        CPU: Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz
21:25:58:WU04:FS04:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 9
21:25:58:WU04:FS04:0xa7:       CPUs: 8
21:25:58:WU04:FS04:0xa7:     Memory: 39.94GiB
21:25:58:WU04:FS04:0xa7:Free Memory: 28.89GiB
21:25:58:WU04:FS04:0xa7:    Threads: WINDOWS_THREADS
21:25:58:WU04:FS04:0xa7: OS Version: 6.2
21:25:58:WU04:FS04:0xa7:Has Battery: false
21:25:58:WU04:FS04:0xa7: On Battery: false
21:25:58:WU04:FS04:0xa7: UTC Offset: -7
21:25:58:WU04:FS04:0xa7:        PID: 24356
21:25:58:WU04:FS04:0xa7:        CWD: C:\Users\Stevi\AppData\Roaming\FAHClient\work
21:25:58:WU04:FS04:0xa7:******************************** Build - libFAH ********************************
21:25:58:WU04:FS04:0xa7:    Version: 0.0.19
21:25:58:WU04:FS04:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
21:25:58:WU04:FS04:0xa7:  Copyright: 2019 foldingathome.org
21:25:58:WU04:FS04:0xa7:   Homepage: https://foldingathome.org/
21:25:58:WU04:FS04:0xa7:       Date: Nov 25 2019
21:25:58:WU02:FS02:0xa7:Completed 87095 out of 250000 steps (34%)
21:25:58:WU04:FS04:0xa7:       Time: 17:12:41
21:25:58:WU04:FS04:0xa7:   Revision: d5b5c747532224f986b7cd02c968ed9a20c16d6e
21:25:58:WU04:FS04:0xa7:     Branch: master
21:25:58:WU04:FS04:0xa7:   Compiler: Visual C++ 2008
21:25:58:WU04:FS04:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
21:25:58:WU04:FS04:0xa7:   Platform: win32 10
21:25:58:WU04:FS04:0xa7:       Bits: 64
21:25:58:WU04:FS04:0xa7:       Mode: Release
21:25:58:WU04:FS04:0xa7:************************************ Build *************************************
21:25:58:WU04:FS04:0xa7:       SIMD: avx_256
21:25:58:WU04:FS04:0xa7:********************************************************************************
21:25:58:WU04:FS04:0xa7:Project: 14806 (Run 254, Clone 0, Gen 84)
21:25:58:WU04:FS04:0xa7:Unit: 0x0000006303159d0b5ec01795420d9309
21:25:58:WU04:FS04:0xa7:Digital signatures verified
21:25:58:WU04:FS04:0xa7:Calling: mdrun -s frame84.tpr -o frame84.trr -cpi state.cpt -cpt 3 -nt 1
21:25:58:WU04:FS04:0xa7:Steps: first=0 total=250000
21:25:58:WU05:FS05:0xa7:*********************** Log Started 2020-08-27T21:25:57Z ***********************
21:25:58:WU05:FS05:0xa7:************************** Gromacs Folding@home Core ***************************
21:25:58:WU05:FS05:0xa7:       Type: 0xa7
21:25:58:WU05:FS05:0xa7:       Core: Gromacs
21:25:58:WU05:FS05:0xa7:       Args: -dir 05 -suffix 01 -version 706 -lifeline 24496 -checkpoint 3 -np 1
21:25:58:WU05:FS05:0xa7:************************************ CBang *************************************
21:25:58:WU05:FS05:0xa7:       Date: Nov 27 2019
21:25:58:WU05:FS05:0xa7:       Time: 03:40:09
21:25:58:WU05:FS05:0xa7:   Revision: d25803215b59272441049dfa05a0a9bf7a6e3c48
21:25:58:WU05:FS05:0xa7:     Branch: master
21:25:58:WU05:FS05:0xa7:   Compiler: Visual C++ 2008
21:25:58:WU05:FS05:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
21:25:58:WU05:FS05:0xa7:   Platform: win32 10
21:25:58:WU05:FS05:0xa7:       Bits: 64
21:25:58:WU05:FS05:0xa7:       Mode: Release
21:25:58:WU05:FS05:0xa7:************************************ System ************************************
21:25:58:WU05:FS05:0xa7:        CPU: Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz
21:25:58:WU05:FS05:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 9
21:25:58:WU05:FS05:0xa7:       CPUs: 8
21:25:58:WU05:FS05:0xa7:     Memory: 39.94GiB
21:25:58:WU05:FS05:0xa7:Free Memory: 28.84GiB
21:25:58:WU05:FS05:0xa7:    Threads: WINDOWS_THREADS
21:25:58:WU05:FS05:0xa7: OS Version: 6.2
21:25:58:WU05:FS05:0xa7:Has Battery: false
21:25:58:WU05:FS05:0xa7: On Battery: false
21:25:58:WU05:FS05:0xa7: UTC Offset: -7
21:25:58:WU05:FS05:0xa7:        PID: 10832
21:25:58:WU05:FS05:0xa7:        CWD: C:\Users\Stevi\AppData\Roaming\FAHClient\work
21:25:58:WU05:FS05:0xa7:******************************** Build - libFAH ********************************
21:25:58:WU05:FS05:0xa7:    Version: 0.0.19
21:25:58:WU05:FS05:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
21:25:58:WU05:FS05:0xa7:  Copyright: 2019 foldingathome.org
21:25:58:WU05:FS05:0xa7:   Homepage: https://foldingathome.org/
21:25:58:WU05:FS05:0xa7:       Date: Nov 25 2019
21:25:58:WU05:FS05:0xa7:       Time: 17:12:41
21:25:58:WU05:FS05:0xa7:   Revision: d5b5c747532224f986b7cd02c968ed9a20c16d6e
21:25:58:WU05:FS05:0xa7:     Branch: master
21:25:58:WU05:FS05:0xa7:   Compiler: Visual C++ 2008
21:25:58:WU05:FS05:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
21:25:58:WU05:FS05:0xa7:   Platform: win32 10
21:25:58:WU05:FS05:0xa7:       Bits: 64
21:25:58:WU05:FS05:0xa7:       Mode: Release
21:25:58:WU05:FS05:0xa7:************************************ Build *************************************
21:25:58:WU05:FS05:0xa7:       SIMD: avx_256
21:25:58:WU05:FS05:0xa7:********************************************************************************
21:25:58:WU05:FS05:0xa7:Project: 16423 (Run 3599, Clone 3, Gen 15)
21:25:58:WU05:FS05:0xa7:Unit: 0x0000001196880e6e5e8a8c9d98a7ed6b
21:25:58:WU05:FS05:0xa7:Digital signatures verified
21:25:58:WU05:FS05:0xa7:Calling: mdrun -s frame15.tpr -o frame15.trr -x frame15.xtc -cpi state.cpt -cpt 3 -nt 1
21:25:58:WU05:FS05:0xa7:Steps: first=3750000 total=250000
21:25:58:WU00:FS00:0xa7:Completed 89389 out of 250000 steps (35%)
21:25:58:WU05:FS05:0xa7:Completed 157822 out of 250000 steps (63%)
21:25:58:WU04:FS04:0xa7:Completed 89011 out of 250000 steps (35%)
21:26:04:WU01:FS01:Connecting to assign1.foldingathome.org:80
21:26:05:WU01:FS01:Assigned to work server 18.188.125.154
21:26:05:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1070] 6463 from 18.188.125.154
21:26:05:WU01:FS01:Connecting to 18.188.125.154:8080
21:26:09:WU01:FS01:Downloading 6.17MiB
21:26:10:WU01:FS01:Download complete
21:26:10:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13422 run:5403 clone:98 gen:1 core:0x22 unit:0x0000000212bc7d9a5f3a1744d350ab48
21:26:10:WU01:FS01:Starting
21:26:10:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Stevi\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.11/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 706 -lifeline 25136 -checkpoint 3 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
21:26:10:WU01:FS01:Started FahCore on PID 27304
21:26:10:WU01:FS01:Core PID:25428
21:26:10:WU01:FS01:FahCore 0x22 started
21:26:11:WU01:FS01:0x22:*********************** Log Started 2020-08-27T21:26:11Z ***********************
21:26:11:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
21:26:11:WU01:FS01:0x22:       Core: Core22
21:26:11:WU01:FS01:0x22:       Type: 0x22
21:26:11:WU01:FS01:0x22:    Version: 0.0.11
21:26:11:WU01:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
21:26:11:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
21:26:11:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
21:26:11:WU01:FS01:0x22:       Date: Jun 26 2020
21:26:11:WU01:FS01:0x22:       Time: 19:49:16
21:26:11:WU01:FS01:0x22:   Revision: 22010df8a4db48db1b35d33e666b64d8ce48689d
21:26:11:WU01:FS01:0x22:     Branch: core22-0.0.11
21:26:11:WU01:FS01:0x22:   Compiler: Visual C++ 2015
21:26:11:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
21:26:11:WU01:FS01:0x22:   Platform: win32 10
21:26:11:WU01:FS01:0x22:       Bits: 64
21:26:11:WU01:FS01:0x22:       Mode: Release
21:26:11:WU01:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
21:26:11:WU01:FS01:0x22:             <peastman@stanford.edu>
21:26:11:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 27304 -checkpoint 3
21:26:11:WU01:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
21:26:11:WU01:FS01:0x22:             0 -gpu 0
21:26:11:WU01:FS01:0x22:************************************ libFAH ************************************
21:26:11:WU01:FS01:0x22:       Date: Jun 26 2020
21:26:11:WU01:FS01:0x22:       Time: 19:47:12
21:26:11:WU01:FS01:0x22:   Revision: 2b383f4f04f38511dff592885d7c0400e72bdf43
21:26:11:WU01:FS01:0x22:     Branch: HEAD
21:26:11:WU01:FS01:0x22:   Compiler: Visual C++ 2015
21:26:11:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
21:26:11:WU01:FS01:0x22:   Platform: win32 10
21:26:11:WU01:FS01:0x22:       Bits: 64
21:26:11:WU01:FS01:0x22:       Mode: Release
21:26:11:WU01:FS01:0x22:************************************ CBang *************************************
21:26:11:WU01:FS01:0x22:       Date: Jun 26 2020
21:26:11:WU01:FS01:0x22:       Time: 19:46:11
21:26:11:WU01:FS01:0x22:   Revision: f8529962055b0e7bde23e429f5072ff758089dee
21:26:11:WU01:FS01:0x22:     Branch: master
21:26:11:WU01:FS01:0x22:   Compiler: Visual C++ 2015
21:26:11:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
21:26:11:WU01:FS01:0x22:   Platform: win32 10
21:26:11:WU01:FS01:0x22:       Bits: 64
21:26:11:WU01:FS01:0x22:       Mode: Release
21:26:11:WU01:FS01:0x22:************************************ System ************************************
21:26:11:WU01:FS01:0x22:        CPU: Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz
21:26:11:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 9
21:26:11:WU01:FS01:0x22:       CPUs: 8
21:26:11:WU01:FS01:0x22:     Memory: 39.94GiB
21:26:11:WU01:FS01:0x22:Free Memory: 28.69GiB
21:26:11:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
21:26:11:WU01:FS01:0x22: OS Version: 6.2
21:26:11:WU01:FS01:0x22:Has Battery: false
21:26:11:WU01:FS01:0x22: On Battery: false
21:26:11:WU01:FS01:0x22: UTC Offset: -7
21:26:11:WU01:FS01:0x22:        PID: 25428
21:26:11:WU01:FS01:0x22:        CWD: C:\Users\Stevi\AppData\Roaming\FAHClient\work
21:26:11:WU01:FS01:0x22:********************************************************************************
21:26:11:WU01:FS01:0x22:Project: 13422 (Run 5403, Clone 98, Gen 1)
21:26:11:WU01:FS01:0x22:Unit: 0x0000000212bc7d9a5f3a1744d350ab48
21:26:11:WU01:FS01:0x22:Reading tar file core.xml
21:26:11:WU01:FS01:0x22:Reading tar file integrator.xml
21:26:11:WU01:FS01:0x22:Reading tar file state.xml.bz2
21:26:11:WU01:FS01:0x22:Reading tar file system.xml.bz2
21:26:11:WU01:FS01:0x22:Digital signatures verified
21:26:11:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
21:26:11:WU01:FS01:0x22:Version 0.0.11
21:26:11:WU01:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
21:26:11:WU01:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
21:26:11:WU01:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
21:26:11:WU01:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
21:26:31:WU01:FS01:0x22:Completed 0 out of 1000000 steps (0%)
Mod Edit: Added Code Tags - PantherX
Top
Neil-B
Posts: 2027
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: FAH Client GPU Slot Continously failing

Post by Neil-B »

Someone will hopefully be able to help with the GPU issue ... but in the mean time - It would be best to run a single CPU slot (either a 6 or in heat/noise is an issue then 46 threads - 5 isn't a good number) rather than those 5 single thread slots - speed of return of WU is important to the science and so lots of single thread slots are less helpful than a single multithread slot.

Best way to achieve this would be to put all of them on Finish then once the current WUs are completed delete four of them and edit the final one to have the desired thread count - finally unpause the slot and let it fold
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070
(Green/Bold = Active)
Top
Neil-B
Posts: 2027
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: FAH Client GPU Slot Continously failing

Post by Neil-B »

Have all the fails on the GPU been on the same WU failing over and over again or is it failing every WU it downloads? ... If the first you might have been caught by an issue where multiple failures on the same WU which should cause it to be returned to the server failed doesn't work - and someone should be able to assist you with that ... The second may be a tad harder to diagnose/resolve but hopefully someone will be able to help (apologies I am mainly a CPU folder).
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070
(Green/Bold = Active)
Top
steviejason6
Posts: 6
Joined: Thu Aug 27, 2020 7:27 pm

Re: FAH Client GPU Slot Continously failing

Post by steviejason6 »

Yeah only GPU fails. I'll try just the 2 slots too. This is really strange.
Top
Neil-B
Posts: 2027
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: FAH Client GPU Slot Continously failing

Post by Neil-B »

... but is it always just re-failing the same WU or is it getting new WUs and failing those? ... worst case scenario on the first is it will keep retrying/re-failing until the expiration deadline is reached at which point the client should dump it and get a fresh one (there are quicker ways to sort this though) ... if it is failing each and every WU it downloads it will need someone much better than I to help you
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070
(Green/Bold = Active)
Top
steviejason6
Posts: 6
Joined: Thu Aug 27, 2020 7:27 pm

Re: FAH Client GPU Slot Continously failing

Post by steviejason6 »

Neil-B wrote:Someone will hopefully be able to help with the GPU issue ... but in the mean time - It would be best to run a single CPU slot (either a 6 or in heat/noise is an issue then 46 threads - 5 isn't a good number) rather than those 5 single thread slots - speed of return of WU is important to the science and so lots of single thread slots are less helpful than a single multithread slot.

Best way to achieve this would be to put all of them on Finish then once the current WUs are completed delete four of them and edit the final one to have the desired thread count - finally unpause the slot and let it fold
I will try the finish option as well, thank you!
Top
steviejason6
Posts: 6
Joined: Thu Aug 27, 2020 7:27 pm

Re: FAH Client GPU Slot Continously failing

Post by steviejason6 »

Seems like it keeps restarting or starting a new WU

Code: Select all

*********************** Log Started 2020-08-27T21:25:56Z ***********************
21:27:28:WU01:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
21:27:29:WARNING:WU01:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
21:28:38:WU01:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
21:28:39:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
21:30:18:WU06:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
21:30:19:WARNING:WU06:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
21:30:47:WU06:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
21:30:50:WARNING:WU06:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
21:31:22:WU01:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
21:31:23:WARNING:WU01:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
21:32:31:WU01:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
21:32:33:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
21:33:33:WU06:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
21:33:34:WARNING:WU06:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
21:34:49:WU06:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
21:34:51:WARNING:WU06:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
21:36:00:WU01:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
21:36:02:WARNING:WU01:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
21:37:55:WU01:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
21:37:57:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
21:39:03:WU06:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
21:39:04:WARNING:WU06:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
21:40:27:WU02:FS02:0xa7:WARNING:Console control signal 1 on PID 18428
21:40:27:WU05:FS05:0xa7:WARNING:Console control signal 1 on PID 10832
21:40:27:WU03:FS03:0xa7:WARNING:Console control signal 1 on PID 10920
21:40:27:WU04:FS04:0xa7:WARNING:Console control signal 1 on PID 24356
21:40:27:WU00:FS00:0xa7:WARNING:Console control signal 1 on PID 27404
21:40:30:WARNING:WU05:Slot ID 5 no longer exists, migrating to FS00
21:40:30:WARNING:WU05:Changed SMP threads from 1 to 7 this can cause some work units to fail
21:40:30:WARNING:WU05:AS lowered CPUs from 7 to 1
21:40:30:WARNING:WU03:Slot ID 3 no longer exists, migrating to FS00
21:40:30:WARNING:WU02:Slot ID 2 no longer exists, migrating to FS00
21:40:30:WARNING:WU04:Slot ID 4 no longer exists, migrating to FS00
21:43:37:WU06:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
21:43:38:WARNING:WU06:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
21:48:09:WU01:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
21:48:09:WARNING:WU01:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
Mod Edit: Added Code Tags - PantherX
Top
Neil-B
Posts: 2027
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: FAH Client GPU Slot Continously failing

Post by Neil-B »

For CPU - 7 is not good number either (like 5 but actually worse) ... and if you do the change mid WU it won't use the new thread count until the next WU.
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070
(Green/Bold = Active)
Top
PantherX
Site Moderator
Posts: 7020
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:
Contact PantherX

Re: FAH Client GPU Slot Continously failing

Post by PantherX »

Welcome to the F@H Forum steviejason6,

Please note that your GPU Slot isn't restarting the same WU. Instead, it downloads a WU, fails to fold and get a new one. After doing 5 in a row, it fails.

Can you confirm that GPU-Z is correctly reporting the GPU and it is operating as normal when you're running games or other GPU applications?
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
Top
Lenciviona
Posts: 1
Joined: Mon Jun 01, 2020 8:19 pm

Re: FAH Client GPU Slot Continously failing

Post by Lenciviona »

I see from the log you are running the 32 bit client, try the 64 bit version if you're on Win 10.
21:25:56: Platform: win32 10
21:25:56: Bits: 32
Top
PantherX
Site Moderator
Posts: 7020
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:
Contact PantherX

Re: FAH Client GPU Slot Continously failing

Post by PantherX »

Lenciviona wrote:I see from the log you are running the 32 bit client, try the 64 bit version if you're on Win 10...
Welcome to the F@H Forum Lenciviona,

Please note that while macOS and Linux have a native 64-bit client, there's no 64-bit client for Windows. However, the part of the software that does the actual folding, that is 64-bit thus, there's not to much value in creating a native 64-bit client for Windows.
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
Top
Joe_H
Site Admin
Posts: 7868
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: FAH Client GPU Slot Continously failing

Post by Joe_H »

Lenciviona wrote:I see from the log you are running the 32 bit client, try the 64 bit version if you're on Win 10.
21:25:56: Platform: win32 10
21:25:56: Bits: 32
The bitness of the client does not matter, but you do need to be running 64-bit Windows for GPU folding. I think every GPU project that would process on 32-bit Windows has completed. The entry in the log does show that it is 64-bit Win 10"

Code: Select all

21:25:56:             OS: Windows 10 Enterprise
21:25:56:        OS Arch: AMD64
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Top
Post Reply

Return to “New Donors start here”