FAH Client errors

If you're new to FAH and need help getting started or you have very basic questions, start here.

Moderators: Site Moderators, FAHC Science Team

tulanebarandgrill
Posts: 36
Joined: Thu Nov 16, 2017 2:57 pm

Re: FAH Client errors

Post by tulanebarandgrill »

Ok I guess I still don't get how to post the top log pages. I thought I did that from my post on the 13th. Anyway my system has ONE GTX 970, and 8 cores with hyperthreading.

I've been using the medium setting on the GUI (and "-1" configured in slot 0) which autoselects 14 cores. The FULL setting selects 15 cores. Today I went in and set cores manually to 12 in the slot 0 settings.

Verbosity is now set to 3 where it shall hopefully remain.

I hit refresh and captured this per instructions -- please note it is 4 days old (the current log file contains 4 days).

Code: Select all

*********************** Log Started 2019-06-12T16:43:14Z ***********************
16:43:14:************************* Folding@home Client *************************
16:43:14:        Website: https://foldingathome.org/
16:43:14:      Copyright: (c) 2009-2018 foldingathome.org
16:43:14:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
16:43:14:           Args: 
16:43:14:         Config: C:\Users\pt\AppData\Roaming\FAHClient\config.xml
16:43:14:******************************** Build ********************************
16:43:14:        Version: 7.5.1
16:43:14:           Date: May 11 2018
16:43:14:           Time: 13:06:32
16:43:14:     Repository: Git
16:43:14:       Revision: 4705bf53c635f88b8fe85af7675557e15d491ff0
16:43:14:         Branch: master
16:43:14:       Compiler: Visual C++ 2008
16:43:14:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
16:43:14:       Platform: win32 10
16:43:14:           Bits: 32
16:43:14:           Mode: Release
16:43:14:******************************* System ********************************
16:43:14:            CPU: Intel(R) Core(TM) i7-5960X CPU @ 3.00GHz
16:43:14:         CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
16:43:14:           CPUs: 16
16:43:14:         Memory: 63.91GiB
16:43:14:    Free Memory: 60.93GiB
16:43:14:        Threads: WINDOWS_THREADS
16:43:14:     OS Version: 6.2
16:43:14:    Has Battery: false
16:43:14:     On Battery: false
16:43:14:     UTC Offset: -5
16:43:14:            PID: 12904
16:43:14:            CWD: C:\Users\pt\AppData\Roaming\FAHClient
16:43:14:             OS: Windows 10 Enterprise
16:43:14:        OS Arch: AMD64
16:43:14:           GPUs: 1
16:43:14:          GPU 0: Bus:1 Slot:0 Func:0 NVIDIA:5 GM204 [GeForce GTX 970]
16:43:14:  CUDA Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:5.2 Driver:9.1
16:43:14:OpenCL Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:1.2 Driver:388.13
16:43:14:  Win32 Service: false
16:43:14:***********************************************************************
16:43:14:<config>
16:43:14:  <!-- Folding Core -->
16:43:14:  <checkpoint v='6'/>
16:43:14:
16:43:14:  <!-- Folding Slot Configuration -->
16:43:14:  <cause v='ALZHEIMERS'/>
16:43:14:
16:43:14:  <!-- Logging -->
16:43:14:  <verbosity v='2'/>
16:43:14:
16:43:14:  <!-- Network -->
16:43:14:  <proxy v=':8080'/>
16:43:14:
16:43:14:  <!-- User Information -->
16:43:14:  <passkey v='********************************'/>
16:43:14:  <team v='233664'/>
16:43:14:  <user v='TulaneBaG'/>
16:43:14:
16:43:14:  <!-- Folding Slots -->
16:43:14:  <slot id='0' type='CPU'>
16:43:14:    <paused v='true'/>
16:43:14:  </slot>
16:43:14:  <slot id='1' type='GPU'>
16:43:14:    <paused v='true'/>
16:43:14:  </slot>
16:43:14:</config>
16:43:14:Trying to access database...
16:43:14:Enabled folding slot 00: PAUSED cpu:14 (by user)
16:43:14:Enabled folding slot 01: PAUSED gpu:0:GM204 [GeForce GTX 970] (by user)
16:45:49:FS00:Unpaused
16:45:49:FS01:Unpaused
16:45:49:WU01:FS01:Starting
16:45:49:WU01:FS01:Core PID:7468
16:45:49:WU01:FS01:FahCore 0x21 started
16:45:49:WU02:FS00:Starting
16:45:49:WARNING:WU02:FS00:AS lowered CPUs from 14 to 13
16:45:49:WU02:FS00:Core PID:9708
16:45:49:WU02:FS00:FahCore 0xa7 started
16:45:49:WU01:FS01:0x21:*********************** Log Started 2019-06-12T16:45:49Z ***********************
16:45:49:WU01:FS01:0x21:Project: 11718 (Run 0, Clone 223, Gen 396)
16:45:49:WU01:FS01:0x21:Unit: 0x0000023b8ca304e75b846a3f442a51ba
16:45:49:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
16:45:49:WU01:FS01:0x21:Machine: 1
16:45:49:WU01:FS01:0x21:Digital signatures verified
16:45:49:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
16:45:49:WU01:FS01:0x21:Version 0.0.18
16:45:50:WU02:FS00:0xa7:*********************** Log Started 2019-06-12T16:45:49Z ***********************
16:45:50:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
16:45:50:WU02:FS00:0xa7:       Type: 0xa7
16:45:50:WU02:FS00:0xa7:       Core: Gromacs
16:45:50:WU02:FS00:0xa7:    Website: https://foldingathome.org/
16:45:50:WU02:FS00:0xa7:  Copyright: (c) 2009-2018 foldingathome.org
16:45:50:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
16:45:50:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 705 -lifeline 5152 -checkpoint 6 -np 13
16:45:50:WU02:FS00:0xa7:     Config: <none>
16:45:50:WU02:FS00:0xa7:************************************ Build *************************************
16:45:50:WU02:FS00:0xa7:    Version: 0.0.17
16:45:50:WU02:FS00:0xa7:       Date: Apr 27 2018
16:45:50:WU02:FS00:0xa7:       Time: 16:19:36
16:45:50:WU02:FS00:0xa7: Repository: Git
16:45:50:WU02:FS00:0xa7:   Revision: 21359963583d09ec2063ef946399441c4df4ccd7
16:45:50:WU02:FS00:0xa7:     Branch: master
16:45:50:WU02:FS00:0xa7:   Compiler: Visual C++ 2008
16:45:50:WU02:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
16:45:50:WU02:FS00:0xa7:   Platform: win32 10
16:45:50:WU02:FS00:0xa7:       Bits: 64
16:45:50:WU02:FS00:0xa7:       Mode: Release
16:45:50:WU02:FS00:0xa7:       SIMD: avx_256
16:45:50:WU02:FS00:0xa7:************************************ System ************************************
16:45:50:WU02:FS00:0xa7:        CPU: Unknown
16:45:50:WU02:FS00:0xa7:     CPU ID: 
16:45:50:WU02:FS00:0xa7:       CPUs: 16
16:45:50:WU02:FS00:0xa7:     Memory: 63.91GiB
16:45:50:WU02:FS00:0xa7:Free Memory: 60.67GiB
16:45:50:WU02:FS00:0xa7:    Threads: WINDOWS_THREADS
16:45:50:WU02:FS00:0xa7: OS Version: 6.2
16:45:50:WU02:FS00:0xa7:Has Battery: false
16:45:50:WU02:FS00:0xa7: On Battery: false
16:45:50:WU02:FS00:0xa7: UTC Offset: -5
16:45:50:WU02:FS00:0xa7:        PID: 9708
16:45:50:WU02:FS00:0xa7:        CWD: C:\Users\pt\AppData\Roaming\FAHClient\work
16:45:50:WU02:FS00:0xa7:         OS: Windows 10 Pro
16:45:50:WU02:FS00:0xa7:    OS Arch: AMD64
16:45:50:WU02:FS00:0xa7:********************************************************************************
16:45:50:WU02:FS00:0xa7:Project: 13823 (Run 830, Clone 1, Gen 28)
16:45:50:WU02:FS00:0xa7:Unit: 0x0000001d80fccb095c8ff4fb019cfbdf
16:45:50:WU02:FS00:0xa7:Digital signatures verified
16:45:50:WU02:FS00:0xa7:Reducing thread count from 13 to 12 to avoid domain decomposition by a prime number > 3
16:45:50:WU02:FS00:0xa7:Calling: mdrun -s frame28.tpr -o frame28.trr -x frame28.xtc -cpi state.cpt -cpt 6 -nt 12
16:45:50:WU02:FS00:0xa7:Steps: first=3500000 total=125000
16:45:52:WU02:FS00:0xa7:Completed 5202 out of 125000 steps (4%)
16:45:57:WU01:FS01:0x21:Completed 0 out of 5000000 steps (0%)
16:45:57:WU01:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
16:46:17:Saving configuration to config.xml
16:46:17:<config>
16:46:17:  <!-- Folding Core -->
16:46:17:  <checkpoint v='6'/>
16:46:17:
16:46:17:  <!-- Folding Slot Configuration -->
16:46:17:  <cause v='ALZHEIMERS'/>
16:46:17:
16:46:17:  <!-- Logging -->
16:46:17:  <verbosity v='2'/>
16:46:17:
16:46:17:  <!-- Network -->
16:46:17:  <proxy v=':8080'/>
16:46:17:
16:46:17:  <!-- User Information -->
16:46:17:  <passkey v='********************************'/>
16:46:17:  <team v='233664'/>
16:46:17:  <user v='TulaneBaG'/>
16:46:17:
16:46:17:  <!-- Folding Slots -->
16:46:17:  <slot id='0' type='CPU'/>
16:46:17:  <slot id='1' type='GPU'/>
16:46:17:</config>

current log page (showing new settings):

Code: Select all

15:43:41:<config>
15:43:41:  <!-- Folding Core -->
15:43:41:  <checkpoint v='6'/>
15:43:41:
15:43:41:  <!-- Folding Slot Configuration -->
15:43:41:  <cause v='ALZHEIMERS'/>
15:43:41:
15:43:41:  <!-- Network -->
15:43:41:  <proxy v=':8080'/>
15:43:41:
15:43:41:  <!-- User Information -->
15:43:41:  <passkey v='********************************'/>
15:43:41:  <team v='233664'/>
15:43:41:  <user v='TulaneBaG'/>
15:43:41:
15:43:41:  <!-- Folding Slots -->
15:43:41:  <slot id='0' type='CPU'>
15:43:41:    <cpus v='12'/>
15:43:41:  </slot>
15:43:41:  <slot id='1' type='GPU'/>
15:43:41:</config>
- TulaneBaG
bruce
Posts: 20910
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: FAH Client errors

Post by bruce »

If you manually set cpus=12, it should be able to download the largest proteins and run them quite effectively but you won't be using 100% of the capability of your 16-thread CPU because some cores will never be allocated to FAH. Adding a second CPU slot will increase utilization (and heat) by running another CPU-based assignment concurrently. (You may or may not want to do that, especially since you already decided on a power setting of medium.) The total number of CPUs (including one for your GPU) should never exceed your actual 16.
tulanebarandgrill
Posts: 36
Joined: Thu Nov 16, 2017 2:57 pm

Re: FAH Client errors

Post by tulanebarandgrill »

I only have 1 GPU.

I thought I posted the top page on the 13th, but I'll do it again. Seems the clock error is back. I'm not sure what to think about that but I'm pretty certain it's not an error with the FAH client. Even if my hardware clock is drifting, NTP should correct, so I'm going to investigate what is going on with that.

Code: Select all

*********************** Log Started 2019-06-18T00:31:44Z ***********************
00:31:44:************************* Folding@home Client *************************
00:31:44:        Website: https://foldingathome.org/
00:31:44:      Copyright: (c) 2009-2018 foldingathome.org
00:31:44:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
00:31:44:           Args: 
00:31:44:         Config: C:\Users\pt\AppData\Roaming\FAHClient\config.xml
00:31:44:******************************** Build ********************************
00:31:44:        Version: 7.5.1
00:31:44:           Date: May 11 2018
00:31:44:           Time: 13:06:32
00:31:44:     Repository: Git
00:31:44:       Revision: 4705bf53c635f88b8fe85af7675557e15d491ff0
00:31:44:         Branch: master
00:31:44:       Compiler: Visual C++ 2008
00:31:44:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
00:31:44:       Platform: win32 10
00:31:44:           Bits: 32
00:31:44:           Mode: Release
00:31:44:******************************* System ********************************
00:31:44:            CPU: Intel(R) Core(TM) i7-5960X CPU @ 3.00GHz
00:31:44:         CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
00:31:44:           CPUs: 16
00:31:44:         Memory: 63.91GiB
00:31:44:    Free Memory: 61.03GiB
00:31:44:        Threads: WINDOWS_THREADS
00:31:44:     OS Version: 6.2
00:31:44:    Has Battery: false
00:31:44:     On Battery: false
00:31:44:     UTC Offset: -5
00:31:44:            PID: 13000
00:31:44:            CWD: C:\Users\pt\AppData\Roaming\FAHClient
00:31:44:             OS: Windows 10 Enterprise
00:31:44:        OS Arch: AMD64
00:31:44:           GPUs: 1
00:31:44:          GPU 0: Bus:1 Slot:0 Func:0 NVIDIA:5 GM204 [GeForce GTX 970]
00:31:44:  CUDA Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:5.2 Driver:9.1
00:31:44:OpenCL Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:1.2 Driver:388.13
00:31:44:  Win32 Service: false
00:31:44:***********************************************************************
00:31:44:<config>
00:31:44:  <!-- Folding Core -->
00:31:44:  <checkpoint v='6'/>
00:31:44:
00:31:44:  <!-- Folding Slot Configuration -->
00:31:44:  <cause v='ALZHEIMERS'/>
00:31:44:
00:31:44:  <!-- Network -->
00:31:44:  <proxy v=':8080'/>
00:31:44:
00:31:44:  <!-- User Information -->
00:31:44:  <passkey v='********************************'/>
00:31:44:  <team v='233664'/>
00:31:44:  <user v='TulaneBaG'/>
00:31:44:
00:31:44:  <!-- Folding Slots -->
00:31:44:  <slot id='0' type='CPU'>
00:31:44:    <cpus v='12'/>
00:31:44:  </slot>
00:31:44:  <slot id='1' type='GPU'/>
00:31:44:</config>
00:31:44:Trying to access database...
00:31:44:Successfully acquired database lock
00:31:44:Enabled folding slot 00: READY cpu:12
00:31:44:Enabled folding slot 01: READY gpu:0:GM204 [GeForce GTX 970]
00:31:44:WU00:FS01:Starting
00:31:44:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\pt\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 705 -lifeline 13000 -checkpoint 6 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
00:31:44:WU00:FS01:Started FahCore on PID 12084
00:31:44:WU00:FS01:Core PID:12104
00:31:44:WU00:FS01:FahCore 0x21 started
00:31:44:WU01:FS00:Starting
00:31:44:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\pt\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/Win32/AMD64/AVX/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 705 -lifeline 13000 -checkpoint 6 -np 12
00:31:44:WU01:FS00:Started FahCore on PID 12336
00:31:44:WU01:FS00:Core PID:12208
00:31:44:WU01:FS00:FahCore 0xa7 started
00:31:44:WU00:FS01:0x21:*********************** Log Started 2019-06-18T00:31:44Z ***********************
00:31:44:WU00:FS01:0x21:Project: 11726 (Run 0, Clone 2598, Gen 222)
00:31:44:WU00:FS01:0x21:Unit: 0x000001338ca304e75bbcea4f2e2f6eee
00:31:44:WU00:FS01:0x21:CPU: 0x00000000000000000000000000000000
00:31:45:WU00:FS01:0x21:Machine: 1
00:31:45:WU00:FS01:0x21:Digital signatures verified
00:31:45:WU00:FS01:0x21:Folding@home GPU Core21 Folding@home Core
00:31:45:WU00:FS01:0x21:Version 0.0.18
00:31:45:WU00:FS01:0x21:  Found a checkpoint file
00:31:45:WU01:FS00:0xa7:*********************** Log Started 2019-06-18T00:31:44Z ***********************
00:31:45:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
00:31:45:WU01:FS00:0xa7:       Type: 0xa7
00:31:45:WU01:FS00:0xa7:       Core: Gromacs
00:31:45:WU01:FS00:0xa7:    Website: https://foldingathome.org/
00:31:45:WU01:FS00:0xa7:  Copyright: (c) 2009-2018 foldingathome.org
00:31:45:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
00:31:45:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 705 -lifeline 12336 -checkpoint 6 -np
00:31:45:WU01:FS00:0xa7:             12
00:31:45:WU01:FS00:0xa7:     Config: <none>
00:31:45:WU01:FS00:0xa7:************************************ Build *************************************
00:31:45:WU01:FS00:0xa7:    Version: 0.0.17
00:31:45:WU01:FS00:0xa7:       Date: Apr 27 2018
00:31:45:WU01:FS00:0xa7:       Time: 16:19:36
00:31:45:WU01:FS00:0xa7: Repository: Git
00:31:45:WU01:FS00:0xa7:   Revision: 21359963583d09ec2063ef946399441c4df4ccd7
00:31:45:WU01:FS00:0xa7:     Branch: master
00:31:45:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
00:31:45:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
00:31:45:WU01:FS00:0xa7:   Platform: win32 10
00:31:45:WU01:FS00:0xa7:       Bits: 64
00:31:45:WU01:FS00:0xa7:       Mode: Release
00:31:45:WU01:FS00:0xa7:       SIMD: avx_256
00:31:45:WU01:FS00:0xa7:************************************ System ************************************
00:31:45:WU01:FS00:0xa7:        CPU: Unknown
00:31:45:WU01:FS00:0xa7:     CPU ID: 
00:31:45:WU01:FS00:0xa7:       CPUs: 16
00:31:45:WU01:FS00:0xa7:     Memory: 63.91GiB
00:31:45:WU01:FS00:0xa7:Free Memory: 60.89GiB
00:31:45:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
00:31:45:WU01:FS00:0xa7: OS Version: 6.2
00:31:45:WU01:FS00:0xa7:Has Battery: false
00:31:45:WU01:FS00:0xa7: On Battery: false
00:31:45:WU01:FS00:0xa7: UTC Offset: -5
00:31:45:WU01:FS00:0xa7:        PID: 12208
00:31:45:WU01:FS00:0xa7:        CWD: C:\Users\pt\AppData\Roaming\FAHClient\work
00:31:45:WU01:FS00:0xa7:         OS: Windows 10 Pro
00:31:45:WU01:FS00:0xa7:    OS Arch: AMD64
00:31:45:WU01:FS00:0xa7:********************************************************************************
00:31:45:WU01:FS00:0xa7:Project: 14143 (Run 4, Clone 43, Gen 78)
00:31:45:WU01:FS00:0xa7:Unit: 0x0000005c0002894c5ca3a72a1c31e539
00:31:45:WU01:FS00:0xa7:Digital signatures verified
00:31:45:WU01:FS00:0xa7:Calling: mdrun -s frame78.tpr -o frame78.trr -cpi state.cpt -cpt 6 -nt 12
00:31:45:WU01:FS00:0xa7:Steps: first=195000000 total=2500000
00:31:46:WU01:FS00:0xa7:Completed 1684122 out of 2500000 steps (67%)
00:31:51:WU00:FS01:0x21:Completed 2250000 out of 5000000 steps (45%)
00:31:51:WU00:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
00:32:33:WU01:FS00:0xa7:Completed 1700000 out of 2500000 steps (68%)
00:37:39:WARNING:WU00:FS01:Detected clock skew (5 mins 00 secs), I/O delay, laptop hibernation or other slowdown noted, adjusting time estimates
00:37:39:WARNING:WU01:FS00:Detected clock skew (5 mins 00 secs), I/O delay, laptop hibernation or other slowdown noted, adjusting time estimates
00:37:39:WU00:FS01:0x21:ERROR:exception: Error downloading array energyBuffer: clEnqueueReadBuffer (-5)
00:37:39:WU00:FS01:0x21:Saving result file logfile_01.txt
00:37:39:WU00:FS01:0x21:Saving result file log.txt
00:37:39:WU00:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
00:37:40:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:37:40:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:11726 run:0 clone:2598 gen:222 core:0x21 unit:0x000001338ca304e75bbcea4f2e2f6eee
00:37:40:WU00:FS01:Uploading 17.50KiB to 140.163.4.231
00:37:40:WU00:FS01:Connecting to 140.163.4.231:8080
00:37:40:WU00:FS01:Upload complete
00:37:40:WU00:FS01:Server responded WORK_ACK (400)
00:37:40:WU02:FS01:Connecting to 65.254.110.245:8080
00:37:40:WU00:FS01:Cleaning up
00:37:41:WU02:FS01:Assigned to work server 155.247.166.220
00:37:41:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GM204 [GeForce GTX
- TulaneBaG
tulanebarandgrill
Posts: 36
Joined: Thu Nov 16, 2017 2:57 pm

Re: FAH Client errors

Post by tulanebarandgrill »

@Bruce; thanks. If I use all 16 it puts out quite a bit of heat so I think I'll stick with the 12, especially since the GPU greatly overshadows it anyway. I'm planning on upgrading GPU soon, and I might still keep this one in so the CPUs are going to fade into obscurity @ that point.
- TulaneBaG
tulanebarandgrill
Posts: 36
Joined: Thu Nov 16, 2017 2:57 pm

Re: FAH Client errors

Post by tulanebarandgrill »

In the end I just set it to "high" and let it use 15 CPU. It seems happy with this.

There is only one GPU.
- TulaneBaG
Post Reply