2 different GPUs waiting for assignment

[mrbobpowell]

Hi Folks,

I'm relatively new to FAH, but I bought a new computer primarily for folding, and I have 4 other computers in house running the client as well.
Two of the computers (including the new one) have been folding fine on both CPU and GPU, but recently both of them have stopped using the GPU to fold.
Both are running FAH Client Version 6.6.13
One is an
NVidia GeForce RTX 2080 wiht Max-Q design (version 442.23)

the other board on a completely separate computer is:
NVidia GeForce GTX 1660

Both are under Windows 10, recently updated. I've checked the GPUs.txt file and both cards are listed.
Using the FAHControl and checking the log files, for slot 01 there are no entries for the last 2 days.
Also the status shows the GPUs as ready. It's as if they are just not receiving WUs.

I am getting this in only one of the log files:

Code: Select all

07:24:32:ERROR:WU00:FS01:Exception: Could not get an assignment
08:24:31:WU00:FS01:Connecting to assign1.foldingathome.org:80
08:24:32:WARNING:WU00:FS01:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
08:24:32:WU00:FS01:Connecting to assign2.foldingathome.org:80
08:24:32:WARNING:WU00:FS01:Failed to get assignment from 'assign2.foldingathome.org:80': No WUs available for this configuration
08:24:32:WU00:FS01:Connecting to assign3.foldingathome.org:80
08:24:32:WARNING:WU00:FS01:Failed to get assignment from 'assign3.foldingathome.org:80': No WUs available for this configuration
08:24:32:WU00:FS01:Connecting to assign4.foldingathome.org:80
08:24:32:WARNING:WU00:FS01:Failed to get assignment from 'assign4.foldingathome.org:80': No WUs available for this configuration
08:24:32:ERROR:WU00:FS01:Exception: Could not get an assignment

The configuration of the computer with the above log file has not changed since it was successfully using the GPU.
The other computer however has nothing listed for slot 01 except dates.

So I find this all a bit puzzling. Any suggestions?

Bob P.

[bollix47]

Welcome to the foldingathome support forum Bob.

You mentioned that there were some Windows updates so I'm going to suggest that you re-install the latest drivers from www.nvidia.com/drivers .

There could be other causes but you would need to post your System Information & your Configuration Sections for anyone to be able to help you:
viewtopic.php?p=327412&f=24#p327412

[mrbobpowell]

Hi Bollix47,

Thanks for your quick response. I installed a new nvidia driver and restarted my system
for the Alienware laptop.

I noticed in the control panel after the restart, that even though I have 2 gpus on this laptop,
the one listed in the control panel is the gpu:0:Gen9p5/GT2 [UHD Graphics 630] and not the nvidia card.
Do I need another slot defined to make use of the nvidia card? Right now it's at the default of -1. I did
try changing the thread count on the CPU (which is running) to an even number, but that didn't seem to
make a difference.

After the restart, I captured the log below, which seems to be showing a problem downloading and running a WU.
As before, it says no WU available for this configuration, though it was running before. I believe the output below
also includes the system information you were referring to.

Thanks you for your advice!

Bob P
---

Code: Select all

*********************** Log Started 2020-07-08T17:46:20Z ***********************
17:46:20:Trying to access database...
17:46:20:Successfully acquired database lock
17:46:20:Read GPUs.txt
17:46:20:Enabled folding slot 00: READY cpu:10
17:46:23:Enabled folding slot 01: READY gpu:0:Gen9p5/GT2 [UHD Graphics 630]
17:46:23:****************************** FAHClient ******************************
17:46:23:        Version: 7.6.13
17:46:23:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
17:46:23:      Copyright: 2020 foldingathome.org
17:46:23:       Homepage: https://foldingathome.org/
17:46:23:           Date: Apr 27 2020
17:46:23:           Time: 21:21:01
17:46:23:       Revision: 5a652817f46116b6e135503af97f18e094414e3b
17:46:23:         Branch: master
17:46:23:       Compiler: Visual C++ 2008
17:46:23:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
17:46:23:       Platform: win32 10
17:46:23:           Bits: 32
17:46:23:           Mode: Release
17:46:23:         Config: C:\Users\bob.powell\AppData\Roaming\FAHClient\config.xml
17:46:23:******************************** CBang ********************************
17:46:23:           Date: Apr 24 2020
17:46:23:           Time: 17:07:55
17:46:23:       Revision: ea081a3b3b0f4a37c4d0440b4f1bc184197c7797
17:46:23:         Branch: master
17:46:23:       Compiler: Visual C++ 2008
17:46:23:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
17:46:23:       Platform: win32 10
17:46:23:           Bits: 32
17:46:23:           Mode: Release
17:46:23:******************************* System ********************************
17:46:23:            CPU: Intel(R) Core(TM) i7-8750H CPU @ 2.20GHz
17:46:23:         CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
17:46:23:           CPUs: 12
17:46:23:         Memory: 31.80GiB
17:46:23:    Free Memory: 25.45GiB
17:46:23:        Threads: WINDOWS_THREADS
17:46:23:     OS Version: 6.2
17:46:23:    Has Battery: true
17:46:23:     On Battery: false
17:46:23:     UTC Offset: -7
17:46:23:            PID: 16764
17:46:23:            CWD: C:\Users\bob.powell\AppData\Roaming\FAHClient
17:46:23:  Win32 Service: false
17:46:23:             OS: Windows 10 Enterprise
17:46:23:        OS Arch: AMD64
17:46:23:           GPUs: 2
17:46:23:          GPU 0: Bus:0 Slot:2 Func:0 INTEL:1 Gen9p5/GT2 [UHD Graphics 630]
17:46:23:          GPU 1: Bus:1 Slot:0 Func:0 NVIDIA:7 TU104M [GeForce RTX 2080 Mobile]
17:46:23:  CUDA Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:7.5 Driver:11.0
17:46:23:OpenCL Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:1.2 Driver:451.48
17:46:23:OpenCL Device 1: Platform:1 Device:0 Bus:NA Slot:NA Compute:2.1 Driver:26.20
17:46:23:******************************* libFAH ********************************
17:46:23:           Date: Apr 15 2020
17:46:23:           Time: 14:53:14
17:46:23:       Revision: 216968bc7025029c841ed6e36e81a03a316890d3
17:46:23:         Branch: master
17:46:23:       Compiler: Visual C++ 2008
17:46:23:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
17:46:23:       Platform: win32 10
17:46:23:           Bits: 32
17:46:23:           Mode: Release
17:46:23:***********************************************************************
17:46:23:<config>
17:46:23:  <!-- Folding Slot Configuration -->
17:46:23:  <cause v='COVID_19'/>
17:46:23:
17:46:23:  <!-- Network -->
17:46:23:  <proxy v=':8080'/>
17:46:23:
17:46:23:  <!-- Slot Control -->
17:46:23:  <power v='full'/>
17:46:23:
17:46:23:  <!-- User Information -->
17:46:23:  <passkey v='*****'/>
17:46:23:  <team v='253668'/>
17:46:23:  <user v='mrbobpowell'/>
17:46:23:
17:46:23:  <!-- Folding Slots -->
17:46:23:  <slot id='0' type='CPU'>
17:46:23:    <cpus v='10'/>
17:46:23:  </slot>
17:46:23:  <slot id='1' type='GPU'/>
17:46:23:</config>
17:46:23:WU02:FS00:Starting
17:46:23:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\bob.powell\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 02 -suffix 01 -version 706 -lifeline 16764 -checkpoint 15 -np 10
17:46:23:WU02:FS00:Started FahCore on PID 19084
17:46:24:WU02:FS00:Core PID:19188
17:46:24:WU02:FS00:FahCore 0xa7 started
17:46:24:WU00:FS01:Connecting to assign1.foldingathome.org:80
17:46:24:WU02:FS00:0xa7:*********************** Log Started 2020-07-08T17:46:24Z ***********************
17:46:24:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
17:46:24:WU02:FS00:0xa7:       Type: 0xa7
17:46:24:WU02:FS00:0xa7:       Core: Gromacs
17:46:24:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 706 -lifeline 19084 -checkpoint 15 -np
17:46:24:WU02:FS00:0xa7:             10
17:46:24:WU02:FS00:0xa7:************************************ CBang *************************************
17:46:24:WU02:FS00:0xa7:       Date: Oct 26 2019
17:46:24:WU02:FS00:0xa7:       Time: 01:38:25
17:46:24:WU02:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
17:46:24:WU02:FS00:0xa7:     Branch: master
17:46:24:WU02:FS00:0xa7:   Compiler: Visual C++ 2008
17:46:24:WU02:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
17:46:24:WU02:FS00:0xa7:   Platform: win32 10
17:46:24:WU02:FS00:0xa7:       Bits: 64
17:46:24:WU02:FS00:0xa7:       Mode: Release
17:46:24:WU02:FS00:0xa7:************************************ System ************************************
17:46:24:WU02:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8750H CPU @ 2.20GHz
17:46:24:WU02:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
17:46:24:WU02:FS00:0xa7:       CPUs: 12
17:46:24:WU02:FS00:0xa7:     Memory: 31.80GiB
17:46:24:WU02:FS00:0xa7:Free Memory: 25.12GiB
17:46:24:WU02:FS00:0xa7:    Threads: WINDOWS_THREADS
17:46:24:WU02:FS00:0xa7: OS Version: 6.2
17:46:24:WU02:FS00:0xa7:Has Battery: true
17:46:24:WU02:FS00:0xa7: On Battery: false
17:46:24:WU02:FS00:0xa7: UTC Offset: -7
17:46:24:WU02:FS00:0xa7:        PID: 19188
17:46:24:WU02:FS00:0xa7:        CWD: C:\Users\bob.powell\AppData\Roaming\FAHClient\work
17:46:25:WU02:FS00:0xa7:******************************** Build - libFAH ********************************
17:46:25:WU02:FS00:0xa7:    Version: 0.0.18
17:46:25:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
17:46:25:WU02:FS00:0xa7:  Copyright: 2019 foldingathome.org
17:46:25:WU02:FS00:0xa7:   Homepage: https://foldingathome.org/
17:46:25:WU02:FS00:0xa7:       Date: Oct 26 2019
17:46:25:WU02:FS00:0xa7:       Time: 01:52:30
17:46:25:WU02:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
17:46:25:WU02:FS00:0xa7:     Branch: master
17:46:25:WU02:FS00:0xa7:   Compiler: Visual C++ 2008
17:46:25:WU02:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
17:46:25:WU02:FS00:0xa7:   Platform: win32 10
17:46:25:WU02:FS00:0xa7:       Bits: 64
17:46:25:WU02:FS00:0xa7:       Mode: Release
17:46:25:WU02:FS00:0xa7:************************************ Build *************************************
17:46:25:WU02:FS00:0xa7:       SIMD: avx_256
17:46:25:WU02:FS00:0xa7:********************************************************************************
17:46:25:WU02:FS00:0xa7:Project: 14809 (Run 2877, Clone 0, Gen 123)
17:46:25:WU02:FS00:0xa7:Unit: 0x000000a1455e42065ec123f6b829259c
17:46:25:WU02:FS00:0xa7:Digital signatures verified
17:46:25:WU02:FS00:0xa7:Calling: mdrun -s frame123.tpr -o frame123.trr -cpi state.cpt -cpt 15 -nt 10
17:46:25:WU02:FS00:0xa7:Steps: first=0 total=250000
17:46:26:WARNING:WU00:FS01:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
17:46:26:WU00:FS01:Connecting to assign2.foldingathome.org:80
17:46:26:WU02:FS00:0xa7:Completed 24268 out of 250000 steps (9%)
17:46:27:WARNING:WU00:FS01:Failed to get assignment from 'assign2.foldingathome.org:80': No WUs available for this configuration
17:46:27:WU00:FS01:Connecting to assign3.foldingathome.org:80
17:46:28:WARNING:WU00:FS01:Failed to get assignment from 'assign3.foldingathome.org:80': No WUs available for this configuration
17:46:28:WU00:FS01:Connecting to assign4.foldingathome.org:80
17:46:29:WARNING:WU00:FS01:Failed to get assignment from 'assign4.foldingathome.org:80': No WUs available for this configuration
17:46:29:ERROR:WU00:FS01:Exception: Could not get an assignment
17:46:29:WU00:FS01:Connecting to assign1.foldingathome.org:80
17:46:30:WARNING:WU00:FS01:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
17:46:30:WU00:FS01:Connecting to assign2.foldingathome.org:80
17:46:31:WARNING:WU00:FS01:Failed to get assignment from 'assign2.foldingathome.org:80': No WUs available for this configuration
17:46:31:WU00:FS01:Connecting to assign3.foldingathome.org:80
17:46:31:WARNING:WU00:FS01:Failed to get assignment from 'assign3.foldingathome.org:80': No WUs available for this configuration
17:46:31:WU00:FS01:Connecting to assign4.foldingathome.org:80
17:46:32:WARNING:WU00:FS01:Failed to get assignment from 'assign4.foldingathome.org:80': No WUs available for this configuration
17:46:32:ERROR:WU00:FS01:Exception: Could not get an assignment
17:47:29:WU00:FS01:Connecting to assign1.foldingathome.org:80
17:47:30:WARNING:WU00:FS01:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
17:47:30:WU00:FS01:Connecting to assign2.foldingathome.org:80
17:47:30:WARNING:WU00:FS01:Failed to get assignment from 'assign2.foldingathome.org:80': No WUs available for this configuration
17:47:30:WU00:FS01:Connecting to assign3.foldingathome.org:80
17:47:30:WARNING:WU00:FS01:Failed to get assignment from 'assign3.foldingathome.org:80': No WUs available for this configuration
17:47:30:WU00:FS01:Connecting to assign4.foldingathome.org:80
17:47:30:WARNING:WU00:FS01:Failed to get assignment from 'assign4.foldingathome.org:80': No WUs available for this configuration
17:47:30:ERROR:WU00:FS01:Exception: Could not get an assignment
17:47:36:WU02:FS00:0xa7:Completed 25000 out of 250000 steps (10%)

[Neil-B]

I'm guessing both are laptops ... and if so I believe both may have picked up the Intel iGPU (there are other posts re this - it is in testing) ... If I am right then these slots need to be paused (and set to pause on start) and extra slots adding for the nvidia GPUs ... unfortunately I am not a GPU folding guru as I mainly fold CPU but I am sure one of the gurus will spot this and advise.

[bollix47]

Thanks for the log Bob.

Yes, you need to add another GPU slot or disable the 630 (don't do this if it's driving your screen ). If you add another slot for the nvidia then, as mentioned, you should add pause-on-start true for slot 1 so it doesn't try to fold before development gets those iGPUs working consistently.

[Neil-B]

Don't just delete the iGPU slot as it will probably come back again and bounce the nvidia - pausing seems to be the way to deal with this issue.

[mrbobpowell]

Hi Neil-B and Bollix47,

Thank you both for the quick responses.
Actually, they are not both laptops. One is a laptop, the other is an HP Omen Obelisk workstation.
The omen obelisk does see the NVidia GeForce GTX 1660 card, it's just not using it. For the
Aleinware laptop I will try to pause the iGPU and add an additional slot for the NVidia Card.
Gentlemen, is there anymore info online about how to install the new slot definition correctly?
I've searched, but some of the posts I've found are rather dated and didn't correspond to the
newer ui.

Thank you!

Bob P.

[bruce]

Does the Obelisk have two distinct GPUs or does it employ switching like optimus notebooks. The only solution we've found for optimus is to disable switching since FAH doesn't like having it's GPU ripped away from it.

[mrbobpowell]

Hi Bruce!

The Omen Obelisk has only 1 GPU, a GeForce GTX 1660, which it lists in the web client,
so I don't think there's any switching going on.

I have not tried re-installing the nvidia driver there and rebooting yet, which will be my next
attempt to debug the HP Obelisk. If I track the log as soon as that happens, I may get a better
idea why the Obelisk has stopped using the gpu. Is the odd prime number of the cpu threads
still an issue for the Gromacs software?

[mrbobpowell]

So for the HP Omen Obelisk workstation, it looks like installing a new NVIDIA driver fixed the problem.
Thank you everyone for your help and suggestions!

If there's any online doc for configuring the second GPU using FAHControl for my laptop, I'd love
to read up to be sure I'm getting it done correctly.

Thanks everyone for your help!

Bob P.

[bruce]

If you happen to have an Intel iGPU which may have suddenly appeared as a GPU plus you have another GPU, yes, I can explain it. The Intel device has stolen the slot that should still be associated with the NVidia device.

If the two devices happen to be a single Optimus power-saving device that's switching between the two, you need to disable the switching in your BIOS.

the log above shows

17:46:23: GPUs: 2
17:46:23: GPU 0: Bus:0 Slot:2 Func:0 INTEL:1 Gen9p5/GT2 [UHD Graphics 630]
17:46:23: GPU 1: Bus:1 Slot:0 Func:0 NVIDIA:7 TU104M [GeForce RTX 2080 Mobile]

and you need to disable the UHD Graphics 630 device by permanently pausing that device and then add a new slot for the NVIDIA device.

The Intel iGPU is not supported and only appears there because FAH is testing devices like that one prior to deciding whether to officially support them or not.

[mrbobpowell]

Hey Bruce!

Actually that was easier than I expected it to be!
I have the NVidia card running as a second gpu again, thanks!
The Intel card is paused, all 3 show up in the web client.
Anyway to 'hide' the tab to the paused graphics card in the web client?
(I'm guessing not)

Anyway, thanks again for your help Bruce, Bollix47 and Neil-B!
I'm up and running on both computers again!

Bob

[bruce]

No, you really can't hide the tab for the iGPU, nor can you remove it. It'll just recreate itself the next time FAHClient is restarted.

I recommend you add the optional setting "pause-on-start" = 'true' to the Intel slot. It's not essential, but it may correct an error if you happen to start the slot by accident.