About 2 x GPUs and heat problems

A forum for discussing FAH-related hardware choices and info on actual products (not speculation).

Moderator: Site Moderators

Forum rules
Please read the forum rules before posting.
markdotgooley
Posts: 101
Joined: Tue Apr 21, 2020 11:46 am

Re: About 2 x GPUs and heat problems

Post by markdotgooley »

kiore wrote:How are you controlling the temps on the cards? I really recommend power limiting as a first step and looking at what the fans are really doing on an like MSI Afterburner.
I'm on Ubuntu Linux but I guess I could use nvidia-smi to force lower power consumption. But consumption is a little over 150W on each 2060 and I'm not sure how much I can lower it. 125W maybe? Lower? Fans around 85%: maybe I can force 100%? (Not much experience with this tool yet.)

Here's one card, excerpt of data from nvidia-smi -q :

Power Readings
Power Management : Supported
Power Draw : 152.06 W
Power Limit : 160.00 W
Default Power Limit : 160.00 W
Enforced Power Limit : 160.00 W
Min Power Limit : 125.00 W
Max Power Limit : 160.00 W

So is 125W the minimum? Will dropping power to 125W on each card reduce the temperature much? Will givve it a try later...
HaloJones
Posts: 920
Joined: Thu Jul 24, 2008 10:16 am

Re: About 2 x GPUs and heat problems

Post by HaloJones »

It also depends a lot on which units you get. I've seen GPU utilisation sometimes as low as 60% and as high as 99% just down to the science it's being asked to do.
single 1070

Image
Mxyzptlk
Posts: 72
Joined: Wed Apr 08, 2020 8:55 pm
Hardware configuration: Lots... Look at my website: www.mxyzptlk.us
Location: California
Contact:

Re: About 2 x GPUs and heat problems

Post by Mxyzptlk »

My 2 GPU’s are both twin fan EVGA’s. The upper is a 2060 Super and the lower a 2060. The GPU temps have not really altered with or without the CPU folding / the CPU air cooler running (a Noctua D15). The upper 2060 fans are running at 83%, is power limited to 75% and is right now 63c. The lower GPU fan is at 70%, is power limited to 65% and the temp is 51c.
I have always heard that the upper GPU gets hotter from the lower GPU fans blowing its hot air towards the upper GPU... Which makes sense with what i hav seen.
I fold..... look at my folding setups here: www.mxyzptlk.us
bruce
Posts: 20910
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: About 2 x GPUs and heat problems

Post by bruce »

Having GPUs that exhaust the hot air out the back helps, too. Those that just circulate the hot air in the case should be avoided.
HaloJones
Posts: 920
Joined: Thu Jul 24, 2008 10:16 am

Re: About 2 x GPUs and heat problems

Post by HaloJones »

HaloJones wrote:
A GTX1070 and a TitanX powered by a G4400.

Liquid really is the only way with dual gpu

With single, you can make any card into a hybrid liquid cooled card with an NZXT G10/G12 and a used AIO.
Just blew up the motherboard :(

Oh well, chance to upgrade again. This was a B150, just won an auction for a Z170 so hopefully a little bit better and easier to debug as it has a debug LED.
single 1070

Image
rickoic
Posts: 322
Joined: Sat May 23, 2009 4:49 pm
Hardware configuration: eVga x299 DARK 2070 Super, eVGA 2080, eVga 1070, eVga 2080 Super
MSI x399 eVga 2080, eVga 1070, eVga 1070, GT970
Location: Mississippi near Memphis, Tn

Re: About 2 x GPUs and heat problems

Post by rickoic »

I've pretty much stopped using enclosures for my computers. Gone completely open air computing. Just stumbled on to open air mining frames which now lets me stagger my gpu's from on board to ribbon risers and that keeps several inches in-between gpus and helps cooling them much easier.
I'm folding because Dec 2005 I had radical prostate surgery.
Lost brother to spinal cancer, brother-in-law to prostate cancer.
Several 1st cousins lost and a few who have survived.
markdotgooley
Posts: 101
Joined: Tue Apr 21, 2020 11:46 am

Re: About 2 x GPUs and heat problems

Post by markdotgooley »

rickoic wrote:I've pretty much stopped using enclosures for my computers. Gone completely open air computing. Just stumbled on to open air mining frames which now lets me stagger my gpu's from on board to ribbon risers and that keeps several inches in-between gpus and helps cooling them much easier.
Tempting. Need a motherboard with 3 or 4 nicely-spaced PCIe 3.0 or 4.0 x16 slots. Maybe an old dual-Xeon although those eat power. Put it in a rack-style setup or something makeshift.
KtC
Posts: 17
Joined: Thu May 21, 2020 4:05 am

Re: About 2 x GPUs and heat problems

Post by KtC »

I went back to Folding with a single 1060 and just realized the temperature @ stock is 76C (without any need to mod the settings with afterburner). It is not a card with a high end cooling solution, just two fans and radiator size gets two slots. Fan at around 56% I do not feel this is loud (and obviously that is a very subjective thing). Most important thing is that I do not feel any temperature discomfort when I touch the case on the back.

Even when I lowered the power of 2x1070ti setup and kept them running @ about 70C (I think that the Afterburner shows temp on a chip die), there was a huuuge difference in my PC case temperatures. With that setup I could barely touch the metal back of my PC case due to temp. IMHO cooling solution used on that 1070s was a top on the market with three fans and very big radiators. It seems the thermals on such powerful GPUs are very nonlinear processes comparing single card setup to combo.

You can see in the photo how tight that setup was.
https://imgur.com/a/YYJWpnE
Paragon
Posts: 139
Joined: Fri Oct 21, 2011 3:24 am
Hardware configuration: Rig1 (Dedicated SMP): AMD Phenom II X6 1100T, Gigabyte GA-880GMA-USB3 board, 8 GB Kingston 1333 DDR3 Ram, Seasonic S12 II 380 Watt PSU, Noctua CPU Cooler

Rig2 (Part-Time GPU): Intel Q6600, Gigabyte 965P-S3 Board, EVGA 460 GTX Graphics, 8 GB Kingston 800 DDR2 Ram, Seasonic Gold X-650 PSU, Artic Cooling Freezer 7 CPU Cooler
Location: United States

Re: About 2 x GPUs and heat problems

Post by Paragon »

I've been running various configs of dual, triple, and quad air cooled GPUs in mid tower cases. The key for me was using blower style cards that exhaust 100 percent of the air outside the case, and adding cool air intake fans to the side panel to feed the cards directly.

I applied this to an old fermi-based GPU "space heater" here.
https://greenfoldingathome.com/2020/05/ ... u-want-to/

Cooling diagram is in the gallery at the bottom of the article
MeeLee
Posts: 1375
Joined: Tue Feb 19, 2019 10:16 pm

Re: About 2 x GPUs and heat problems

Post by MeeLee »

Zotac used to have a great open cooler design.
Their design had the fins in the length of the GPU, forcing the air out the back and front of the card, while some of the air went through it and exhausted on the sides.
It's like half a blower type, half an open type.
Unlike most modern GPUs that are fully open, and force air on the top/bottom of the GPU.
HaloJones
Posts: 920
Joined: Thu Jul 24, 2008 10:16 am

Re: About 2 x GPUs and heat problems

Post by HaloJones »

HaloJones wrote:
HaloJones wrote:
A GTX1070 and a TitanX powered by a G4400.

Liquid really is the only way with dual gpu

With single, you can make any card into a hybrid liquid cooled card with an NZXT G10/G12 and a used AIO.
Just blew up the motherboard :(

Oh well, chance to upgrade again. This was a B150, just won an auction for a Z170 so hopefully a little bit better and easier to debug as it has a debug LED.
Tried again this morning after an hour of using an iPhone11 as a microscope to better see the bent pins in the cpu socket and some gentle manipulation, the motherboard now works again! Shame I won that auction. Now I'll have to build another folding rig :D
single 1070

Image
Skajaquada
Posts: 23
Joined: Wed Apr 01, 2020 7:37 am
Hardware configuration: Frankenfolder System: Gigabyte Aorus X570 Ultra, Ryzen 5 3600x, 32GB G.Skill 3600 Ram, 2x Nvidia RTX2080Ti, system custom watercooled.

Primo Victoria: Gigabyte Aorus X570 Pro, Ryzen 7 3700x, 32GB G.Skill Trident 3600 Ram, Radeon RX6800xt, system custom watercooled

Wifeys Machine: MSI X570 Gaming Plus, Ryzen 5 5600x, 32GB G.Skill Trident 3600 Ram, Nvidia RTX 2080Ti, system custom watercooled
Location: Wuppertal/Germany

Re: About 2 x GPUs and heat problems

Post by Skajaquada »

I had the same issues and choose the other way :)
My RX5700xt was too loud and hot for my wife, so i decide to change on custom watercooling.
After that it was so cold that i decided to buy another RX5700xt and a bigger Radiator.
Now it became a Corsair 780T with 2x 280mm and one 360mm Radiator which cool the 2 overclocked rx5700xt and the Ryzen 7 3700x down to 48°C max (Water temps at 38° max)
And yes, it´s so silent, my wife now wants her own watercooled System :lol:
Image
jrweiss
Posts: 707
Joined: Tue Dec 04, 2007 6:56 am
Hardware configuration: Ryzen 7 5700G, 22.40.46 VGA driver; 32GB G-Skill Trident DDR4-3200; Samsung 860EVO 1TB Boot SSD; VelociRaptor 1TB; MSI GTX 1050ti, 551.23 studio driver; BeQuiet FM 550 PSU; Lian Li PC-9F; Win11Pro-64, F@H 8.3.5.

[Suspended] Ryzen 7 3700X, MSI X570MPG, 32GB G-Skill Trident Z DDR4-3600; Corsair MP600 M.2 PCIe Gen4 Boot, Samsung 840EVO-250 SSDs; VelociRaptor 1TB, Raptor 150; MSI GTX 1050ti, 526.98 driver; Kingwin Stryker 500 PSU; Lian Li PC-K7B. Win10Pro-64, F@H 8.3.5.
Location: @Home
Contact:

Re: About 2 x GPUs and heat problems

Post by jrweiss »

bruce wrote:Having GPUs that exhaust the hot air out the back helps, too. Those that just circulate the hot air in the case should be avoided.
Unfortunately, most GPUs will NOT exhaust [most of] the cooling air through their own backplanes. Even those that have slotted backplanes often have the cooling fins oriented parallel to the backplane, so airflow is mainly directed back into the case.

I recommend you use slotted backplane covers adjacent to the GPUs, and have positive pressure airflow (more intake than exhaust CFM) so that hot air will tend to go out those slotted backplanes.
Ryzen 7 5700G, 22.40.46 VGA driver; MSI GTX 1050ti, 551.23 studio driver
Ryzen 7 3700X; MSI GTX 1050ti, 551.23 studio driver [Suspended]
agent71
Posts: 44
Joined: Wed Mar 25, 2020 1:38 pm
Location: UK

Re: About 2 x GPUs and heat problems

Post by agent71 »

I don't have 2 x RTX 2060 but am running 1 x RTX2060 and 1 x P106.

Temps are high but "fine" and in a case that isn't exactly great with airflow - Corsair Carbide 275R. It is pretty quiet though as replaced all fans with Noctua and placed CPU radiator at top of case to allow maxmium, unrestricted airflow in via front panel. It's still not really enough but ok.

You can see that the RTX peaks at 81C running at 150W and the P106 at 59C which is bearly an increase from idle temp...

I was power limiting both via nvidia-smi but it made very little difference to temps on the P106, +/- 3 degrees, so I let that run at whatever power it needs.
RTX at 125W sees temps peak around 75C.

As the 2060 runs hot and the PC sits in the home office I pause it via cron during working hours and fire up at 9PM although still limit to 150W. So not exactly a solution to improving cooling but one that means I don't care about the noise the fans make as I'm not in the room.

Code: Select all

0 7 * * 1-5 /usr/bin/FAHClient --send-pause 1
0 21 * * 1-5 /usr/bin/FAHClient --send-unpause 1
Image
Image
Image
Image
Image
MeeLee
Posts: 1375
Joined: Tue Feb 19, 2019 10:16 pm

Re: About 2 x GPUs and heat problems

Post by MeeLee »

agent71 wrote:I don't have 2 x RTX 2060 but am running 1 x RTX2060 and 1 x P106.

Temps are high but "fine" and in a case that isn't exactly great with airflow - Corsair Carbide 275R. It is pretty quiet though as replaced all fans with Noctua and placed CPU radiator at top of case to allow maxmium, unrestricted airflow in via front panel. It's still not really enough but ok.

You can see that the RTX peaks at 81C running at 150W and the P106 at 59C which is bearly an increase from idle temp...

I was power limiting both via nvidia-smi but it made very little difference to temps on the P106, +/- 3 degrees, so I let that run at whatever power it needs.
RTX at 125W sees temps peak around 75C.

As the 2060 runs hot and the PC sits in the home office I pause it via cron during working hours and fire up at 9PM although still limit to 150W. So not exactly a solution to improving cooling but one that means I don't care about the noise the fans make as I'm not in the room.
...
the P106 uses a lower TDP than the RTX GPU.
Limiting the P106 to 125W, is setting it 5 Watt higher than it's stock rated '120W' TDP.
If I'm not mistaken, the P106 can be lowered all the way to ~75W; but it'll suffer in performance at those power levels.
I believe somewhere around 80-85W is the optimal setting for that GPU, but you'll have to play around with it, looking at GPU frequencies while power capping to different settings, to see if you can sacrifice 10% of GPU frequency (usually for ~25% of lower power settings).
10% of GPU frequency drop, doesn't always relate to 10% lower PPD. It more or less equals like 5% of PPD loss.
So instead of a 333k PPD, you'll get like 315-320k PPD.
Not a biggie, if you look at the power saved.
Post Reply