Folding rig support

A forum for discussing FAH-related hardware choices and info on actual products (not speculation).

Moderator: Site Moderators

Forum rules
Please read the forum rules before posting.
Post Reply
Amstellodamois
Posts: 5
Joined: Sat Mar 03, 2018 10:39 am

Folding rig support

Post by Amstellodamois »

Hi,

I have a 12x 1080 Ti rig mining various alcoins and thought I'd give folding a shot.

I understand the CPU processing power and and PCIe bandwidth matter (which isn't the case when mining) but I don't know how much.

What would be the PPD of a 1080 Ti on riser (because it's in a rig)?

What would be a good starting point for me, information-wise? I mean a good thorough article or blog post or...

Mod edit: merged two posts
Joe_H
Site Admin
Posts: 7856
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: Folding rig support

Post by Joe_H »

Welcome to the folding support forum.

There is a long topic on this subforum - viewtopic.php?f=38&t=28847 - that discussed this issue as recently as last Fall. Some newer topics in FAH Hardware have also touched on this issue. Basically each GPU will require use of one CPU core of a processor that is not at the very low end of power. If you are running Linux the PCIe bandwidth is less of an issue, but 1X slots will reduce throughput. 4X or better PCIe v.3 slots general are sufficient for almost full throughput from reports by those who have tested this.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Amstellodamois
Posts: 5
Joined: Sat Mar 03, 2018 10:39 am

Re: Folding rig support

Post by Amstellodamois »

Well, that changes the plans...

Maybe I can fold with a 1080 Ti in a 16X slot and mine with the 11 others.
toTOW
Site Moderator
Posts: 6296
Joined: Sun Dec 02, 2007 10:38 am
Location: Bordeaux, France
Contact:

Re: Folding rig support

Post by toTOW »

We're doing real computations here, not basic maths ... ;)
Image

Folding@Home beta tester since 2002. Folding Forum moderator since July 2008.
foldinghomealone2
Posts: 148
Joined: Sun Jul 30, 2017 8:40 pm

Re: Folding rig support

Post by foldinghomealone2 »

Just give it a try and post the results here. I assume everyone's curios
SteveWillis
Posts: 409
Joined: Fri Apr 15, 2016 12:42 am
Hardware configuration: PC 1:
Linux Mint 17.3
three gtx 1080 GPUs One on a powered header
Motherboard = [MB-AM3-AS-SB-990FXR2] qty 1 Asus Sabertooth 990FX(+59.99)
CPU = [CPU-AM3-FX-8320BR] qty 1 AMD FX 8320 Eight Core 3.5GHz(+41.99)

PC2:
Linux Mint 18
Open air case
Motherboard: ASUS Crosshair V Formula-Z AM3+ AMD 990FX SATA 6Gb/s USB 3.0 ATX AMD
AMD FD6300WMHKBOX FX-6300 6-Core Processor Black Edition with Cooler Master Hyper 212 EVO - CPU Cooler with 120mm PWM Fan
three gtx 1080,
one gtx 1080 TI on a powered header

Re: Folding rig support

Post by SteveWillis »

I've seen reports, over on Discord I think it was, that 1x 3.0 pcie slots do ok
Image

1080 and 1080TI GPUs on Linux Mint
foldy
Posts: 2061
Joined: Sat Dec 01, 2012 3:43 pm
Hardware configuration: Folding@Home Client 7.6.13 (1 GPU slots)
Windows 7 64bit
Intel Core i5 2500k@4Ghz
Nvidia gtx 1080ti driver 441

Re: Folding rig support

Post by foldy »

I heard you need have Linux and one CPU thread for each GPU and still pcie 3.0 1x looses 20% PPD - may be worth it.
SteveWillis
Posts: 409
Joined: Fri Apr 15, 2016 12:42 am
Hardware configuration: PC 1:
Linux Mint 17.3
three gtx 1080 GPUs One on a powered header
Motherboard = [MB-AM3-AS-SB-990FXR2] qty 1 Asus Sabertooth 990FX(+59.99)
CPU = [CPU-AM3-FX-8320BR] qty 1 AMD FX 8320 Eight Core 3.5GHz(+41.99)

PC2:
Linux Mint 18
Open air case
Motherboard: ASUS Crosshair V Formula-Z AM3+ AMD 990FX SATA 6Gb/s USB 3.0 ATX AMD
AMD FD6300WMHKBOX FX-6300 6-Core Processor Black Edition with Cooler Master Hyper 212 EVO - CPU Cooler with 120mm PWM Fan
three gtx 1080,
one gtx 1080 TI on a powered header

Re: Folding rig support

Post by SteveWillis »

I guess I lose about 20% on a 1080 on a 1x 2.0 on Linux
Image

1080 and 1080TI GPUs on Linux Mint
Amstellodamois
Posts: 5
Joined: Sat Mar 03, 2018 10:39 am

Re: Folding rig support

Post by Amstellodamois »

My airflow is fucked up if I install one 1080 Ti in a full size slot.
So risers are mandatory and my CPU is a piece of crap (2 threads), it hardly seem worth it to go through the hassle of learning the specifics of folding with such limitations from the start.


But I thank you for the information!
v00d00
Posts: 396
Joined: Sun Dec 02, 2007 4:53 am
Hardware configuration: FX8320e (6 cores enabled) @ stock,
- 16GB DDR3,
- Zotac GTX 1050Ti @ Stock.
- Gigabyte GTX 970 @ Stock
Debian 9.

Running GPU since it came out, CPU since client version 3.
Folding since Folding began (~2000) and ran Genome@Home for a while too.
Ran Seti@Home prior to that.
Location: UK
Contact:

Re: Folding rig support

Post by v00d00 »

I always assumed people running big rigs like this would go with liquid cooling solutions for the GPU's, to remove points of failure from the design and ensure better temperatures on the cards.

I also wouldn't ever run a 1080 next to another. The air gap is just too small. I have had cards overheat in the past, when ran side by side. If I was putting down the type of money required to build that kind of setup, I would consider liquid cooling a must.

Anyways I would also be interested in the OP's numbers running 12 cards simutaneously for 24 hours. Even if only as an experiment. As for running from an x16 slot, not massively bothered. We know what a card can generate in a x16 slot. What would be more useful is a hardware breakdown and numbers for 12x cards folding in whatever configuration he uses. While the CPU will bottleneck it. I am still interested in it from an experimentation standpoint.
Image
Amstellodamois
Posts: 5
Joined: Sat Mar 03, 2018 10:39 am

Re: Folding rig support

Post by Amstellodamois »

v00d00 wrote:I always assumed people running big rigs like this would go with liquid cooling solutions for the GPU's, to remove points of failure from the design and ensure better temperatures on the cards.
The price of a watercooling for 12 cards is crazy. It's a much more efficient solution to run them on an open frame with one or two box fans moving air around.
Very noisy, but a huge watercooling would be as well.
Anyways I would also be interested in the OP's numbers running 12 cards simutaneously for 24 hours. Even if only as an experiment. As for running from an x16 slot, not massively bothered. We know what a card can generate in a x16 slot. What would be more useful is a hardware breakdown and numbers for 12x cards folding in whatever configuration he uses. While the CPU will bottleneck it. I am still interested in it from an experimentation standpoint.
I had really shitty results, under 1000000 ppd with the 12 cards: I assume the CPU couldn't handle the workload at all.
foldy
Posts: 2061
Joined: Sat Dec 01, 2012 3:43 pm
Hardware configuration: Folding@Home Client 7.6.13 (1 GPU slots)
Windows 7 64bit
Intel Core i5 2500k@4Ghz
Nvidia gtx 1080ti driver 441

Re: Folding rig support

Post by foldy »

If it were a 6 core/12 thread cpu which are now cheaper available from AMD or Intel then I guess it would make 12 x 1mill PPD max on Linux = 12mill PPD total.
Amstellodamois
Posts: 5
Joined: Sat Mar 03, 2018 10:39 am

Re: Folding rig support

Post by Amstellodamois »

The celeron is supposed to have two cores.

Anyway, not trying that again :-D
bruce
Posts: 20910
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Folding rig support

Post by bruce »

Amstellodamois wrote:The celeron is supposed to have two cores.

Anyway, not trying that again :-D
That's most definitely under-powered. One thread per GPU is recommended when running OpenCL drivers.
Post Reply