Guidance for building a folding dedicated computer

A forum for discussing FAH-related hardware choices and info on actual products (not speculation).

Moderator: Site Moderators

Forum rules
Please read the forum rules before posting.
ComputerGenie
Posts: 236
Joined: Mon Dec 12, 2016 4:06 am

Re: Guidance for building a folding dedicated computer

Post by ComputerGenie »

boristsybin wrote:
kiore wrote:people tell you to just open a window to air cool 4 X gpu's they haven't run this
but i do
...
But, you're not exactly running a "stock" case in a "normal" room, either. :wink:
boristsybin
Posts: 50
Joined: Mon Jan 16, 2017 11:40 am
Hardware configuration: 4x1080Ti + 2x1050Ti
Location: Russia, Moscow

Re: Guidance for building a folding dedicated computer

Post by boristsybin »

yes, the case is a bit customized (originaly Antec NSK 4482, very compact and spacy, AYCS), and the room... is watercloset, hot air blows directly into exhaust ventilation. No noise and no heat in livingrooms

3x1080Ti FE run their coolers up to 80% and temperatures up to 80 C

Image Image
Image
Aurum
Posts: 296
Joined: Sat Oct 03, 2015 3:15 pm
Location: The Great Basin

Re: Guidance for building a folding dedicated computer

Post by Aurum »

Boris, Those are the biggest gauge PCIe power cables I've ever seen :shock:
Thanks for all the photos in your gallery. You must've had a lot of fun figuring all that out.
In Science We Trust Image
boristsybin
Posts: 50
Joined: Mon Jan 16, 2017 11:40 am
Hardware configuration: 4x1080Ti + 2x1050Ti
Location: Russia, Moscow

Re: Guidance for building a folding dedicated computer

Post by boristsybin »

Aurum wrote:Boris, Those are the biggest gauge PCIe power cables I've ever seen :shock:
Yeah, I pimp my wires! :D
Aurum wrote:Thanks for all the photos in your gallery. You must've had a lot of fun figuring all that out.
Thank you.
Image
Leonardo
Posts: 261
Joined: Tue Dec 04, 2007 5:09 am
Hardware configuration: GPU slots on home-built, purpose-built PCs.
Location: Eagle River, Alaska

Re: Guidance for building a folding dedicated computer

Post by Leonardo »

I award extra points for the heat exhaust ingenuity!
Image
FldngForGrandparents
Posts: 70
Joined: Sun Feb 28, 2016 10:06 pm

Re: Guidance for building a folding dedicated computer

Post by FldngForGrandparents »

jrweiss wrote:7 slots doesn't necessarily mean it's capable of handling 7 GPUs... Since the CPU will handle a max of 40 PCI lanes, 5 x8 GPU connections would be the max available, IF you could physically put the cards into the machine. That board will accept a max of 4 double-slot GPU cards.
This is not correct. Everyone on here seems to think you need x8 PCIe. This depends on several factors. One being the GPU itself. I am currently running a 1070 on a PCIe 1x to 16x adapter connected to a PCIe 1x Gen3 slot and doing 700k PPD+. This has more to do with the PCIe gen when using multiple GPU's. And yes this does require extension cables to accomplish.
Image

Dedicated to my grandparents who have passed away from Alzheimer's

Dedicated folding rig on Linux Mint 19.1:
2 - GTX 980 OC +200
1 - GTX 980 Ti OC +20
4 - GTX 1070 FE OC +200
3 - GTX 1080 OC +140
1 - GTX 1080Ti OC +120
boristsybin
Posts: 50
Joined: Mon Jan 16, 2017 11:40 am
Hardware configuration: 4x1080Ti + 2x1050Ti
Location: Russia, Moscow

Re: Guidance for building a folding dedicated computer

Post by boristsybin »

FldngForGrandparents wrote:I am currently running a 1070 on a PCIe 1x to 16x adapter connected to a PCIe 1x Gen3 slot and doing 700k PPD+.
That is very good numbers. What FAH Client and driver version you use? Seems that 1060 is very suitible for x1 Gen2 on Linux
Image
bruce
Posts: 20910
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Guidance for building a folding dedicated computer

Post by bruce »

The characteristics of projects so vary. Small projects a different that big projects and there are probably variations in the particular type of analysis being done.

The "Everyone on here seems to think you need x8 PCIe" comes from questions about when the bus speed "matters" The subtlety here is that to some people, it "matters" if the only GPU isn't running at a constant 100% and to others, running two GPUs at, say, 95% is actually a big improvement.

Actually, a very fast GPU needs more bandwidth than a moderate or slow GPU -- especially if you demand that the GPU utilization always be 100%.
Slower GPUs work find with a lower bandwidth, and if you need to allocate lower bus bandwidth in order to accommodate more GPUs, any GPU will get more work done with an X1 connection that if it's not connected.

Only you can decide the best way to spread the resources of your PCIe lanes across whatever group of GPUs you can connect.
bruce
Posts: 20910
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Guidance for building a folding dedicated computer

Post by bruce »

boristsybin wrote:That is very good numbers. What FAH Client and driver version you use? Seems that 1060 is very suitible for x1 Gen2 on Linux
It's unlikely that either the client version of the driver version have very much to do with it.

If you want every project to run at 100%, then give your GPU unlimited bandwidth. If you'll settle for some running at 99% and others at 95%, then you've still made a good change.

Depending on the the MB, the total bandwidth that is allocated has a cap as well as the particular slot. Each device gets an allocation of a specific chunk at boot time. In some cases, adding a 1x slot can reduce another slot from 16x to 8x or something like that -- if that matters on the particular project and GPU that is involved.
foldy
Posts: 2061
Joined: Sat Dec 01, 2012 3:43 pm
Hardware configuration: Folding@Home Client 7.6.13 (1 GPU slots)
Windows 7 64bit
Intel Core i5 2500k@4Ghz
Nvidia gtx 1080ti driver 441

Re: Guidance for building a folding dedicated computer

Post by foldy »

The important part is the OS: 8x pcie speed recommendation for full speed of fast GPUs is for Windows only. Linux needs much less pcie bandwidth.
Nathan_P
Posts: 1180
Joined: Wed Apr 01, 2009 9:22 pm
Hardware configuration: Asus Z8NA D6C, 2 x5670@3.2 Ghz, , 12gb Ram, GTX 980ti, AX650 PSU, win 10 (daily use)

Asus Z87 WS, Xeon E3-1230L v3, 8gb ram, KFA GTX 1080, EVGA 750ti , AX760 PSU, Mint 18.2 OS

Not currently folding
Asus Z9PE- D8 WS, 2 E5-2665@2.3 Ghz, 16Gb 1.35v Ram, Ubuntu (Fold only)
Asus Z9PA, 2 Ivy 12 core, 16gb Ram, H folding appliance (fold only)
Location: Jersey, Channel islands

Re: Guidance for building a folding dedicated computer

Post by Nathan_P »

foldy wrote:The important part is the OS: 8x pcie speed recommendation for full speed of fast GPUs is for Windows only. Linux needs much less pcie bandwidth.
It may need less but you still see a performance drop off from anything lower than PCIe2.0 x8 on Linux
Image
bruce
Posts: 20910
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Guidance for building a folding dedicated computer

Post by bruce »

Nathan_P wrote:It may need less but you still see a performance drop off from anything lower than PCIe2.0 x8 on Linux
True, but it's still a personal judgement whether the drop-off is significant or not ... as compared to the addition of another GPU.
foldy
Posts: 2061
Joined: Sat Dec 01, 2012 3:43 pm
Hardware configuration: Folding@Home Client 7.6.13 (1 GPU slots)
Windows 7 64bit
Intel Core i5 2500k@4Ghz
Nvidia gtx 1080ti driver 441

Re: Guidance for building a folding dedicated computer

Post by foldy »

Who is interested in pcie bandwidth limits, we have this thread
viewtopic.php?f=38&t=28847
ollie1983
Posts: 7
Joined: Sat Jul 29, 2017 8:12 pm

Please advise, hoping to build a dedicated folding machine

Post by ollie1983 »

As I have posted in the newbie section, I am looking to build or buy a fairly brutish PC to fold with. It might get some VR gaming as well eventually.

I am thinking along the lines of an X99 platform (probably Asus Sabertooth), i7 6850K CPU and probably a GTX 1080ti slotted on.

Am I going along the right lines for serious folding output with long term reliability? OR should I be choosing a different processor/mobo and SLI or something? Are AMD CPUs/platforms worth using instead? Various reviews are saying AMD have now got the edge in various benchmarks etc etc, but folding is a distinctly different application.

Any suggestion of a sensible case with good potential airflow, CPU cooler and PSU would also be useful.

I have built PCs before but my current rig is a few years old now and I just keep skipping along GPU generations to keep it up fairly current. I am just not that up to date with my knowledge of the respective hardware families these days.

Thanks
boristsybin
Posts: 50
Joined: Mon Jan 16, 2017 11:40 am
Hardware configuration: 4x1080Ti + 2x1050Ti
Location: Russia, Moscow

Re: Please advise, hoping to build a dedicated folding machi

Post by boristsybin »

ollie1983 wrote:As I have posted in the newbie section, I am looking to build or buy a fairly brutish PC to fold with. It might get some VR gaming as well eventually.
Asus WS-series motherboard
Intel 8-thread CPU
16 to 32 Gb RAM
4 to 7 1080Ti
PSU by Seasonic / Corsair / EVGA / Superflower with common +12v line 1200 W and more
watercooling
Image
Post Reply