Threadripper Performance

Moderators: Site Moderators, PandeGroup

Re: AMD 3960X

Postby bruce » Mon Jan 20, 2020 6:33 pm

Gleep wrote:Unrelated to FAH, the current high core count offerings of AMD and Intel make it clear that Windows has some significant issues handling 30+ logical processors.

I agree.

Nevertheless, FAH has always focused on the *@home market and there are very few folks who will spend $1000+ for a CPU for a home computer. First is the basic issue of science. Adding an expensive GPU to a computer adds more computing power than adding a threadripper. Second, there's the issue of popularity. A lot more Donors see a gamer quality GPU as more useful than one with a limited video capability but with the ability to run more programs concurrently. People are much more likely to spend $500+ to $2000+ for a high end GPU than a high-end CPU. Doing so also earns a lot more FAH points reflecting FAH's preference for that improved science.
Of course I have no idea if 45 threads is better overall for the science or if it risks the slot stalling due to WU shortage or whatever. I'm surprised to see a CPU above 1M PPD, although most of the points are from the bonus of returning WUs so quickly.


FAH will not stall. You'll get an assignment, though it will reduce the number of allocated threads to some number that works.

Most people have compensated for FAH's shortcoming by manually splitting up the processors by creating multiple CPU slots. e.g.- two CPU:16 slots or even three CPU:12 slots are more likely to be fully utilized that one with a setting of CPU:32+

Oh, and I've heard that the 32-thread limitation is a Windows issue. Does you Linux system allow more (not that it's going to be a real benefit.)

The software used to construct FAHCore_a7 is from gromacs.org. I doubt they're going to change that selection inasmuch as the limitations are not a problem for most Donors.

GROMACS uses Domain Decomposition to allocate portions of the calculation to each SMP thread. This method works well with the CPUs on most home computers. That software is not used to construct the FAHCore's for GPUs.
bruce
 
Posts: 23063
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: AMD 3960X

Postby Joe_H » Tue Jan 21, 2020 2:19 am

Windows can handle high thread/core counts, but the way they license it gets in the way a lot. You need to be running with a server license for Windows to go beyond 32 threads, and specific programming and compiler flags need to have been used.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Joe_H
Site Admin
 
Posts: 4664
Joined: Tue Apr 21, 2009 4:41 pm
Location: W. MA

Re: AMD 3960X

Postby Gleep » Tue Jan 21, 2020 3:52 pm

bruce wrote:Nevertheless, FAH has always focused on the *@home market and there are very few folks who will spend $1000+ for a CPU for a home computer. First is the basic issue of science. Adding an expensive GPU to a computer adds more computing power than adding a threadripper. Second, there's the issue of popularity. A lot more Donors see a gamer quality GPU as more useful than one with a limited video capability but with the ability to run more programs concurrently. People are much more likely to spend $500+ to $2000+ for a high end GPU than a high-end CPU. Doing so also earns a lot more FAH points reflecting FAH's preference for that improved science.

I agree completely. My setup is not typical, I post to reason thru FAH settings for optimal performance with the hardware I have and to let others know what the general performance is. A single top tier GPU does more FAH work in a day than a threadripper and cheaper.

I don't expect FAH to make any changes to accommodate this type of hardware.

bruce wrote:Oh, and I've heard that the 32-thread limitation is a Windows issue. Does you Linux system allow more (not that it's going to be a real benefit.)

The software used to construct FAHCore_a7 is from gromacs.org. I doubt they're going to change that selection inasmuch as the limitations are not a problem for most Donors.

GROMACS uses Domain Decomposition to allocate portions of the calculation to each SMP thread. This method works well with the CPUs on most home computers. That software is not used to construct the FAHCore's for GPUs.

It most definitely is a windows limitation. I'm dual booting windows/linux and in linux the FAH client auto config selected 46 threads (FAHCore_a7 dropped to 45), I found the PPD difference between the two OSes to be substantial, but that's not news to anyone around here. :)
Gleep
 
Posts: 12
Joined: Tue Dec 17, 2019 4:12 pm

Re: AMD 3960X

Postby Nathan_P » Tue Jan 21, 2020 8:06 pm

Gleep wrote:I installed linux and let it auto configure and run over the weekend. From a PPD perspective the difference is massive. I have 2 GPUs now so it set the CPU slot to use 46 threads (which the logs show it drop to 45, I assume because of the prime thread count weirdness). The PPD of the CPU slot is 1-1.1 million. Under Windows I was getting 600-650k, with some slot configs dropping to 500k (the four slot config).

Of course I have no idea if 45 threads is better overall for the science or if it risks the slot stalling due to WU shortage or whatever. I'm surprised to see a CPU above 1M PPD, although most of the points are from the bonus of returning WUs so quickly.

Unrelated to FAH, the current high core count offerings of AMD and Intel make it clear that Windows has some significant issues handling 30+ logical processors.


1m PPD on a cpu slot hasn't been seen in years and even then it was a quad cpu set up, how times have changed!
Image
Nathan_P
 
Posts: 1448
Joined: Wed Apr 01, 2009 9:22 pm
Location: Jersey, Channel islands

Poor Threadripper 1920X Performance

Postby ColonelRyzen » Thu Jan 23, 2020 4:24 am

I am running FAH in a docker on UnRAID. I have 20 of my 24 threads dedicated to FAH. There are two GPUs as well, but I have plenty of threads to handle that. I am only seeing about 45K PPD, but I am reading that the threadripper CPUs can hit near 100K PPD. Is there something I am doing wrong? Should I just do this in a VM instead?
ColonelRyzen
 
Posts: 6
Joined: Thu Oct 24, 2019 1:49 am

Re: Threadripper Performance

Postby bruce » Thu Jan 23, 2020 5:30 am

A couple of things to note:

1) If you have not successfully completed 10 WUs after configuring a passkey, do that first. You don't get bonus points until then.

2) "I have heard that" ... is a dangerous preamble, particularly if they fail to specify whether they're talking about Linux or Windows. Wait for actual reports by Donors associated with YOUR OS.

3) Most hardware CPU threads share floating point resources with at least one oher thread ... and it is worse in a VM than with native hardware. FAH's CPU performance depends greatly on having dedicated floating point hardware.

4) See also the issues of Domain Decomposition mentioned on the first page of this topic.
bruce
 
Posts: 23063
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Threadripper Performance

Postby JimF » Thu Jan 23, 2020 4:39 pm

A Ryzen 3950X (16/32 cores) for $750. looks good to me. I would wait for Ubuntu 18.04.4 though, to get the latest Linux kernel.
But what is the benefit to science? I like the idea of running Gromacs, but what does it do differently than the GPU app?
JimF
 
Posts: 506
Joined: Thu Jan 21, 2010 2:03 pm

Re: Threadripper Performance

Postby bruce » Thu Jan 23, 2020 7:06 pm

See Gromacs.org.

Gromacs is one of the software develpment projects that has been used by FAH to calculate protein folding since the very early days of FAH --- back when typical CPUs had 1 or 2 or 4 cores. Over the years, as an Open project, it as progressed in many areas. Meanwhile, Stanford chartered a parallel development effort called OpenMM which has also progressed in many areas and which focused mainly on useing GPUs although technically either package can run on either hardware platform. There are internal differences but I'm not knowledgable enough to explain them.

Other software has also been used as the basis of historic FAHCores but currently only these two are active.
bruce
 
Posts: 23063
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Threadripper Performance

Postby MeeLee » Thu Jan 23, 2020 11:59 pm

I would recommend using a task manager or htop, and see CPU load.
If all cores are at a 100% load, try dropping a few threads, until 1 of the cores show just under 100%. Then bump it up by 1 thread. You'd be surprised that sometimes running a 24/20 configuration runs the same PPD or higher than a 24/24 config (maxed out cores).
MeeLee
 
Posts: 470
Joined: Tue Feb 19, 2019 10:16 pm

Previous

Return to Discussions of General-FAH topics

Who is online

Users browsing this forum: No registered users and 0 guests

cron