CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > General Forums > Hardware

Eight vs Sixteen DIMMs with dual EPYC 7443

Register Blogs Community New Posts Updated Threads Search

Like Tree1Likes
  • 1 Post By flotus1

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   November 25, 2021, 14:10
Default Eight vs Sixteen DIMMs with dual EPYC 7443
  #1
New Member
 
Manish K
Join Date: Mar 2021
Posts: 2
Rep Power: 0
maksins is on a distinguished road
I went through the threads and general hardware recommendations, but could not find answer to my questions, so I am posting here.

I am getting a workstation with dual socket EPYC 7443 processor. The motherboard has 16 DIMMs.
As I understand, I should have at least 1 DIMM/stick per channel for balanced performance. Since it is dual EPYC, I have 16 memory channels, so I was inclined to get all 16 DIMMs filled.
My vendor is telling offering me 8 x 32 GB 3200 MHz dual channel memory sticks. I requested 16 x 16 GB 3200 MHz, but he says if I use all 16 DIMMs, my memory may operate at lower frequencies (e.g., 2666 MHz).
I would primarily use this workstation for FEA (LS-DYNA) and AUTODYN.

I have three questions:
How much of performance different would be in terms of 8 x 32 GB vs 16 x 16 GB?
Would dual channel RAM mean that effectively I should fill X/2 DIMMs for X memory channels?
Is it true that if I fill all 16 DIMM slots then memory may operate at lower frequencies?

Please share your insights.
maksins is offline   Reply With Quote

Old   November 26, 2021, 04:34
Default
  #2
Super Moderator
 
flotus1's Avatar
 
Alex
Join Date: Jun 2012
Location: Germany
Posts: 3,427
Rep Power: 49
flotus1 has a spectacular aura aboutflotus1 has a spectacular aura about
Quote:
How much of performance different would be in terms of 8 x 32 GB vs 16 x 16 GB?
Hard to put a number down, it depends on a lot of factors. But you should not listen to the advice from this vendor. Not populating all memory channels makes no sense at all.
Quote:
Would dual channel RAM mean that effectively I should fill X/2 DIMMs for X memory channels?
No idea how "dual-channel" came into this. There is no such thing as dual-channel RAM. Maybe they meant dual rank???
Quote:
Is it true that if I fill all 16 DIMM slots then memory may operate at lower frequencies?
That should not be a thing with third gen Epyc CPUs. And even if memory transfer rates dropped down to DDR4-2933, the performance loss from that is still much lower than leaving half of all memory channels unpopulated.

Overall, pretty bad advice from your vendor. Which is a common occurrence unfortunately.
flotus1 is offline   Reply With Quote

Old   November 26, 2021, 05:58
Default
  #3
Member
 
Yan
Join Date: Dec 2013
Location: Milano
Posts: 43
Rep Power: 13
aparangement is on a distinguished road
Send a message via Skype™ to aparangement
Motherboard supermicro's H11dsi?

I heard another version, says all 16 DIMMs would down clock to 2933.

Turns out NOT true, at least not for BIOS versions later than August 2021, runs 3200 out of the box.

I did manually down clocked the RAM from 3200 to 2933, actually almost the same performance, due to better timings I guess.

But I guess 2667 would be too low to keep same level of performance, even with better timings.

Quote:
Originally Posted by maksins View Post
I went through the threads and general hardware recommendations, but could not find answer to my questions, so I am posting here.

I am getting a workstation with dual socket EPYC 7443 processor. The motherboard has 16 DIMMs.
As I understand, I should have at least 1 DIMM/stick per channel for balanced performance. Since it is dual EPYC, I have 16 memory channels, so I was inclined to get all 16 DIMMs filled.
My vendor is telling offering me 8 x 32 GB 3200 MHz dual channel memory sticks. I requested 16 x 16 GB 3200 MHz, but he says if I use all 16 DIMMs, my memory may operate at lower frequencies (e.g., 2666 MHz).
I would primarily use this workstation for FEA (LS-DYNA) and AUTODYN.

I have three questions:
How much of performance different would be in terms of 8 x 32 GB vs 16 x 16 GB?
Would dual channel RAM mean that effectively I should fill X/2 DIMMs for X memory channels?
Is it true that if I fill all 16 DIMM slots then memory may operate at lower frequencies?

Please share your insights.
aparangement is offline   Reply With Quote

Old   November 26, 2021, 12:55
Default
  #4
New Member
 
Manish K
Join Date: Mar 2021
Posts: 2
Rep Power: 0
maksins is on a distinguished road
Thank you @flotus1 and @aparangement for the answers.

Quote:
Originally Posted by aparangement View Post
Motherboard supermicro's H11dsi?
He said Gigabyte, so the only SP3 motherboard I know is Gigabyte MZ72-HB0.
Now, I have asked him for 16 x 16 GBs. He said prices may go up a little as 32 GB Reg server memories have better availability. I said ok, it is unlikely that I would invest in 8 x 32 GB to utilize all 16 DIMMs in future, it may be just be better to get a new system.

Any suggestion on CPU cooling for this kind of system? I would be using this as a desk Workstation with 4U tower Stand-alone/Pedestal Server chassis.
I don't want too much of noise, I enquired about liquid cooling and the vendor said it may cost north of $1500 to install liquid cooling with this. I am thinking Noctua NH-U14S TR4-SP3 Air Cooler. Any other recommendation for Air Coolers are welcome.
maksins is offline   Reply With Quote

Old   November 26, 2021, 22:13
Default
  #5
Member
 
Yan
Join Date: Dec 2013
Location: Milano
Posts: 43
Rep Power: 13
aparangement is on a distinguished road
Send a message via Skype™ to aparangement
Sorry I didn't notice it's 7003.

For 7003 I have no experience at all. (I would say it is less likely for 7003 board to have such strange behaviour, but who knows.. It's too expensive to actually buy one and test.)

Maybe you could ask for another model? Supermicro's H12DSI should also be available now. But still, better make it clear that you would return the machine if the RAM gets down clocked.

Quote:
Originally Posted by maksins View Post
Thank you @flotus1 and @aparangement for the answers.


He said Gigabyte, so the only SP3 motherboard I know is Gigabyte MZ72-HB0.
Now, I have asked him for 16 x 16 GBs. He said prices may go up a little as 32 GB Reg server memories have better availability. I said ok, it is unlikely that I would invest in 8 x 32 GB to utilize all 16 DIMMs in future, it may be just be better to get a new system.

Any suggestion on CPU cooling for this kind of system? I would be using this as a desk Workstation with 4U tower Stand-alone/Pedestal Server chassis.
I don't want too much of noise, I enquired about liquid cooling and the vendor said it may cost north of $1500 to install liquid cooling with this. I am thinking Noctua NH-U14S TR4-SP3 Air Cooler. Any other recommendation for Air Coolers are welcome.
aparangement is offline   Reply With Quote

Old   November 27, 2021, 10:39
Default
  #6
Super Moderator
 
flotus1's Avatar
 
Alex
Join Date: Jun 2012
Location: Germany
Posts: 3,427
Rep Power: 49
flotus1 has a spectacular aura aboutflotus1 has a spectacular aura about
All right, here is the deeper dive:
Reduced maximum memory transfer rates have become less common, or at least less pronounced with modern systems. And even if the official spec (which is surprisingly hard to get a hold of) dictates reduced speed for some memory configurations, it is often possible to just overwrite that setting in bios. So that's reason 1 not to worry about it.
Looking at what actually could lead to reduced memory speed gives us reason 2: It is about the number of memory ranks per channel. The single value for maximum supported memory transfer rates (DDR4-3200 in this case) is for 1 rank per channel. Meaning if you populate all 16 memory channels with a single-rank DIMM, you are still guaranteed DDR4-3200. Even with 2 ranks per channel, I find it highly unlikely that Epyc Milan official spec would be lower than that. And it would definitely be possible to set it to DDR4-3200 anyway. What happens with 4 ranks per channel might be debatable, but with the amount of memory we are talking about here, this is irrelevant anyway.
And lastly reason 3, which I already discussed in my first post: dropping memory transfer rates a bit is still much better than just leaving half of all memory channels unpopulated.

Quote:
Any suggestion on CPU cooling for this kind of system? I would be using this as a desk Workstation with 4U tower Stand-alone/Pedestal Server chassis.
I don't want too much of noise, I enquired about liquid cooling and the vendor said it may cost north of $1500 to install liquid cooling with this. I am thinking Noctua NH-U14S TR4-SP3 Air Cooler. Any other recommendation for Air Coolers are welcome.
A 4U form factor will negatively impact noise for several reasons. The limited space only allows for small CPU coolers. E.g. a Noctuas NH-U14S won't fit.
What's worse, most 4U cases lean more towards servers than workstations. Which means loud case fans, and sometimes even server-class power supplies with tiny 40mm fans that will drive you crazy within minutes.
Water cooling for the CPUs won't help with that. So if you value a quiet system, the case is a big factor to consider.
aparangement likes this.
flotus1 is offline   Reply With Quote

Reply

Tags
7443, dimms, epyc


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
New dual EPYC CPU Supermicro motherboard thomas_CFD Hardware 3 May 23, 2021 17:54
Source for (/existence of) 8GB dual rank dimms? hsnyder Hardware 3 June 19, 2020 05:54
New OpenFOAM Server (Dual Epyc Rome) fanta Hardware 3 April 1, 2020 15:24
New 128 mini cluster - Cascade Lake SP or EPYC Rome? SLC Hardware 8 December 16, 2019 17:25
Another Dual Epyc Setup for Openfoam Mr Jordan Hardware 5 January 25, 2019 07:20


All times are GMT -4. The time now is 15:30.