What's in a Name? Little to No Difference in a Processor's SKU Can Translate to a Big Impact on Performance, Part 2
Herrera on Hardware: High-power components like GPUs often have performance rein in to fit in more compact form factors... and you may not notice from the brand and SKU.
In our previous column, we introduced a challenge facing workstation vendors and buyers of emerging class of both mobile models as well as shrunken form factor fixed machines. The vendor needs to cram more components in a smaller space, ultimately (and to varying degrees) required to rein in performance to ensure tolerable heat dissipation and reliable operation. The buyer needs to understand the tradeoff in performance that must be made — particularly with respect to the CPU and GPU — when stepping down in system size. Worse, that buyer might have to navigate some murky branding, SKU numbers, and datasheet specs that make it difficult to discern the subtle-but-salient differences that dictate when — and to what degree — performance will degrade.
In Part 1, we focused our attention on the CPU, comparing models that look very similar on the outside, but will yield significantly different performance in the case of multi-threaded (MT) workloads. This month in Part 2, we’ll take a look at the GPU, which can present even more difficulty in discerning the performance tradeoffs across branding and SKUs.
GPU: An NVIDIA RTX A5000 versus an NVIDIA RTX A5000?
Consider Nvidia’s dominant RTX line of add-in card GPUs fixed machines (e.g., deskside towers) and mobile GPU modules for mobile workstations. Lenovo’s ThinkStation P360 Ultra differentiates among sub-SFF fixed machines by offering the RTX A5000, which — by the literal reading of respective datasheets — is something a full tower can also claim, but not typical SFF workstations, which typically max out with an RTX A4000. It sounds great, and yes, that option is a legitimate feather in the cap for Lenovo and its Ultra. But, there’s some context that needs to be laid to understand what that difference actually means, and what it doesn’t.
That context stems from Lenovo’s sensible use of the lower-power mobile version for its Ultra fixed machine, as well as Nvidia’s current branding of its professional RTX GPU lines. Too small to house a conventional add-in card, the Ultra — like other sub-SFF models — instead opts for the mobile version. And that leads to the non-intuitive realization that an RTX A5000 for fixed workstations is not the same as an RTX A5000 for mobile applications, as a look at the basic specs below illustrates. The memory size and bandwidth, number of available processing cores, and aggregate FLOPS rate are all notably higher on the add-in card version.
Salient metrics of the RTX A5000 and RTX A4000 add-in cards versus the RTX A5000 mobile module. Data source: Nvidia.
After noting the obvious differences between the RTX A5000 add-in card and the RTX A5000 mobile module in the table above, take a look as well one column over and compare the same specs for the RTX A4000 add-in card. The RTX A5000 mobile actually shares more in common with the RTX A4000 add-in card than the RTX A5000 add-in card, despite the SKU numeration. That’s no surprise when you look under the hood, because the RTX A4000 and RTX A5000 mobile are both based on the same GPU chip.
Is Nvidia short-changing you on your mobile version of the RTX A5000? Well, one could certainly argue the point from the perspective of branding and SKU numbering. It’s worth noting that while the company has always used overlapping 1000s SKUs (e.g ., 4000, 5000) to designate relative performance tiers for both their fixed add-in card line and their mobile module lines, the company has muddied the waters further in the days since it axed the Quadro brand in favor of the simple RTX. With Quadro, Nvidia would make the line clear between fixed and mobile with an “-M” suffix, but it abandoned that designation with RTX, effectively duplicating the same SKU in both lines.
But outside of ambiguous branding, no, Nvidia’s stingier spec’d RTX 5000 for mobiles is constrained not marketing but by physics. It’s the same story for the GPU as the CPU: dial up performance, and power consumption follows, often non-linearly, and the more power a device consumes, the hotter it gets. To constrain maximum chip temperatures then, maximum power must be reined in as well. Nvidia’s specs bear that out, as the RTX 5000 add-in card has a “design power” of 230 W, while the mobile version is noted as 80 – 165 W, similar to the RTX A4000 add-in card’s 140 W power. (Design power essentially translates to the power threshold at which the device can run, and the system can reliably mitigate the heat produced at that level).
As this column often notes, of course, datasheet specifications — mostly peak measures — don’t directly correlate to the throughput you’ll see. The more amply spec’d component offers the potential of higher performance, but whether it can — and to what degree it can — depends on the type of workloads it’s running, along with how well the rest of the system can keep up. SPECviewperf 2020 arguably provides the best unbiased perspective (albeit never perfect) of the relative capabilities each can potentially deliver. Most relevant to CAD users are the scores on SPEC Viewperf 2020’s viewsets gleaned from the popular applications Solidworks, CATIA, Creo, and 3dsmax.
CONTINUE READING. Alex Herrera next analyzes how they compare and why. Find out how these differences can affect your workstation performance. Read more >>
From Our Sponsors
Sponsored: Facilities Planning and Engineering Taps into Digital Technology
Innovators Recognized at Bentley’s Year in Infrastructure and Going Digital Awards. Find out how these winning entries are using digital technology to create powerful and usable ways to share and access data. By Cadalyst Staff, January 24, 2023. Read more >>
WHAT'S NEW FROM CADALYST
All-in-One Handheld Devices Aid GIS Workflows
Combined receiver and data collection units expedite processes for U.S. utility company. By Andrew G. Roe, January 12, 2023. Read more >>
CAD Manager's Column: What Management Really Wants
Approach your job in a way that meets management’s expectations so they value you and your CAD team more. By Robert Green, January 25, 2023.Read more >>
MCAD Solutions: New Product Development Strategies for Smaller Companies
Use an NPD plan to help your company successfully bring new ideas to market. Cadalyst Staff, January 9, 2023.Read more >>
CAD Manager's Back-to-Basics Bootcamp
Sometimes CAD managers get so far into the weeds of specific projects that it's easy to forget the basic skills that are needed as CAD managers. In our Back-to-Basics Boot Camp, we’ll help you focus on the key skills and strategies that every CAD manager needs to function at maximum efficiency.
CAD Manager Chronicles: Episode 4: Making Upgrade Decisions
In this fourth episode of Cadalyst's CAD Chronicles, Robert Green discusses how best to make decisions around upgrading your software. When, what, how much, which seats? Find out how to make the best decisions for your work place.
It comes down to physics — a deskside can always outperform a mobile workstation. Cadalyst hardware expert, Alex Herrera, looks under the hood of both to break down the pros and cons of each form factor.