Recently, AMD has revealed and announced the availability of the 3rd Gen AMD EPYC processors with AMD 3D V-Cache technology and the Instinct MI210 accelerator.

3rd Gen AMD EPYC processors with AMD 3D V-Cache technology

3rd Gen AMD EPYC processors with AMD 3D V Cache technology

A couple of weeks ago, we’ve reported on AMD’s consumer chip running the 3D V-Cache technology which is the Ryzen 7 5800X3D which utilizes 3D-stacked caches to allow more data to be stored within the low-latency temporary storage for faster processing power and responsiveness. That technology is moving into the enterprise state via the main highlight of the show – the 3rd Gen AMD EPYC processors.

Built with the Zen 3 architecture, the 3D V-Cache technology is capable of bringing a maximum of 66% improvement in performance when compared to the standard, non-3D-stacked EPYC processors while having the same hardware and software compatibility to give industry players the ability to quickly upgrade to these new chips if deemed feasible for their business. According to AMD, technical computing loads such as computational fluid dynamics (CFD), finite element analysis (FEA), electronic design automation (EDA), and structural analysis will be some of the greatest beneficiaries of the cache tech.

As of now, industry partners of hardware and software include Atos, Cisco, Dell Technologies, Gigabyte, HPE, Lenovo, QCT, Supermicro, Altair, Ansys, Cadence, Dassault Systèmes, Siemens, and Synopsys already supports the 3rd Gen AMD EPYC processors with AMD 3D V-Cache technology right now while Microsoft Azure HBv3 Virtual Machines has been upgraded with these chips as well that boosts their HPC performance for up to 80% too.

Here’s the spec sheet for the full portfolio if you’re wondering how beastly they are.

Cores

Model

# CCD

TDP (W)

cTDP range (W)

Base Freq (GHz)

Max Boost Freq (Up to GHz)

L3 Cache (MB)

DDR Channels

Price (1KU)

64

7773X

8

280

225 – 280

2.20

3.50

768

8

USD8,800

32

7573X

2.80

3.60

USD5,590

24

7473X

240

2.80

3.70

USD3,900

16

7373X

3.05

3.80

USD4,185

AMD Instinct MI200 Accelerator

AMD Instinct MI210

On the other side of the computing space, the new Instinct MI200 series accelerators offer exascale-class data processing capability for any customer that needs top-tier power in the HPC and AI fields.  One of the new products – the Instinct MI210 – is one of the more accessible options as it utilizes the PCIe form factor which itself already has mature and broad support while having a leading FP64 performance that can be taken further via the AMD Matrix Core Technology.

On the other hand, the adoption of ROCm basically announced AMD is supporting the act of scientific discoveries right now and it is better than ever. The latest revision, ROCm 5, is getting due support from not only the Instinct MI200 products but also the Radeon PRO W6800 professional graphics card. Add that with the support of the Red Hat Enterprise Linux 8.5, developers, researchers, scientists, engineers – anyone that needs a crazy amount of processing power will be able to harness the power of these accelerators.

Aside from taking info from the hardware perspective, the AMD Accelerator Cloud service allows customers to evaluate the AMD Instinct accelerators and AMD ROCm software remotely to test a variety of deployments like application benchmarking, multi-GPU/multi-node scaling, the platform provides quick and easy access to the latest GPUs and software with ease.

Here’s how the Instinct MI210 fare against the stronger counterparts from a comparison standpoint.

Model

Compute Units

Stream Processors

FP64 | FP32 Vector (Peak)

FP64 | FP32 Matrix (Peak)

FP16 | bf16 (Peak)

INT8 (Peak)

HBM2e
ECC
Memory

Memory Bandwidth

Form Factor

AMD Instinct MI210

104

6,656

Up to 22.6 TF

Up to45.3 TF

Up to 181.0 TF

Up to 181.0 TOPS

64GB

Up to 1.6 TB/sec

PCIe

AMD Instinct MI250

208

13,312

Up to 45.3 TF

Up to 90.5 TF

Up to 362.1 TF

Up to 362.1 TOPS

128GB

3.2 TB/sec

OCP Accelerator Module (OAM)

AMD Instinct MI250x

220

14,080

Up to 47.9 TF

Up to 95.7 TF

Up To 383.0 TF

Up to 383.0 TOPS

128GB

3.2 TB/sec

OCP Accelerator Module (OAM)

Facebook
Twitter
LinkedIn
Pinterest

Related Posts

Subscribe via Email

Enter your email address to subscribe to Tech-Critter and receive notifications of new posts by email.