AMD Instinct MI210 Accelerator
The ThinkSystem AMD Instinct MI210 Accelerator is a compute workhorse optimized for accelerating single precision and double-precision HPC-class systems. The accelerator can also be deployed for training large-scale machine intelligence workloads. The accelerator's powerful compute engine, new matrix math FP64 cores, and advanced memory architecture, combined with AMD's ROCm open software platform and ecosystem, provide a powerful, flexible heterogeneous compute solution designed to help datacenter designers meet the challenges of a new era of compute.
Figure 1. AMD Instinct MI210 PCIe Gen4 Passive Accelerator
A visual representation of the AMD Instinct MI210 PCIe Gen4 Passive Accelerator, showing its physical form factor and key components.
Did you know? ❓
The ThinkSystem SR670 V2 supports 8x MI210 Accelerators, which can be connected together using 2x Infinity Fabric Link Bridge Cards, linking two sets of four GPUs. Each accelerator has three Infinity Fabric links with 300 GB/s of Peer-to-Peer (P2P) bandwidth performance. The AMD Infinity Architecture enables platform designs with direct-connect GPU hives with high-speed P2P connectivity, delivering up to 1.2 TB/s of total theoretical GPU bandwidth.
Part Number Information
The following table shows the part numbers for the MI210 Accelerator.
Table 1. Ordering Information
Part Number | Feature Code | Description |
---|---|---|
4X67A81102 | BP04 | ThinkSystem AMD Instinct MI210 PCIe Gen4 Passive Accelerator |
4X67A82325 | BRMD | ThinkSystem AMD Instinct MI210 4x Infinity Fabric Link Bridge Card |
The PCIe option part number includes:
- One MI210 Accelerator with full-height (3U) adapter bracket attached
- Documentation
Each Infinity Fabric Link Bridge Card connects four MI210 Accelerators.
Features
The AMD Instinct MI210 accelerator offers the following features: The AMD Instinct MI210 accelerator extends AMD's industry performance leadership in accelerated compute for double precision (FP64) on PCIe form factors for mainstream HPC and AI workloads in the data center. Built on AMD Exascale-class technologies with the 2nd Gen AMD CDNA architecture, the MI210 enables scientists and researchers to tackle pressing challenges from climate change to vaccine research. MI210 accelerators, combined with the AMD ROCm 5 software ecosystem, allow innovators to tap the power of HPC and AI data center PCIe GPUs to accelerate their time to science and discovery. Powered by the 2nd Gen AMD CDNA architecture, the AMD Instinct MI210 accelerator delivers HPC performance leadership in FP64 for a broad set of HPC & AI applications. The MI210 accelerator is built to accelerate deep learning training, providing an expanded range of mixed-precision capabilities based on AMD Matrix Core Technology, and delivers an outstanding 181 teraflops peak theoretical FP16 and BF16 performance to fuel the convergence of HPC and AI. AMD innovations in architecture, packaging, and integration are pushing the boundaries of computing by unifying the most important processors in the data center: the CPU and the GPU accelerator. With innovative double-precision Matrix Core capabilities and the 3rd Gen AMD Infinity Architecture, AMD is delivering performance, efficiency, and overall system throughput for HPC and AI using AMD EPYC CPUs and AMD Instinct MI210 accelerators. AMD ROCm is an open software platform allowing researchers to tap the power of AMD Instinct accelerators to drive scientific discoveries. The ROCm platform is built on open portability, supporting environments across multiple accelerator vendors and architectures. With ROCm 5, AMD extends its platform powering top HPC and AI applications with AMD Instinct MI200 series accelerators, increasing ROCm accessibility for developers and delivering outstanding performance across key workloads. The AMD Instinct MI210 accelerator brings commercial HPC & AI customers the compute engine selected for the first U.S. Exascale supercomputer. Powered by the 2nd Gen AMD CDNA architecture, the MI210 accelerator delivers outstanding performance for HPC and AI. The MI210 PCIe GPU delivers superior double and single precision performance for HPC workloads with up to 22.6 TFLOPS peak FP64|FP32 performance, enabling scientists and researchers globally to process HPC parallel codes more efficiently across several industries. AMD's Matrix Core technology delivers a broad range of mixed precision operations, enabling work with large models and enhancing memory-bound operation performance for AI and machine learning workloads. The MI210 offers optimized BF16, INT4, INT8, FP16, FP32, and FP32 Matrix capabilities, providing supercharged compute performance for AI system requirements. The AMD Instinct MI210 accelerator handles large data efficiently for training and delivers 181 teraflops of peak FP16 and bfloat16 floating-point performance for deep learning training. AMD Instinct MI210 GPUs provide advanced I/O capabilities in standard off-the-shelf servers with AMD Infinity Fabric technology and PCIe Gen4 support. The MI210 GPU delivers 64 GB/s CPU to GPU bandwidth without PCIe switches, and up to 300 GB/s of Peer-to-Peer (P2P) bandwidth performance through three Infinity Fabric links. The AMD Infinity Architecture enables platform designs with dual and quad, direct-connect, GPU hives with high-speed P2P connectivity, delivering up to 1.2 TB/s of total theoretical GPU bandwidth within a server design. Infinity Fabric helps unlock accelerated computing, enabling a quick and simple onramp for CPU codes to accelerated platforms. AMD Instinct MI210 accelerators provide up to 64GB High-bandwidth HBM2e memory with ECC support at a clock rate of 1.6 GHz, delivering an ultra-high 1.6 TB/s of memory bandwidth to support large data sets and eliminate bottlenecks moving data in and out of memory. Combining this performance with the MI210's advanced Infinity Fabric I/O capabilities allows workloads to be pushed closer to their full potential.Exascale-Class Technologies for the Data Center
Purpose-built Accelerators for HPC & AI Workloads
Innovations Delivering Performance Leadership
Ecosystem without Borders
2nd Generation AMD CDNA Architecture
AMD Infinity Fabric Link Technology
Ultra-Fast HBM2e Memory
Technical Specifications
The following table lists the MI210 Accelerator specifications.
Table 2. Technical Specifications
Feature | Specification |
---|---|
Compute units | 104 |
Stream Processors: | 6,656 |
GPU Memory: | 64GB HBM2e |
ECC | Yes |
Memory Bandwidth: | 1.6 TB/s |
Peak FP64 Vector | 23 TFLOPS |
Peak FP32 Vector | 23 TFLOPS |
Peak FP64 Matrix | 45 TFLOPS |
Peak FP32 Matrix | 45 TFLOPS |
Peak FP16 | 181 TFLOPS |
Peak BF16 | 181 TFLOPS |
Bus Interface: | PCIe Gen 4 x16 |
AMD Infinity Fabric Link support: | 4 GPU (4-GPU link support by using part number 4X67A82325) |
Board Form Factor: | Full-Height, Full-Length, Dual-Slot |
Thermal Solution: | Passively Cooled |
Standard Max Power: | 300W TDP |
OS Support: | Linux 64-bit |
ROCm Software Platform: | ROCm 5.0 |
Programming Environment: | OpenMP, OpenCL, ISO C++ (via HIP conversion tool), CUDA (via HIP conversion tool) |
Server Support
The following tables list the ThinkSystem servers that are compatible.
Table 3. Server Support (Part 1 of 3)
Part Number | Description | Edge | 1S Intel V2 | AMD V3 | Intel V3 |
---|---|---|---|---|---|
4X67A81102 | ThinkSystem AMD Instinct MI210 PCIe Gen4 Passive Accelerator | N | N | N | N |
4X67A82325 | ThinkSystem AMD Instinct MI210 4x Infinity Fabric Link Bridge Card | N | N | N | N |
Z | Z | 3 | 3 | ||
Z | 8 | 8 | 2 | ||
Z | N | 4 | N | ||
Z | N | N | N | ||
Z | N | N | N | ||
Z | N | N | N | ||
Z | N | N | N | ||
Z | N | N | N | ||
Z | N | N | N | ||
Z | N | N | N | ||
Z | N | N | N | ||
Z | N | N | N | ||
Z | N | N | N | ||
Z | N | N | N | ||
Z | N | N | N | ||
Z | N | N | N | ||
Z | N | N | N | ||
Z | N | N | N |
Table 4. Server Support (Part 2 of 3)
Part Number | Description | Dense V3 | 2S Intel V2 | AMD V1 | Dense V2 | 4S V2 | 8S |
---|---|---|---|---|---|---|---|
4X67A81102 | ThinkSystem AMD Instinct MI210 PCIe Gen4 Passive Accelerator | N | N | N | N | N | N |
4X67A82325 | ThinkSystem AMD Instinct MI210 4x Infinity Fabric Link Bridge Card | N | N | N | N | N | N |
Z | Z | 3 | N | N | N | ||
Z | 8 | N | N | N | |||
N | 21 | N | N | N | |||
Y | N | N | N | N | |||
N | N | N | N | N | |||
N | N | N | N | N | |||
N | N | N | N | N | |||
N | N | N | N | N | |||
N | N | N | N | N | |||
N | N | N | N | N | |||
N | N | N | N | N | |||
N | N | N | N | N | |||
N | N | N | N | N | |||
N | N | N | N | N | |||
N | N | N | N | N | |||
N | N | N | N | N | |||
N | N | N | N | N | |||
N | N | N | N | N |
1. Supported only with EPYC 7003 "Milan" processors. Not supported with EPYC 7002 "Rome" processors.
Table 5. Server Support (Part 3 of 3)
Part Number | Description | 4S V1 | 1S Intel V1 | 2S Intel V1 | Dense V1 |
---|---|---|---|---|---|
4X67A81102 | ThinkSystem AMD Instinct MI210 PCIe Gen4 Passive Accelerator | N | N | N | N |
4X67A82325 | ThinkSystem AMD Instinct MI210 4x Infinity Fabric Link Bridge Card | N | N | N | N |
Z | Z | Z | Z | ||
Z | Z | Z | Z | ||
Z | Z | Z | Z | ||
Z | Z | Z | Z | ||
Z | Z | Z | Z | ||
Z | Z | Z | Z | ||
Z | Z | Z | Z | ||
Z | Z | Z | Z | ||
Z | Z | Z | Z | ||
Z | Z | Z | Z | ||
Z | Z | Z | Z | ||
Z | Z | Z | Z | ||
Z | Z | Z | Z | ||
Z | Z | Z | Z | ||
Z | Z | Z | Z | ||
Z | Z | Z | Z | ||
Z | Z | Z | Z | ||
Z | Z | Z | Z |
Operating System Support
The following table lists the supported operating systems.
Tip: ? These tables are automatically generated based on data from Lenovo ServerProven.
Table 6. Operating System Support for ThinkSystem AMD Instinct MI210 PCIe Gen4 Passive Accelerator, 4X67A81102
Operating Systems | SR650 V3 | SR655 V3 | SR665 V3 | SR675 V3 | SR850 V3 | SR860 V3 | SR650 V2 | SR670 V2 | SR655 | SR665 |
---|---|---|---|---|---|---|---|---|---|---|
Red Hat Enterprise Linux 7.9 | N | N | N | N | N | N | Y | Y | Y | Y |
Red Hat Enterprise Linux 8.3 | N | N | N | N | N | N | Y | Y | Y | Y |
Red Hat Enterprise Linux 8.4 | N | N | N | N | N | N | Y | Y | Y | Y |
Red Hat Enterprise Linux 8.5 | N | N | N | N | N | N | Y | Y | Y | Y |
Red Hat Enterprise Linux 8.6 | N | N | N | N | N | N | Y | Y | Y | Y |
Red Hat Enterprise Linux 9.0 | N | N | N | N | N | N | Y | Y | Y | Y |
SUSE Linux Enterprise Server 15 SP3 | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
SUSE Linux Enterprise Server 15 SP4 | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
Ubuntu 18.04.5 LTS | N | N | N | N | N | N | N | N | N | N |
Ubuntu 20.04 LTS | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
Ubuntu 20.04.5 LTS | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
Ubuntu 22.04 LTS | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
1 HW is not supported with EPYC 7002 processors.
Auxiliary Power Cables
The MI210 Accelerator option part number does not ship with auxiliary power cables.
Table 7. Auxiliary Power Cables for MI210
Description | Details |
---|---|
350mm 8pin (2x4) cable | Server support: SR655 (Riser 1 or Riser 2) Option: 4X97A59853, ThinkSystem SR655 GPU Cable Kit Feature: B5T5 SBB: SBB7A14640 Base: SC17A50848 FRU: 02JK011 |
250mm 8pin (2x4) cable | Server support: SR655 (Riser 3) Option: 4X97A59853, ThinkSystem SR655 GPU Cable Kit Feature: B5TS SBB: SBB7A10974 Base: SC17A50844 FRU: 02JK010 |
360mm 8pin (2x4) cable | Auxiliary power cables needed with the SR650 V3, SR655 V3, SR665 V3, SR650 V2, SR665 Option*:
SBB: SBB7A49792 or SBB7A21691 Base: SC17A95312 or SC17A59596 FRU: 03HA297 or 02YE420 |
215mm 8pin (2x4) cable | Auxiliary power cable needed with the SR670 V2 Option: 4X97A69627, ThinkSystem SR670 V2 GPU Option Power Cable Feature: BFNL SBB: SBB7A40281 Base: SC17A10990 FRU: 02YE945 |
235mm 8pin (2x4) cable | Auxiliary power cable needed with the SR675 V3 Option: 4X97A84509, ThinkSystem SR675 V3 GPU Power Cable Kit Feature: BRGU SBB: SBB7A65297 Base: SC17B39302 FRU: 03LE555 |
200mm 8pin (2x4) cable | Auxiliary power cable needed with the SR850 V3 or SR860 V3 Option: 4X97A88017, ThinkSystem SR850 V3/SR860 V3 A100/A6000/MI210 GPU Power Cable Option Kit Feature: BTPB SBB: SBB7A72760 Base: SC17B40606 FRU: 03LF917 |
*The option part numbers are for thermal kits and include other components needed to install the GPU. See the server product guide for details.
Regulatory Approvals
The MI210 Accelerator has the following regulatory approvals:Electromagnetic Compliance
Product Safety Compliance
Operating Environment
The MI210 Accelerator has the following operating characteristics:
- Ambient temperature: Operational: 5°C to 45°C; Storage: -40°C to 70°C
- Relative humidity: Operational: 8-90%; Storage: 0-95%
Warranty
One year limited warranty. When installed in a Lenovo server, the MI210 Accelerator assumes the server's base warranty and any warranty upgrades.
Related Publications
For more information, refer to these documents:
- ThinkSystem and ThinkAgile GPU Summary: https://lenovopress.lenovo.com/lp0768-thinksystem-thinkagile-gpu-summary
- ServerProven compatibility: https://serverproven.lenovo.com/
- AMD MI210 product page: https://www.amd.com/en/products/server-accelerators/amd-instinct-mi210
Related Product Families
Product families related to this document are the following:
- GPU adapters
Notices
Lenovo may not offer the products, services, or features discussed in this document in all countries. Consult your local Lenovo representative for information on the products and services currently available in your area. Any reference to a Lenovo product, program, or service is not intended to state or imply that only that Lenovo product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any Lenovo intellectual property right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any other product, program, or service. Lenovo may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not give you any license to these patents. You can send license inquiries, in writing, to:
Lenovo (United States), Inc.
8001 Development Drive
Morrisville, NC 27560
U.S.A.
Attention: Lenovo Director of Licensing
LENOVO PROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some jurisdictions do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you.
This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. Lenovo may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice.
The products described in this document are not intended for use in implantation or other life support applications where malfunction may result in injury or death to persons. The information contained in this document does not affect or change Lenovo product specifications or warranties. Nothing in this document shall operate as an express or implied license or indemnity under the intellectual property rights of Lenovo or third parties. All information contained in this document was obtained in specific environments and is presented as an illustration. The result obtained in other operating environments may vary. Lenovo may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you.
Any references in this publication to non-Lenovo Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites. The materials at those Web sites are not part of the materials for this Lenovo product, and use of those Web sites is at your own risk. Any performance data contained herein was determined in a controlled environment. Therefore, the result obtained in other operating environments may vary significantly. Some measurements may have been made on development-level systems and there is no guarantee that these measurements will be the same on generally available systems. Furthermore, some measurements may have been estimated through extrapolation. Actual results may vary. Users of this document should verify the applicable data for their specific environment.
© Copyright Lenovo 2023. All rights reserved.
This document, LP1862, was created or updated on December 6, 2023.
Send us your comments in one of the following ways:
- Use the online Contact us review form found at: https://lenovopress.lenovo.com/LP1862
- Send your comments in an e-mail to: comments@lenovopress.com
This document is available online at https://lenovopress.lenovo.com/LP1862.
Trademarks
Lenovo and the Lenovo logo are trademarks or registered trademarks of Lenovo in the United States, other countries, or both. A current list of Lenovo trademarks is available on the Web at https://www.lenovo.com/us/en/legal/copytrade/.
The following terms are trademarks of Lenovo in the United States, other countries, or both: Lenovo®, ServerProven®, ThinkAgile®, ThinkSystem®
The following terms are trademarks of other companies:
Intel® is a trademark of Intel Corporation or its subsidiaries.
Linux® is the trademark of Linus Torvalds in the U.S. and other countries.
Other company, product, or service names may be trademarks or service marks of others.