What is InfiniBand and Why is it used in HPC?

According to the top 500 list, more 50% of supercomputer interconnect devices are InfiniBand based and the percentage is growing YOY. Why are most HPC data centers deploying InfiniBand instead of Ethernet or OPA in their network?

Learn more: What Is InfiniBand and Why Is It Used in HPC?

InfiniBand Is Widely Used in Supercomputers and HPC Data Centers

Early in June 2015, InfiniBand consisted of 51.8% in the Top500 list of the world’s most powerful supercomputers, with a 15.8% year-on-year growth.

TOP500 Interconnect Trends, June 2015. Image source: IBTA Home

In the Top500 list in June 2022, InfiniBand networks once again topped the list of supercomputer interconnect devices with absolute numbers and performance advantages, a significant increase from the previous list. Throughout this list, the following three trends can be summarized.

  • Supercomputers based on InfiniBand networks are significantly ahead of other network technologies with 189 systems. InfiniBand-based supercomputers lead the Top 100 systems in particular, with 59 units in the Top 100, and InfiniBand networks have become the standard for performance-conscious supercomputers.
  • NVIDIA GPU and networking products, such as NVIDIA Volta GV100, A100, Mellanox HDR Quantum QM87xx switches and BlueField DPU, are the dominant interconnect in the Top500 systems, with more than two-thirds of the supercomputers using NVIDIA Mellanox networking, and the performance and technology leadership of NVIDIA Mellanox networking has been widely recognized.
  • It is also worth noting that InfiniBand networks are widely used not only in the traditional HPC business, but also in enterprise-class data centers and public clouds. NVIDIA Selene, the number one performance enterprise supercomputer, and Microsoft’s Azure public cloud are both leveraging InfiniBand networks to deliver superb business performance.

Whether it is the evolution of data communication technology, the innovation of Internet technology, or the upgrade of visual presentation, all are thanks to more powerful computing, larger capacity and more secure storage, and more efficient network; InfiniBand network-based cluster architecture solution not only provides higher bandwidth network services, but also reduces the consumption of computing resources by network transmission load and reduces latency and perfectly integrates HPC with data centers.

In the latest Top500 list in Nov. 2022, InfiniBand continued leadership in the Top 500 high-performance computing systems and kept growing. Why are InfiniBand networks so highly valued in the Top500? Its performance benefits play a decisive role.

#hpc #infinband #opa #ethernet #datacenter #highperformancecomputing

评论

发表评论

此博客中的热门博文

What Is VLAN Switch and Why Do We Need It?

图片
VLAN or virtual LAN is a type of LAN that is defined to map workstations based on everything except for geographic location. It develops when the network has increased in size and complexity, and many companies require more access ports or a network design. Basically, it’s a networking technology which allows the network to be segmented logically without geographic restrictions. But how much do you know about VLAN switch? What Is  VLAN Switch? VLAN switch is built on the fiber optic switch  of LAN, which realizes the division and management of logical working group as a software. As defined in IEEE standard 802.1Q, VLAN switch can provide a way to transform one network into multiple broadcast domains. And each broadcast domain is usually matched with IP subnet boundaries, so that each subnet has its own VLAN. Therefore, users can obtain various wired LANs for different purposes that are co-existed physically, which means you don’t need to buy additional hardware or cabling at a la
阅读全文

Differentiate the 3 Technologies: Switch Stacking vs Cascading vs Clustering

图片
When we have more than one switches on hand we often seek to a better way in making use of them and managing them. There are mainly three technologies that we might use when we interconnect or combine several switches together, which are switch stacking, cascading and clustering. For many people that firstly get in touch with these terms, they can’t figure out the differences between them. Some discussions of the switch stacking versus switch clustering and switch stacking versus switch cascading have been put forward, but a comprehensive comparison between them has not been made. So this post is a discussion of switch stacking vs cascading vs clustering. Switch Stacking vs Cascading vs Clustering The comparison of switch stacking, cascading and clustering should be based on knowing the meaning of these technologies. So firstly we will see what switch stacking, cascading and cluster are. What Are Switch Stacking, Cascading and Clustering? Switch stack
阅读全文

Introduction of Patch Panel Types

图片
Patch panel, an unsung hero, is the most important cable management tool of the data center. When you want to connect a vast number of devices to a central server or other network hardware, there must be plenty of various cables, and you have to plan each thing out properly. It’s always smart to use a patch panel to help you manage the cables and keep your server room organized. However, patch panels are available in different ports and applied in various cables, like 24 port or 48 port patch panel, Cat5e or Cat6 patch panel. There are so many patch panel types on the market that make you confused. Usually, patch panels can be used in two systems, fiber  and  copper cabling systems. Therefore, patch panel types will fall into two main categories, fiber optic patch panel  and   Ethernet patch panel . Fiber  O ptic  P atch  P an el Fiber optic patch panel  is applied in distributing the single mode and multimode fibers to realize the connection, allocation  and  scheduling between t
阅读全文