Sage-Code Laboratory
index<--

GPU Extension

A graphic processing unit (GPU) is a specialized processor that is used to accelerate the rendering of graphics. GPUs are typically found in computers that are used for gaming, video editing, and other graphics-intensive tasks.

What is GPU ?

Graphic Processor Unit = GPU. This is an acceleration card for gaming PCs. But you can also do cool applications for GPU using special libraries. This enable DML (Deep Machine Learning) algorithms to run especially for Nvidia GPUs. AMD and Nvidia this time are competing against each other in this market. Intel does not make video cards for HPC.

Picture

Titan RDX - GPU Video Card

Picture

Titan RDX - Display Ports

A graphic GPU extension card is a separate circuit board that can be installed in a computer to provide additional graphics processing power. Extension cards are typically used in computers that do not have a powerful enough integrated GPU or in computers that need to be upgraded to support more demanding graphics applications.

Extension cards can offer a significant performance boost over integrated GPUs. They can also provide additional features, such as support for multiple monitors or higher resolutions.

GPU selection

When choosing a graphic GPU extension card, it is important to make sure that it is compatible with your computer's motherboard and power supply. You should also consider the type of graphics applications that you will be using. If you plan on doing gaming or video editing, you will need a more powerful card.

Picture

Old: VGA, DVI, HDMI ports.

Selection Criterias

Here are some of the factors to consider when choosing a graphic GPU extension card:

Picture

Multiple monitors for one computer.

Multiple GPUs

Multiple GPUs, also known as multi-GPU or GPU arrays, can be used in modern computers to improve performance in a variety of tasks. Here are some of the use-cases for multiple GPUs:

Picture

Computer with 4GPU on Motherboard

In order to use multiple GPUs, your computer's motherboard must support it. You will also need to install the appropriate drivers for your GPUs. Once you have installed the drivers, you can configure your computer to use multiple GPUs for the tasks that you want to improve performance.

Here are some of the factors to consider when using multiple GPUs:

Warning: Selecting different kind of GPUs for a single rig is usually a bad idea. All GPUs should be the same brand but you can have one video-card with ports and secondary GPU cards that have no ports. The position of cards is important. One GPU card is primary and the other ones are secondary.

GPU Rigs

A GPU Rig is a computer system that is specifically designed to use multiple GPUs. These rigs are typically used for high-performance computing tasks, such as scientific computing, machine learning, and cryptocurrency mining.

There are a few different ways to configure a GPU Rig. One common configuration is to use two or more identical GPUs in a SLI or CrossFire configuration. SLI and Crossfire are technologies that allow multiple GPUs to work together to render graphics. This can provide a significant performance boost in games and other graphics-intensive applications.

Picture

6GPU Mining Rig

Another way to configure a GPU Rig is to use a multi-node configuration. In a multi-node configuration, each GPU is connected to its own motherboard and CPU. This allows each GPU to work independently, which can be useful for certain tasks, such as machine learning.

There are a few issues to consider when using a GPU Rig. One issue is that it can be more expensive than a traditional computer system. Another issue is that it can require more power and cooling. Additionally, some games and applications may not support multiple GPUs.

However, there are also a number of advantages to using a GPU Rig. One advantage is that it can provide a significant performance boost in graphics-intensive applications. Another advantage is that it can be used for a variety of tasks, such as gaming, video editing, machine learning, and cryptocurrency mining.

The type of motherboard that you need for a GPU Rig will depend on the number of GPUs that you want to use. If you are only using two GPUs, you can use a standard motherboard. However, if you want to use more than two GPUs, you will need to use a motherboard that supports SLI or Crossfire.

When choosing a motherboard for a GPU Rigs, you should also consider the computer case. Modern GPUs take a lot of power and are heavy. Best position of GPU is vertical (parallel to each other). For open chose you need extension cards for each GPU. A closed case is better but it can support only 4GPUs.

Note: Chosing a computer case for your rig is a smart idea. To protect the components. But usually a computer case is limiting the number of GPU to maximum 4, so you need many rigs connected to train an AI. This may be a good solution that is tranding.

Top AI cards

Modern RIGS that can process AI deep learning are insane expensive. If you multiply the price with 6 (average number of video cards in a rig) you can see the price is rising fast to unafordable levels. Adding to this the price of power, you can realize this is not a fesable solution for a home setup, but is usable only in a data center.

Rank Card Price VRAM Tensor Cores Compute Units
1 NVIDIA RTX 4090 $1499 24GB 16,384 126
2 NVIDIA RTX 4080 $1199 16GB 12,288 102
3 NVIDIA RTX 4070 $599 12GB 6144 60
4 AMD Radeon RX 7900 XT $999 16GB 12,000 96
5 AMD Radeon RX 7800 XT $799 12GB >8192 80

Large GPUs

Large GPUs are problematic. You need the consider these cards can take 4 slots. And of course they are very heavy. So a good idea is to have only two very powerful video cards in a horizontal computer case. Make sure the extension slots can support x16 EVGA standard and are far apart for this kind of setup.

Picture

Gaming Rig 2xGPUs

Info: This is a double deck computer case very easy to work with. It has power supply and HDD on lower deck and motherboard in the upper deck. I has 2x5" bay extensions and 2HDD drowers. I have used this computer case for one of my rigs. Notice it's using just air cooling.

Read next: Power Supply