Type: gpu¶
GPU devices make the specified GPU device or devices appear in the instance.
Note
For containers, a gpu device may match multiple GPUs at once.
For VMs, each device can match only a single GPU.
The following types of GPUs can be added using the gputype device option:
physical(container and VM): Passes an entire GPU through into the instance. This value is the default ifgputypeis unspecified.mdev(VM only): Creates and passes a virtual GPU through into the instance.mig(container only): Creates and passes a MIG (Multi-Instance GPU) through into the instance.sriov(VM only): Passes a virtual function of an SR-IOV-enabled GPU into the instance.
The available device options depend on the GPU type and are listed in the tables in the following sections.
gputype: physical¶
Note
The physical GPU type is supported for both containers and VMs.
It supports hotplugging only for containers, not for VMs.
A physical GPU device passes an entire GPU through into the instance.
Device options¶
GPU devices of type physical have the following device options:
Key |
Type |
Default |
Description |
|---|---|---|---|
|
int |
|
GID of the device owner in the instance (container only) |
|
string |
- |
The DRM card ID of the GPU device |
|
int |
|
Mode of the device in the instance (container only) |
|
string |
- |
The PCI address of the GPU device |
|
string |
- |
The product ID of the GPU device |
|
int |
|
UID of the device owner in the instance (container only) |
|
string |
- |
The vendor ID of the GPU device |
gputype: mdev¶
Note
The mdev GPU type is supported only for VMs.
It does not support hotplugging.
An mdev GPU device creates and passes a virtual GPU through into the instance.
You can check the list of available mdev profiles by running incus info --resources.
Device options¶
GPU devices of type mdev have the following device options:
Key |
Type |
Default |
Description |
|---|---|---|---|
|
string |
- |
The DRM card ID of the GPU device |
|
string |
- |
The |
|
string |
- |
The PCI address of the GPU device |
|
string |
- |
The product ID of the GPU device |
|
string |
- |
The vendor ID of the GPU device |
gputype: mig¶
Note
The mig GPU type is supported only for containers.
It does not support hotplugging.
A mig GPU device creates and passes a MIG compute instance through into the instance.
Currently, this requires NVIDIA MIG instances to be pre-created.
Device options¶
GPU devices of type mig have the following device options:
Key |
Type |
Default |
Description |
|---|---|---|---|
|
string |
- |
The DRM card ID of the GPU device |
|
int |
- |
Existing MIG compute instance ID |
|
int |
- |
Existing MIG GPU instance ID |
|
string |
- |
Existing MIG device UUID ( |
|
string |
- |
The PCI address of the GPU device |
|
string |
- |
The product ID of the GPU device |
|
string |
- |
The vendor ID of the GPU device |
You must set either mig.uuid (NVIDIA drivers 470+) or both mig.ci and mig.gi (old NVIDIA drivers).
gputype: sriov¶
Note
The sriov GPU type is supported only for VMs.
It does not support hotplugging.
An sriov GPU device passes a virtual function of an SR-IOV-enabled GPU into the instance.
Device options¶
GPU devices of type sriov have the following device options:
Key |
Type |
Default |
Description |
|---|---|---|---|
|
string |
- |
The DRM card ID of the parent GPU device |
|
string |
- |
The PCI address of the parent GPU device |
|
string |
- |
The product ID of the parent GPU device |
|
string |
- |
The vendor ID of the parent GPU device |