GPU Performance Summary
Monitor and manage the status and performance metrics of GPUs connected to the system in real time. You can view both physical GPUs and MIG instances together, and efficiently sort or filter each item as needed.
Supported Agent Version
Only supported on Linux. Requires agent version 2.9.3 or higher.
Basic Screen Overview
Click Live to view or pause real-time data. You can search for GPU information using the search box.
Click on any column header in the data list to toggle between ascending and descending sort order.
- Total: Total number of GPU instances (including Physical + MIG)
- Physical: Number of actual physical GPU devices
- MIG: Number of MIG (Multi-Instance GPU) instances
GPU Information
| Column | Description |
|---|---|
| Status | Current status of the GPU instance - N/A: GPU status is displayed only for Physical GPU targets. If the GPU Type is MIG, it is shown as N/A - Allocated: Same as the previous Active status - Unallocated: Same as the previous Inactive status - Active: Allocated and the 5-minute average GPU Utilization is 1% or higher - Idle: Allocated and the 5-minute average GPU Utilization is less than 1% - Effective: Allocated and the 5-minute average GPU Utilization exceeds 50% |
| HostName | Hostname of the server to which the GPU is connected |
| GPU Index | Unique index of the physical GPU or MIG instance (MIG is shown in a format like 0/6/0) |
| Model Name | GPU model name (e.g., NVIDIA A100-SXM4) |
| GPU Type | Type of the instance: either Physical or MIG |
GPU Performance Metrics
For detailed descriptions of each metric, see GPU Metrics.
Download CSV
You can download the data as a CSV file.
Column Settings
Click the Column Settings button at the top right of the screen to open the Column Settings window.
In the Column Settings window, you can select which columns to display in the table.
-
Select All: Select all columns
-
Reset to Default Order: Reset the column order to default
-
Reset to Default Selection: Restore to the default column selection
The selected columns are saved in your browser cookies, so the selection persists even after refreshing the page.
If cookies are deleted or an error occurs, the default columns will be restored.
-
In the Column Settings window, select the columns to display under GPU Information and GPU Performance Metrics.
- You can select columns by group or adjust their order.
CautionThe Status and HostName fields under GPU Information cannot be removed.
-
Click the Apply button to save your settings.
Add Filter
You can add filter conditions to quickly find the GPUs you need.
-
Click the
Filter search bar to open the Add Filter window.
-
In the Add Filter window, select the desired GPU condition (filter key and condition), then click the Apply button.
Compare GPUs
When you select multiple GPUs to compare, the Compare panel appears below the GPU list, allowing you to visually compare metrics using charts.
You can track trends for the last 10 minutes and identify performance anomalies or bottlenecks.
- You can compare up to 20 items at a time.