Capacity Forecast
The Capacity Forecast analytic determines the “time‐to‐zero” period for an entity’s key metrics to reach capacity using trend estimates based on long‐term historical usage data. It flags each key metric whose time‐to‐zero period is less than specified thresholds.
Before you can begin analyzing for capacity forecasting, you must collect at least three days’ worth of data. The Integration cannot access capacity information from before the integration was installed.
Capacity Forecast analyses the following metrics to provide capacity reporting and planning information for the Integration.
AI Model | ||
Name | Description | |
Total # Tokens In Prompts | The total number of tokens sent in all requests across all instances and time. | |
Total # Response Tokens | The total number of tokens returned in all responses across all instances and time. | |
NVIDIA Program | ||
Name | Description | |
Process GPU Energy Consumption (kWh) | The amount of GPU energy consumed by a process, in kilowatt-hours. | |
Process GPU Energy Consumption (Wh) | The amount of GPU energy consumed by a process, in watt-hours. | |
# of other applications running | Number of other applications running along with this process during the last poll interval. | |
# of currently running processes | Number of process instances currently running | |
NVIDIA GPU Host Cluster | ||
Name | Description | |
Total # Tokens In Prompts | The total number of tokens sent in all requests across all instances and time. | |
Total # Response Tokens | The total number of tokens returned in all responses across all instances and time. | |
System Power Consumed (BTU/hr) | Current system power consumption converted to BTU per hour. | |
Energy Consumption (kWh) | The amount of energy consumed, in kilowatt-hours. | |
Energy Consumption (Wh) | The amount of energy consumed, in watt-hours. | |
Process GPU Energy Consumption (kWh) | The amount of GPU energy consumed by a process, in kilowatt-hours. | |
Process GPU Energy Consumption (Wh) | The amount of GPU energy consumed by a process, in watt-hours. | |
# of other applications running | Number of other applications running along with this process during the last poll interval. | |
# of currently running processes | Number of process instances currently running | |
NVIDIA Job | ||
Name | Description | |
Process GPU Energy Consumption (kWh) | The amount of GPU energy consumed by a process, in kilowatt-hours. | |
Process GPU Energy Consumption (Wh) | The amount of GPU energy consumed by a process, in watt-hours. | |
# of other applications running | Number of other applications running along with this process during the last poll interval. | |
# of currently running processes | Number of process instances currently running | |
NVIDIA Host | ||
Name | Description | |
Total # Tokens In Prompts | The total number of tokens sent in all requests across all instances and time. | |
Total # Response Tokens | The total number of tokens returned in all responses across all instances and time. | |
System Power Consumed (BTU/hr) | Current system power consumption converted to BTU per hour. | |
Energy Consumption (kWh) | The amount of energy consumed, in kilowatt-hours. | |
Energy Consumption (Wh) | The amount of energy consumed, in watt-hours. | |
Application | ||
Name | Description | |
Total # Tokens In Prompts | The total number of tokens sent in all requests across all instances and time. | |
Total # Response Tokens | The total number of tokens returned in all responses across all instances and time. | |
System Power Consumed (BTU/hr) | Current system power consumption converted to BTU per hour. | |
Energy Consumption (kWh) | The amount of energy consumed, in kilowatt-hours. | |
Energy Consumption (Wh) | The amount of energy consumed, in watt-hours. | |
Process GPU Energy Consumption (kWh) | The amount of GPU energy consumed by a process, in kilowatt-hours. | |
Process GPU Energy Consumption (Wh) | The amount of GPU energy consumed by a process, in watt-hours. | |
# of other applications running | Number of other applications running along with this process during the last poll interval. | |
# of currently running processes | Number of process instances currently running | |
NVIDIA GPU | ||
Name | Description | |
System Power Consumed (BTU/hr) | Current system power consumption converted to BTU per hour. | |
Energy Consumption (kWh) | The amount of energy consumed, in kilowatt-hours. | |
Energy Consumption (Wh) | The amount of energy consumed, in watt-hours. | |
Process GPU Energy Consumption (kWh) | The amount of GPU energy consumed by a process, in kilowatt-hours. | |
Process GPU Energy Consumption (Wh) | The amount of GPU energy consumed by a process, in watt-hours. | |
# of other applications running | Number of other applications running along with this process during the last poll interval. | |
# of currently running processes | Number of process instances currently running | |