You can view the usage metrics of your Hyperdisk Storage Pool on the Storage pools page of the Google Cloud console, or in Cloud Monitoring, Google Cloud's monitoring solution.
You can programmatically retrieve and calculate storage pool metrics using:
This document discusses the metrics Compute Engine automatically collects for each storage pool and how to view them in Cloud Monitoring.
Before you begin
-
If you haven't already, then set up authentication.
Authentication is
the process by which your identity is verified for access to Google Cloud services and APIs.
To run code or samples from a local development environment, you can authenticate to
Compute Engine by selecting one of the following options:
Select the tab for how you plan to use the samples on this page:
Console
When you use the Google Cloud console to access Google Cloud services and APIs, you don't need to set up authentication.
gcloud
-
Install the Google Cloud CLI, then initialize it by running the following command:
gcloud init
- Set a default region and zone.
REST
To use the REST API samples on this page in a local development environment, you use the credentials you provide to the gcloud CLI.
Install the Google Cloud CLI, then initialize it by running the following command:
gcloud init
For more information, see Authenticate for using REST in the Google Cloud authentication documentation.
-
Required roles and permissions
To get the permissions that you need to view metrics for a storage pool, ask your administrator to grant you the following IAM roles on the project:
-
Monitoring Viewer (
roles/monitoring.viewer
) -
To modify a metric's scope, you need the following role for the scoping project and each resource container that you want to add:
Monitoring Admin (
roles/monitoring.admin
)
For more information about granting roles, see Manage access to projects, folders, and organizations.
You might also be able to get the required permissions through custom roles or other predefined roles.
Overview of Hyperdisk Storage Pool metrics
The Hyperdisk Storage Pool performance metrics can help you answer questions about your storage pool usage, such as the following:
Area | Query or goal | Available metrics |
---|---|---|
Storage pool characteristics |
|
|
Storage pool usage |
|
|
Storage pool aggregate disk characteristics |
|
|
Storage pool utilization |
|
|
Storage pool advanced provisioning |
|
|
Available storage pool metrics
The following table lists the metrics available for Hyperdisk Storage Pools. For a full list of storage pool metrics, see Compute Engine metrics.
Each metric type in this table must be prefixed with compute.googleapis.com/
,
which has been omitted from the table for readability.
Display name(Metric type) |
Description |
---|---|
Disks
(storage_pool/disks)
|
Count of disks that are in the storage pool. |
Provisioned Capacity
(storage_pool/provisioned_capacity)
|
The size, in TiB, of the storage pool. |
Provisioned IOPS
(storage_pool/provisioned_iops)
|
Provisioned IOPS of the storage pool. This metric is only valid for Hyperdisk Balanced Storage Pools. |
Provisioned Throughput
(storage_pool/provisioned_throughput)
|
Provisioned throughput of the storage pool. |
Total Disk Provisioned Capacity
(storage_pool/total_disk_provisioned_capacity)
|
The sum of the capacity that is provisioned across all disks in the storage pool. A disk's provisioned capacity is the same as its total capacity. For example, a storage pool with 10 disks, each 5 TiB in size, would return 50 TiB for Total Disk Provisioned Capacity. |
Used Capacity
(storage_pool/used_capacity)
|
|
Used IOPS
(storage_pool/used_iops)
|
The sum of IOPS provisioned for all disks in the storage pool. For Hyperdisk Balanced Storage Pools, the first 3,000 provisioned IOPS per disk are not counted towards this value. |
Used Throughput
(storage_pool/used_throughput)
|
The sum of throughput provisioned for all disks in the storage pool, in MBps. For Hyperdisk Balanced Storage Pools, the first 140 MBps of provisioned throughput per disk are not counted towards this value. |
Total Disk Provisioned IOPS
(storage_pool/total_disk_provisioned_iops)
|
Sum of the provisioned IOPS for all disks in the storage pool. |
Total Disk Provisioned Throughput
(storage_pool/total_disk_provisioned_throughput)
|
Sum of the provisioned throughput for all disks in the storage pool, in MiBps. |
Capacity Utilization (%)
(storage_pool/capacity_utilization)
|
The used capacity of the storage pool, represented as a percentage of the overall pool capacity. This value is calculated using the following formula: Utilization = |
IOPS Utilization (%)
(storage_pool/iops_utilization)
|
The used IOPS of the storage pool, represented as a percentage of the overall pool IOPS. This value is calculated using the following formula: Utilization = |
Throughput Utilization (%)
(storage_pool/throughput_utilization)
|
The used throughput of the storage pool, represented as a percentage of the overall pool throughput. This value is calculated using the following formula: Utilization = |
Capacity Overprovisioning (%)
(storage_pool/capacity_overprovisioning)
|
Ratio of the total provisioned capacity of disks in the storage pool to the storage pool provisioned capacity, as a percentage. |
IOPS Overprovisioning (%)
(storage_pool/iops_overprovisioning)
|
Ratio of the total provisioned IOPS of disks in the storage pool to the storage pool provisioned IOPS, as a percentage. |
Throughput Overprovisioning (%)
(storage_pool/throughput_overprovisioning)
|
Ratio of the total provisioned throughput of disks in the storage pool to the storage pool provisioned throughput, as a percentage. |
Review storage pool metrics
You can view the metrics for a storage pool on the Storage pools page in the console, and on the Monitoring tab of the Manage storage pool page for a specific storage pool.
On the Storage pools page, you can view the following for each storage pool:
- Provisioned capacity and the remaining capacity
- Provisioned IOPS and the remaining IOPS
- The number of disks in the storage pool
If you click the name of a storage pool, the Manage storage pool page opens. There are two tabs on this page. On the Details tab you can view the following information:
- At the top of the page are tiles that show the provisioned and used capacity, throughput, and IOPS.
- In the Storage pool settings section, there is a table that shows the utilization percentages for capacity, IOPS, and throughput.
Visualize storage pool metrics on a chart
You can visualize the storage pool metrics by plotting any of the metrics listed previously with Metrics Explorer. Metrics Explorer is part of Cloud Monitoring.
Example: Visualize storage pool capacity utilization
To visualize the storage pool used capacity on a chart, follow these instructions. You can follow the same procedure for the other storage pool metrics.
-
In the Google Cloud console, go to the leaderboard Metrics explorer page:
If you use the search bar to find this page, then select the result whose subheading is Monitoring.
- In the Metric element, expand the Select a metric menu,
enter
Storage Pool
in the filter bar, and then use the submenus to select a specific resource type and metric:- In the Active resources menu, select Storage Pool.
- In the Active metric categories menu, select Storage_pool.
- In the Active metrics menu, select Used Capacity.
- Click Apply.
compute.googleapis.com/storage_pool/used_capacity
. - Configure how the data is viewed. To display only the metrics for a specific storage
pool, follow these steps:
- In the Filter element, click Add filter, and then select storage_pool_id. For the value, enter a specific storage pool ID.
- In the Aggregation entry, set the first menu to Unaggregated and the second menu to storage_pool_id.
For more information about configuring a chart, see Select metrics when using Metrics Explorer.
Configure alerts based on storage pool metrics
You can optionally set alerts to trigger when the storage pool hits certain thresholds, when auto-grow activates, or when other events occur. For an example of how to configure an alerts based on metrics, see Configure alerts for snapshot schedules.
What's next
- Monitor your disk's performance by reviewing disk performance metrics and monitoring disk health.
- Enable the Monitoring API.
- View all the available metrics for Compute Engine.
- Learn more about creating charts with Metric Explorer.
- Learn more about Cloud Monitoring.
- Learn more about storage pools.