Quotas and limits

This document lists the quotas and system limits that apply to Google Cloud Managed Lustre.

  • Quotas specify the amount of a countable, shared resource that you can use. Quotas are defined by Google Cloud services such as Google Cloud Managed Lustre.
  • System limits are fixed values that cannot be changed.

Google Cloud uses quotas to help ensure fairness and reduce spikes in resource use and availability. A quota restricts how much of a Google Cloud resource your Google Cloud project can use. Quotas apply to a range of resource types, including hardware, software, and network components. For example, quotas can restrict the number of API calls to a service, the number of load balancers used concurrently by your project, or the number of projects that you can create. Quotas protect the community of Google Cloud users by preventing the overloading of services. Quotas also help you to manage your own Google Cloud resources.

The Cloud Quotas system does the following:

In most cases, when you attempt to consume more of a resource than its quota allows, the system blocks access to the resource, and the task that you're trying to perform fails.

Quotas generally apply at the Google Cloud project level. Your use of a resource in one project doesn't affect your available quota in another project. Within a Google Cloud project, quotas are shared across all applications and IP addresses.

There are also system limits on Managed Lustre resources. System limits can't be changed.

System limits

Managed Lustre enforces the following system limits:

System limit Value
Minimum storage capacity per Managed Lustre instance

Defined by performance tier:

  • 125 MBps per TiB: 144,000 GiB
  • 250 MBps per TiB: 72,000 GiB
  • 500 MBps per TiB: 36,000 GiB
  • 1000 MBps per TiB: 18,000 GiB
Maximum storage capacity per Managed Lustre instance

Defined by performance tier:

  • 125 MBps per TiB: 7,632,000 GiB (~8 PiB)
  • 250 MBps per TiB: 3,816,000 GiB (~4 PiB)
  • 500 MBps per TiB: 1,908,000 GiB (~2 PiB)
  • 1000 MBps per TiB: 954,000 GiB (~1 PiB)
Maximum file size 0.5 PiB
Maximum number of instances per project 20

Quotas

Available storage capacity quota depends on many factors, including the location of your instance and the performance tier requested. If your project and location have available quota, it is by default applied to the 500 MBps per TiB performance tier.

The quota for Managed Lustre capacity is per Virtual Private Cloud (VPC) network per zone. Any quota increase that has been requested and granted for a specific VPC cannot be used to create a Managed Lustre instance in another VPC.

Quota details

Managed Lustre supports the following quotas:

Item Description
Read limit per minute The maximum number of API requests that an IAM user can make to the Google Cloud Managed Lustre API within a one-minute time period. This quota is only for API calls.
Storage capacity (GiB) for a throughput of 1000 MBps per TiB per zone per VPC Storage capacity in GiB for a throughput of 1000 MBps per TiB.
Storage capacity (GiB) for a throughput of 500 MBps per TiB per zone per VPC Storage capacity in GiB for a throughput of 500 MBps per TiB.
Storage capacity (GiB) for a throughput of 250 MBps per TiB per zone per VPC Storage capacity in GiB for a throughput of 250 MBps per TiB.
Storage capacity (GiB) for a throughput of 125 MBps per TiB per zone per VPC Storage capacity in GiB for a throughput of 125 MBps per TiB.

Request additional quota

Managed Lustre does not support requesting changes to the quota values through the Google Cloud console. Instead, you need to create a Cloud Quotas adjustment requests. This can be done using Google Cloud CLI to call the Cloud Quotas API to create and update quota preferences.

The Cloud Quotas API requires a quota-id. The following are the quota IDs for each performance tier:

Performance Tier Quota ID
1000 MBps per TiB StorageFor1000MBpThroughputPerTiB
500 MBps per TiB StorageFor500MBpThroughputPerTiB
250 MBps per TiB StorageFor250MBpThroughputPerTiB
125 MBps per TiB StorageFor125MBpThroughputPerTiB

Create Preference

To create a new quota preference use the gcloud alpha quotas preferences create command:

gcloud alpha quotas preferences create \
  --preferred-value=PREFERRED_VALUE_GiB \
  --quota-id=QUOTA_ID \
  --service=lustre.googleapis.com \
  --project=PROJECT_ID \
  --dimensions=zone=ZONE,network_name=NETWORK_NAME \
  --email=EMAIL \
  --justification=JUSTIFICATION \
  --preference-id=PREFERENCE_ID

Update Preference

To update existing quota preference use the gcloud alpha quotas preferences update command:

gcloud alpha quotas preferences update PREFERENCE_ID \
  --preferred-value=PREFERRED_VALUE_GiB \
  --quota-id=QUOTA_ID \
  --service=lustre.googleapis.com  \
  --project=PROJECT_ID \
  --dimensions=zone=ZONE,network_name=NETWORK_NAME \
  --email=EMAIL \
  --justification=JUSTIFICATION

The Cloud Quotas adjustment requests are subject to review. You will receive an email acknowledging receipt of your request. If you need further assistance, respond to the email. After reviewing your request, you receive an email notification indicating whether your request was approved.