Capacity overview

AI Hypercomputer supports several consumption options to help you get and use compute resources. This document provides an overview of how you can obtain capacity for each consumption option.

How to obtain capacity

The following table describes the requirements for obtaining capacity for each consumption option.

Consumption option Process for obtaining capacity Pricing implications
Future reservations

To get future reservation resources, the process is as follows:

  1. Contact your account team and ask them to reserve capacity on your behalf.
  2. Quota is automatically increased before capacity is delivered, no action is required from you.
  3. When you create a VM or cluster, specify the reservation-bound provisioning model. VMs and clusters are provisioned from your reserved capacity.
 You're charged for the entire reservation period, whether or not you use the resources for the entire period. For more information, see the Reservation billing section of the Compute Engine reservations documentation.
Flex-start (Preview)

For this consumption option, no reservation is required. To get Flex-start resources, use one of the following options:

When your requested capacity becomes available, Compute Engine provisions it. You obtain resources for up to seven days.

 You're charged when the resources are in use. Resources provisioned using Flex-start automatically get discounts through Dynamic Workload Scheduler pricing.
Spot

For this consumption option, no reservation is required. To get Spot resources, the process is as follows:

  1. You must request preemptible quota for the GPU machine type that you want to use.
  2. When you create a VM or cluster, specify the spot provisioning model. Resources are provisioned for you as capacity becomes available, but can be preempted at any time.
 You're charged when the resources are in use. Spot VMs automatically get discounts through Spot VMs pricing.