Managed Lustre overview

Google Cloud Managed Lustre delivers a high-performance, fully managed parallel file system optimized for AI and HPC applications. With multi-petabyte-scale capacity and up to 1 TBps throughput, Managed Lustre facilitates the migration of demanding workloads to the cloud.

Highlights

  • Developed in collaboration with DDN, the leading provider and primary maintainer of the Lustre file system.
  • Supports extreme IOPs and low latency.
  • POSIX compliance ensures compatibility with existing applications, tools, and workflows.
  • Integrated with Compute Engine and Google Kubernetes Engine, allowing you to mount high-performance storage to your virtual machines and containerized applications.
  • Provides high-speed and fully managed transfers into and out of Cloud Storage.

Specifications

Metric Result
Storage capacity From 18,000 GiB up to ~8 PiB (7,632,000 GiB)
Throughput Up to 1 TBps
IOPS Thousands of IOPS per TiB
Maximum file size 0.5 PiB

Use Cases

  • High-performance computing: Managed Lustre excels in HPC environments where multiple compute nodes need fast and consistent access to shared data for simulations, modeling, and analysis.

  • Machine learning: Managed Lustre can handle the large datasets and high throughput requirements of machine learning workloads, enabling efficient training and inference.

Pricing

See the Pricing page for details.