Lyria | AI Music Generator

Stay organized with collections Save and categorize content based on your preferences.

You can use Lyria to generate new instrumental music tracks from a text prompt that you provide in the Google Cloud console or send in a request to the Vertex AI Gemini API API.

Try Lyria on Vertex AI (Vertex AI Studio)

Lyria features and launch stage

Lyria offers generative AI features for music creation.

The following table describes features that are Generally Available (GA) to all users:

Locations

A location is a region you can specify in a request to control where data is stored at rest. Lyria 2 is offered globally. For the list of available regions for Vertex AI services, see Generative AI on Vertex AI locations.

Performance and limitations

Responsible AI

Lyria generates instrumental music from text prompts. Lyria applies safety measures including content safety filters, recitation checking, and artist intent checks to prevent the input and generation of harmful or inappropriate content. SynthID watermarking is used on generated audio. Prompts that violate responsible AI guidelines may be blocked.

Lyria Vertex AI model versions and lifecycle

The Lyria model and version are the following:

Generate music from text

You can generate novel instrumental music tracks using descriptive text as input.

Before you begin

1. Sign in to your Google Cloud account. If you're new to Google Cloud, create an account to evaluate how our products perform in real-world scenarios. New customers also get $300 in free credits to run, test, and deploy workloads.

2. In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

   Go to project selector

3. Enable the Vertex AI API.

   Enable the API

4. In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

   Go to project selector

5. Enable the Vertex AI API.

   Enable the API

6. Set up authentication for your environment.

   Select the tab for how you plan to use the samples on this page:

   Console

   When you use the Google Cloud console to access Google Cloud services and APIs, you don't need to set up authentication.

   REST

   To use the REST API samples on this page in a local development environment, you use the credentials you provide to the gcloud CLI.

   After installing the Google Cloud CLI, initialize it by running the following command:

   gcloud init

   If you're using an external identity provider (IdP), you must first sign in to the gcloud CLI with your federated identity.

   For more information, see Authenticate for using REST in the Google Cloud authentication documentation.

curl -X POST \
  -H "Authorization: Bearer $(gcloud auth print-access-token)" \
  -H "Content-Type: application/json" \
  https://LOCATION-aiplatform.googleapis.com/v1/projects/PROJECT_ID/locations/LOCATION/publishers/google/models/lyria-002:predict \
  -d '{
    "instances": [
      {
        "prompt": "An uplifting and hopeful orchestral piece with a soaring string melody and triumphant brass.",
        "negative_prompt": " dissonant, minor key",
        "seed": 12345
      }
    ],
    "parameters": {
      // "sample_count": 1 // Use either seed or sample_count
    }
  }'

{
  "predictions": [
    {
      "audioContent": "BASE64_ENCODED_WAV_STRING_SAMPLE_1",
      "mimeType": "audio/wav"
    },
    {
      "audioContent": "BASE64_ENCODED_WAV_STRING_SAMPLE_2",
      "mimeType": "audio/wav"
    }
  ],
  "deployedModelId": "xxxxxxxxxxxxxxx",
  "model": "projects/PROJECT_ID/locations/LOCATION/publishers/google/models/lyria-002",
  "modelDisplayName": "Lyria 2"
}

What's next

• Learn how to write effective prompts in the Lyria music generation prompt guide
• Explore the Lyria API reference
• Discover other Generative AI models on Vertex AI