Create custom organization policy constraints

This page shows you how to use Organization Policy Service custom constraints to restrict specific operations on the following Google Cloud resources:

• datastream.googleapis.com/ConnectionProfile
• datastream.googleapis.com/Stream
• datastream.googleapis.com/PrivateConnection

To learn more about Organization Policy, see Custom organization policies.

About organization policies and constraints

The Google Cloud Organization Policy Service gives you centralized, programmatic control over your organization's resources. As the organization policy administrator, you can define an organization policy, which is a set of restrictions called constraints that apply to Google Cloud resources and descendants of those resources in the Google Cloud resource hierarchy. You can enforce organization policies at the organization, folder, or project level.

Organization Policy provides built-in managed constraints for various Google Cloud services. However, if you want more granular, customizable control over the specific fields that are restricted in your organization policies, you can also create custom constraints and use those custom constraints in an organization policy.

Policy inheritance

By default, organization policies are inherited by the descendants of the resources on which you enforce the policy. For example, if you enforce a policy on a folder, Google Cloud enforces the policy on all projects in the folder. To learn more about this behavior and how to change it, refer to Hierarchy evaluation rules.

Benefits

You can use custom organization policies to enforce specific security policies on your Datastream resources. For example, you can restrict the display names of streams, the types of connection profiles, or the regions where private connectivity can be established. This helps ensure compliance and governance across your organization.

Limitations

• Policy changes don't apply retroactively to existing Datastream resources.
• An existing resource configuration remains valid even if it has non-compliant values, unless it's updated.
• Custom constraint evaluation might add a small latency to resource creation and update requests.

Before you begin

Sign in to your Google Cloud account. If you're new to Google Cloud, create an account to evaluate how our products perform in real-world scenarios. New customers also get $300 in free credits to run, test, and deploy workloads.

In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

Roles required to select or create a project

• Select a project: Selecting a project doesn't require a specific IAM role—you can select any project that you've been granted a role on.
• Create a project: To create a project, you need the Project Creator (roles/resourcemanager.projectCreator), which contains the resourcemanager.projects.create permission. Learn how to grant roles.

Go to project selector

Verify that billing is enabled for your Google Cloud project.

Install the Google Cloud CLI.

If you're using an external identity provider (IdP), you must first sign in to the gcloud CLI with your federated identity.

To initialize the gcloud CLI, run the following command:

gcloud init

In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

Roles required to select or create a project

• Select a project: Selecting a project doesn't require a specific IAM role—you can select any project that you've been granted a role on.
• Create a project: To create a project, you need the Project Creator (roles/resourcemanager.projectCreator), which contains the resourcemanager.projects.create permission. Learn how to grant roles.

Go to project selector

Verify that billing is enabled for your Google Cloud project.

Install the Google Cloud CLI.

If you're using an external identity provider (IdP), you must first sign in to the gcloud CLI with your federated identity.

To initialize the gcloud CLI, run the following command:

gcloud init

1. Ensure that you know your organization ID.

Required roles

To get the permissions that you need to manage custom organization policies, ask your administrator to grant you the Organization Policy Administrator (roles/orgpolicy.policyAdmin) IAM role on the organization resource. For more information about granting roles, see Manage access to projects, folders, and organizations.

You might also be able to get the required permissions through custom roles or other predefined roles.

Create a custom constraint

A custom constraint is defined in a YAML file by the resources, methods, conditions, and actions that are supported by the service on which you are enforcing the organization policy. Conditions for your custom constraints are defined using Common Expression Language (CEL). For more information about how to build conditions in custom constraints using CEL, see the CEL section of Creating and managing custom constraints.

To create a custom constraint, create a YAML file using the following format:

name: organizations/ORGANIZATION_ID/customConstraints/CONSTRAINT_NAME
resourceTypes:
- RESOURCE_NAME
methodTypes:
- CREATE
- UPDATE
condition: "CONDITION"
actionType: ACTION
displayName: DISPLAY_NAME
description: DESCRIPTION

Replace the following:

• ORGANIZATION_ID: your organization ID, such as 123456789.

• CONSTRAINT_NAME: the name you want for your new custom constraint. A custom constraint must start with custom., and can only include uppercase letters, lowercase letters, or numbers. For example, custom.restrictDatastreamStreamDisplayName. The maximum length of this field is 70 characters.

• RESOURCE_NAME: the fully qualified name of the Google Cloud resource containing the object and field you want to restrict. For example, datastream.googleapis.com/Stream.

• CONDITION: a CEL condition that is written against a representation of a supported service resource. This field has a maximum length of 1000 characters. See Supported resources for more information about the resources available to write conditions against. For example, "!resource.displayName.startsWith('test-')".

• ACTION: the action to take if the condition is met. Possible values are ALLOW and DENY.

• DISPLAY_NAME: a human-friendly name for the constraint. This field has a maximum length of 200 characters.

• DESCRIPTION: a human-friendly description of the constraint to display as an error message when the policy is violated. This field has a maximum length of 2000 characters.

For more information about how to create a custom constraint, see Defining custom constraints.

Set up a custom constraint

After you have created the YAML file for a new custom constraint, you must set it up to make it available for organization policies in your organization. To set up a custom constraint, use the gcloud org-policies set-custom-constraint command:

gcloud org-policies set-custom-constraint CONSTRAINT_PATH

Replace CONSTRAINT_PATH with the full path to your custom constraint file. For example, /home/user/customconstraint.yaml. Once completed, your custom constraints are available as organization policies in your list of Google Cloud organization policies. To verify that the custom constraint exists, use the gcloud org-policies list-custom-constraints command:

gcloud org-policies list-custom-constraints --organization=ORGANIZATION_ID

Replace ORGANIZATION_ID with the ID of your organization resource. For more information, see Viewing organization policies.

Enforce a custom organization policy

You can enforce a constraint by creating an organization policy that references it, and then applying that organization policy to a Google Cloud resource.

Console

1. In the Google Cloud console, go to the Organization policies page.

   Go to Organization policies

2. From the project picker, select the project for which you want to set the organization policy.
3. From the list on the Organization policies page, select your constraint to view the Policy details page for that constraint.
4. To configure the organization policy for this resource, click Manage policy.
5. On the Edit policy page, select Override parent's policy.
6. Click Add a rule.
7. In the Enforcement section, select whether enforcement of this organization policy is on or off.
8. Optional: To make the organization policy conditional on a tag, click Add condition. Note that if you add a conditional rule to an organization policy, you must add at least one unconditional rule or the policy cannot be saved. For more information, see Setting an organization policy with tags.
9. Click Test changes to simulate the effect of the organization policy. Policy simulation isn't available for legacy managed constraints. For more information, see Test organization policy changes with Policy Simulator.
10. To finish and apply the organization policy, click Set policy. The policy requires up to 15 minutes to take effect.

gcloud

To create an organization policy with boolean rules, create a policy YAML file that references the constraint:

      name: projects/PROJECT_ID/policies/CONSTRAINT_NAME
      spec:
        rules:
        - enforce: true
    

Replace the following:

• PROJECT_ID: the project on which you want to enforce your constraint.
• CONSTRAINT_NAME: the name you defined for your custom constraint. For example, custom.restrictDatastreamStreamDisplayName.

To enforce the organization policy containing the constraint, run the following command:

    gcloud org-policies set-policy POLICY_PATH
    

Replace POLICY_PATH with the full path to your organization policy YAML file. The policy requires up to 15 minutes to take effect.

Test the custom organization policy

The following example creates a custom constraint and policy that blocks the creation of Datastream streams if their display name doesn't start with test-.

Before you begin, you need the following:

• Your organization ID
• A project ID

Create the constraint

1. Save the following file as constraint-datastream-stream-displayname.yaml:

   name: organizations/ORGANIZATION_ID/customConstraints/custom.restrictDatastreamStreamDisplayName
   resourceTypes:
   - datastream.googleapis.com/Stream
   methodTypes:
   - CREATE
   - UPDATE
   condition: "!resource.displayName.startsWith('test-')"
   actionType: DENY
   displayName: Restrict stream display names
   description: All new Datastream streams must have a display name starting with 'test-'
   

   This defines a constraint where every new or updated stream must have a displayName that starts with test-.

2. Apply the constraint:

   gcloud org-policies set-custom-constraint ~/constraint-datastream-stream-displayname.yaml
   

3. Verify that the constraint exists:

   gcloud org-policies list-custom-constraints --organization=ORGANIZATION_ID
   

Create the policy

1. Save the following file as policy-deny-stream-displayname.yaml:

   name: projects/PROJECT_ID/policies/custom.restrictDatastreamStreamDisplayName
   spec:
     rules:
     - enforce: true
   

   Replace PROJECT_ID with your project ID.

2. Apply the policy:

   gcloud org-policies set-policy ~/policy-deny-stream-displayname.yaml
   

Test the policy

Try to create a Datastream stream with a non-compliant display name:

# This command is a conceptual example. You need to provide valid source and destination config IDs.
# Replace <VAR> placeholders with actual values.
gcloud datastream streams create my-prod-stream --location=<VAR>LOCATION</VAR> --display-name="production-stream" --source=<VAR>SOURCE_CP</VAR> --destination=<VAR>DEST_CP</VAR> ...

The output should include an error similar to:

Operation denied by custom org policies: ["customConstraints/custom.restrictDatastreamStreamDisplayName": "All new Datastream streams must have a display name starting with 'test-'"]

Example custom organization policies for common use cases

This table provides syntax examples for some common custom constraints.

Description	Constraint syntax
Restrict stream display names	Ensures all new streams follow a specific naming convention. name: organizations/ORGANIZATION_ID/customConstraints/custom.restrictDatastreamStreamDisplayName resourceTypes: - datastream.googleapis.com/Stream methodTypes: - CREATE - UPDATE condition: "!resource.displayName.startsWith('test-')" actionType: DENY displayName: Restrict stream display names description: All new Datastream streams must have a display name starting with 'test-'
Restrict connection profile types to MySQL only	Ensures only MySQL connection profiles can be created. Note: The exact condition depends on the structure of the generated Common Expression Language (CEL) protocol buffer for connection profiles. This example assumes a field indicating the profile type. name: organizations/ORGANIZATION_ID/customConstraints/custom.restrictDatastreamToMySQL resourceTypes: - datastream.googleapis.com/ConnectionProfile methodTypes: - CREATE # This condition is an example and needs to be validated against the actual CEL proto fields. # It checks for the presence of the mysqlProfile field. condition: "!has(resource.mysqlProfile)" actionType: DENY displayName: Restrict connection profiles to MySQL description: Only MySQL source connection profiles can be created.
Restrict private connection to a specific VPC	Ensures private connections only use an approved VPC network. Note: This example assumes the VPC name is available in resource.vpcPeeringConfig.vpc. name: organizations/ORGANIZATION_ID/customConstraints/custom.restrictDatastreamPrivateConnectionVPC resourceTypes: - datastream.googleapis.com/PrivateConnection methodTypes: - CREATE # This condition assumes the vpc name is accessible via resource.vpcPeeringConfig.vpc. # This needs to be verified against the actual CEL proto. condition: "resource.vpcPeeringConfig.vpc != 'projects/ALLOWED_PROJECT/global/networks/ALLOWED_VPC'" actionType: DENY displayName: Restrict Private Connection VPC description: Private Connections can only be created with the allowed VPC.

Datastream supported resources

The following table lists the Datastream resources that you can reference in custom constraints.

What's next

• Learn more about Organization Policy Service.
• Learn more about how to create and manage organization policies.
• See the full list of managed organization policy constraints.