Pause, resume, stop, and restart a connector

You can control the operation of a connector by pausing, resuming, stopping, or restarting it. These actions allow you to manage data flow and address issues without deleting and recreating the connector.

To pause, resume, stop, or restart a connector in a Connect cluster, you can use the Google Cloud console, the gcloud CLI, the Managed Service for Apache Kafka client library, or the Managed Kafka API. You can't use the open source Apache Kafka API to change connector states.

Required roles and permissions to pause, resume, stop, or restart a connector

To get the permissions that you need to pause, resume, stop, or restart a connector, ask your administrator to grant you the Managed Kafka Connector Editor (roles/managedkafka.connectorEditor) IAM role on the project containing the Connect cluster. For more information about granting roles, see Manage access to projects, folders, and organizations.

This predefined role contains the permissions required to pause, resume, stop, or restart a connector. To see the exact permissions that are required, expand the Required permissions section:

Required permissions

The following permissions are required to pause, resume, stop, or restart a connector:

  • Grant the pause connector permission on the requested connector: managedkafka.connectors.pause
  • Grant the resume connector permission on the requested connector: managedkafka.connectors.resume
  • Grant the restart connector permission on the requested connector: managedkafka.connectors.restart
  • Grant the stop connector permission on the requested connector: managedkafka.connectors.stop

You might also be able to get these permissions with custom roles or other predefined roles.

For more information about the Managed Kafka Connector Editor role, see Managed Service for Apache Kafka predefined roles.

Pause a connector

When you pause a connector, its state is preserved. This means the connector remembers where it left off in processing messages or data. Message processing is halted until the connector is resumed. You can resume a paused connector, and it continues from where it was paused. This is useful for troubleshooting or performing maintenance without losing the connector's setup.

Console

  1. In the Google Cloud console, go to the Connect clusters page.

    Go to Connect clusters

  2. Click the Connect cluster that hosts the connector you want to pause.

    The Connect cluster details page is displayed.

  3. On the Resources tab, find the connector in the list and click its name.

    You are redirected to the Connector details page.

  4. Click Pause.

gcloud

  1. In the Google Cloud console, activate Cloud Shell.

    Activate Cloud Shell

    At the bottom of the Google Cloud console, a Cloud Shell session starts and displays a command-line prompt. Cloud Shell is a shell environment with the Google Cloud CLI already installed and with values already set for your current project. It can take a few seconds for the session to initialize.

  2. Use the gcloud alpha managed-kafka connectors pause command to pause a connector:

    gcloud alpha managed-kafka connectors pause CONNECTOR_ID \
    --location=LOCATION \
    --connect_cluster=CONNECT_CLUSTER_ID

    Replace the following:

    • CONNECTOR_ID: Required. The ID of the connector you want to pause.

    • LOCATION: Required. The location of the Connect cluster containing the connector.

    • CONNECT_CLUSTER_ID: Required. The ID of the Connect cluster containing the connector.

Resume a connector

Resuming a paused connector restarts its operation from where it left off.

Console

  1. In the Google Cloud console, go to the Connect clusters page.

    Go to Connect clusters

  2. Click the Connect cluster that hosts the connector you want to resume.

    The Connect cluster details page is displayed.

  3. On the Resources tab, find the paused connector in the list and click its name.

    You are redirected to the Connector details page.

  4. Click Resume.

gcloud

  1. In the Google Cloud console, activate Cloud Shell.

    Activate Cloud Shell

    At the bottom of the Google Cloud console, a Cloud Shell session starts and displays a command-line prompt. Cloud Shell is a shell environment with the Google Cloud CLI already installed and with values already set for your current project. It can take a few seconds for the session to initialize.

  2. Use the gcloud alpha managed-kafka connectors resume command to resume a connector:

    gcloud alpha managed-kafka connectors resume CONNECTOR_ID \
    --location=LOCATION \
    --connect_cluster=CONNECT_CLUSTER_ID

    Replace the following:

    • CONNECTOR_ID: Required. The ID of the connector you want to resume.

    • LOCATION: Required. The location of the Connect cluster containing the connector.

    • CONNECT_CLUSTER_ID: Required. The ID of the Connect cluster containing the connector.

Stop a connector

Stopping a connector stops all tasks of the connector. Stopping a connector preserves its state. To get the connector running again, you restart the connector. The logs and metrics are also stored durably.

Console

  1. In the Google Cloud console, go to the Connect clusters page.

    Go to Connect clusters

  2. Click the Connect cluster that hosts the connector you want to stop.

    The Connect cluster details page is displayed.

  3. On the Resources tab, find the connector in the list and click its name.

    You are redirected to the Connector details page.

  4. Click Stop.

gcloud

  1. In the Google Cloud console, activate Cloud Shell.

    Activate Cloud Shell

    At the bottom of the Google Cloud console, a Cloud Shell session starts and displays a command-line prompt. Cloud Shell is a shell environment with the Google Cloud CLI already installed and with values already set for your current project. It can take a few seconds for the session to initialize.

  2. Use the gcloud alpha managed-kafka connectors stop command to stop a connector:

    gcloud alpha managed-kafka connectors stop CONNECTOR_ID \
    --location=LOCATION \
    --connect_cluster=CONNECT_CLUSTER_ID

    Replace the following:

    • CONNECTOR_ID: Required. The ID of the connector you want to stop.

    • LOCATION: Required. The location of the Connect cluster containing the connector.

    • CONNECT_CLUSTER_ID: Required. The ID of the Connect cluster containing the connector.

Restart a connector

Restarting a connector completely stops and then restarts its tasks. This can be useful for refreshing the connector's state or applying configuration changes.

Note: Restarting a connector might cause a brief interruption in data flow.

Console

  1. In the Google Cloud console, go to the Connect clusters page.

    Go to Connect clusters

  2. Click the Connect cluster that hosts the connector you want to restart.

    The Connect cluster details page is displayed.

  3. On the Resources tab, find the connector in the list and click its name.

    You are redirected to the Connector details page.

  4. Click Restart.

gcloud

  1. In the Google Cloud console, activate Cloud Shell.

    Activate Cloud Shell

    At the bottom of the Google Cloud console, a Cloud Shell session starts and displays a command-line prompt. Cloud Shell is a shell environment with the Google Cloud CLI already installed and with values already set for your current project. It can take a few seconds for the session to initialize.

  2. Use the gcloud alpha managed-kafka connectors restart command to restart a connector:

    gcloud alpha managed-kafka connectors restart CONNECTOR_ID \
    --location=LOCATION \
    --connect_cluster=CONNECT_CLUSTER_ID

    Replace the following:

    • CONNECTOR_ID: Required. The ID of the connector you want to restart.

    • LOCATION: Required. The location of the Connect cluster containing the connector.

    • CONNECT_CLUSTER_ID: Required. The ID of the Connect cluster containing the connector.

Apache Kafka® is a registered trademark of The Apache Software Foundation or its affiliates in the United States and/or other countries.