Stay organized with collections
Save and categorize content based on your preferences.
This document describes audit logging for Dataflow. Google Cloud services
generate audit logs that record administrative and access activities within your Google Cloud resources.
For more information about Cloud Audit Logs, see the following:
Each IAM permission has a type property, whose value is an enum
that can be one of four values: ADMIN_READ, ADMIN_WRITE,
DATA_READ, or DATA_WRITE. When you call a method,
Dataflow generates an audit log whose category is dependent on the
type property of the permission required to perform the method.
Methods that require an IAM permission with the type property value
of DATA_READ, DATA_WRITE, or ADMIN_READ generate
Data Access audit logs.
Methods that require an IAM permission with the type property value
of ADMIN_WRITE generate
Admin Activity audit logs.
Permission type
Methods
ADMIN_WRITE
dataflow.jobs.create dataflow.jobs.cancel
OTHER
resourcemanager.projects.get: To enable this log, enable ADMIN_READ under the service cloudresourcemanager.googleapis.com. resourcemanager.projects.get: To enable this log, enable ADMIN_READ under the service cloudresourcemanager.googleapis.com. resourcemanager.projects.get: To enable this log, enable ADMIN_READ under the service cloudresourcemanager.googleapis.com. resourcemanager.projects.get: To enable this log, enable ADMIN_READ under the service cloudresourcemanager.googleapis.com.
API interface audit logs
For information about how and which permissions are evaluated for each method,
see the Identity and Access Management documentation for Dataflow.
google.dataflow.v1beta3.FlexTemplatesService
The following audit logs are associated with methods belonging to
google.dataflow.v1beta3.FlexTemplatesService.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-08-26 UTC."],[[["\u003cp\u003eGoogle Cloud's Dataflow service generates audit logs that record administrative and access activities within your resources.\u003c/p\u003e\n"],["\u003cp\u003eDataflow audit logs use the service name \u003ccode\u003edataflow.googleapis.com\u003c/code\u003e, which can be used for filtering.\u003c/p\u003e\n"],["\u003cp\u003eMethods requiring \u003ccode\u003eADMIN_WRITE\u003c/code\u003e permissions generate Admin Activity audit logs, while methods needing \u003ccode\u003eDATA_READ\u003c/code\u003e, \u003ccode\u003eDATA_WRITE\u003c/code\u003e, or \u003ccode\u003eADMIN_READ\u003c/code\u003e permissions create Data Access audit logs.\u003c/p\u003e\n"],["\u003cp\u003eCertain Dataflow methods like \u003ccode\u003edataflow.jobs.create\u003c/code\u003e and \u003ccode\u003edataflow.jobs.cancel\u003c/code\u003e are categorized as \u003ccode\u003eADMIN_WRITE\u003c/code\u003e and trigger Admin Activity audit logs, while methods like \u003ccode\u003eresourcemanager.projects.get\u003c/code\u003e are \u003ccode\u003eADMIN_READ\u003c/code\u003e and generate Data Access audit logs.\u003c/p\u003e\n"],["\u003cp\u003eA list of specific methods within Dataflow, such as \u003ccode\u003egoogle.dataflow.v1beta3.JobsV1Beta3.GetJob\u003c/code\u003e and others, are identified as not producing audit logs due to high volume, low auditing value, or coverage by other logs.\u003c/p\u003e\n"]]],[],null,["# Dataflow audit logging\n\nThis document describes audit logging for Dataflow. Google Cloud services\ngenerate audit logs that record administrative and access activities within your Google Cloud resources.\nFor more information about Cloud Audit Logs, see the following:\n\n- [Types of audit logs](/logging/docs/audit#types)\n- [Audit log entry structure](/logging/docs/audit#audit_log_entry_structure)\n- [Storing and routing audit logs](/logging/docs/audit#storing_and_routing_audit_logs)\n- [Cloud Logging pricing summary](/stackdriver/pricing#logs-pricing-summary)\n- [Enable Data Access audit logs](/logging/docs/audit/configure-data-access)\n\n\u003cbr /\u003e\n\nService name\n------------\n\nDataflow audit logs use the service name `dataflow.googleapis.com`.\nFilter for this service: \n\n```gdscript\n protoPayload.serviceName=\"dataflow.googleapis.com\"\n \n```\n\n\u003cbr /\u003e\n\nMethods by permission type\n--------------------------\n\nEach IAM permission has a `type` property, whose value is an enum\nthat can be one of four values: `ADMIN_READ`, `ADMIN_WRITE`,\n`DATA_READ`, or `DATA_WRITE`. When you call a method,\nDataflow generates an audit log whose category is dependent on the\n`type` property of the permission required to perform the method.\n\nMethods that require an IAM permission with the `type` property value\nof `DATA_READ`, `DATA_WRITE`, or `ADMIN_READ` generate\n[Data Access](/logging/docs/audit#data-access) audit logs.\n\nMethods that require an IAM permission with the `type` property value\nof `ADMIN_WRITE` generate\n[Admin Activity](/logging/docs/audit#admin-activity) audit logs.\n\nAPI interface audit logs\n------------------------\n\nFor information about how and which permissions are evaluated for each method,\nsee the Identity and Access Management documentation for Dataflow.\n\n### `google.dataflow.v1beta3.FlexTemplatesService`\n\nThe following audit logs are associated with methods belonging to\n`google.dataflow.v1beta3.FlexTemplatesService`.\n\n#### `get`\n\n- **Method** : `resourcemanager.projects.get` \n- **Audit log type** : [Data access](/logging/docs/audit#data-access) \n- **Permissions** :\n - `resourcemanager.projects.get - ADMIN_READ`\n- **Method is a long-running or streaming operation** : No. \n- **Filter for this method** : `\n protoPayload.methodName=\"resourcemanager.projects.get\"\n ` \n\n### `google.dataflow.v1beta3.JobsV1Beta3`\n\nThe following audit logs are associated with methods belonging to\n`google.dataflow.v1beta3.JobsV1Beta3`.\n\n#### `create`\n\n- **Method** : `dataflow.jobs.create` \n- **Audit log type** : [Admin activity](/logging/docs/audit#admin-activity) \n- **Permissions** :\n - `dataflow.jobs.create - ADMIN_WRITE`\n- **Method is a long-running or streaming operation** : No. \n- **Filter for this method** : `\n protoPayload.methodName=\"dataflow.jobs.create\"\n ` \n\n#### `cancel`\n\n- **Method** : `dataflow.jobs.cancel` \n- **Audit log type** : [Admin activity](/logging/docs/audit#admin-activity) \n- **Permissions** :\n - `dataflow.jobs.cancel - ADMIN_WRITE`\n - `dataflow.jobs.updateContents - ADMIN_WRITE`\n- **Method is a long-running or streaming operation** : No. \n- **Filter for this method** : `\n protoPayload.methodName=\"dataflow.jobs.cancel\"\n ` \n\n### `google.dataflow.v1beta3.TemplatesService`\n\nThe following audit logs are associated with methods belonging to\n`google.dataflow.v1beta3.TemplatesService`.\n\n#### `get`\n\n- **Method** : `resourcemanager.projects.get` \n- **Audit log type** : [Data access](/logging/docs/audit#data-access) \n- **Permissions** :\n - `resourcemanager.projects.get - ADMIN_READ`\n- **Method is a long-running or streaming operation** : No. \n- **Filter for this method** : `\n protoPayload.methodName=\"resourcemanager.projects.get\"\n ` \n\n#### `get`\n\n- **Method** : `resourcemanager.projects.get` \n- **Audit log type** : [Data access](/logging/docs/audit#data-access) \n- **Permissions** :\n - `resourcemanager.projects.get - ADMIN_READ`\n- **Method is a long-running or streaming operation** : No. \n- **Filter for this method** : `\n protoPayload.methodName=\"resourcemanager.projects.get\"\n ` \n\n#### `get`\n\n- **Method** : `resourcemanager.projects.get` \n- **Audit log type** : [Data access](/logging/docs/audit#data-access) \n- **Permissions** :\n - `resourcemanager.projects.get - ADMIN_READ`\n- **Method is a long-running or streaming operation** : No. \n- **Filter for this method** : `\n protoPayload.methodName=\"resourcemanager.projects.get\"\n ` \n\nMethods that don't produce audit logs\n-------------------------------------\n\nA method might not produce audit logs for one or more of the following\nreasons:\n\n- It is a high volume method involving significant log generation and storage costs.\n- It has low auditing value.\n- Another audit or platform log already provides method coverage.\n\n\u003cbr /\u003e\n\nThe following methods don't produce audit logs:\n\n- `google.dataflow.v1beta3.DebugCaptureV1Beta3.GetConfig`\n- `google.dataflow.v1beta3.DebugCaptureV1Beta3.SendCapture`\n- `google.dataflow.v1beta3.JobsV1Beta3.AggregatedListJobs`\n- `google.dataflow.v1beta3.JobsV1Beta3.CheckActiveJobs`\n- `google.dataflow.v1beta3.JobsV1Beta3.GetJob`\n- `google.dataflow.v1beta3.JobsV1Beta3.ListJobs`\n- `google.dataflow.v1beta3.JobsV1Beta3.SnapshotJob`\n- `google.dataflow.v1beta3.MessagesV1Beta3.ListJobMessages`\n- `google.dataflow.v1beta3.MetricsV1Beta3.GetJobExecutionDetails`\n- `google.dataflow.v1beta3.MetricsV1Beta3.GetJobMetrics`\n- `google.dataflow.v1beta3.MetricsV1Beta3.GetStageExecutionDetails`\n- `google.dataflow.v1beta3.SnapshotsV1Beta3.DeleteSnapshot`\n- `google.dataflow.v1beta3.SnapshotsV1Beta3.GetSnapshot`\n- `google.dataflow.v1beta3.SnapshotsV1Beta3.ListSnapshots`\n- `google.dataflow.v1beta3.WorkItemsV1Beta3.LeaseWorkItem`\n- `google.dataflow.v1beta3.WorkItemsV1Beta3.ReportWorkItemStatus`\n- `google.dataflow.v1beta3.WorkerMessagesV1Beta3.SendWorkerMessages`"]]
