Dataproc audit logging

This document describes audit logging for Dataproc and Dataproc Serverless. Google Cloud services generate audit logs that record administrative and access activities within your Google Cloud resources. For more information about Cloud Audit Logs, see the following:

Service name

Dataproc and Dataproc Serverless audit logs use the service name dataproc.googleapis.com. Filter for this service:

    protoPayload.serviceName="dataproc.googleapis.com"
  

Methods by permission type

Each IAM permission has a type property, whose value is an enum that can be one of four values: ADMIN_READ, ADMIN_WRITE, DATA_READ, or DATA_WRITE. When you call a method, Dataproc and Dataproc Serverless generates an audit log whose category is dependent on the type property of the permission required to perform the method. Methods that require an IAM permission with the type property value of DATA_READ, DATA_WRITE, or ADMIN_READ generate Data Access audit logs. Methods that require an IAM permission with the type property value of ADMIN_WRITE generate Admin Activity audit logs.

Permission type Methods
ADMIN_READ google.cloud.dataproc.v1.AutoscalingPolicyService.GetAutoscalingPolicy
google.cloud.dataproc.v1.AutoscalingPolicyService.ListAutoscalingPolicies
google.cloud.dataproc.v1.BatchController.GetBatch
google.cloud.dataproc.v1.BatchController.ListBatches
google.cloud.dataproc.v1.ClusterController.GetCluster
google.cloud.dataproc.v1.ClusterController.ListClusters
google.cloud.dataproc.v1.JobController.GetJob
google.cloud.dataproc.v1.JobController.ListJobs
google.cloud.dataproc.v1.NodeGroupController.GetNodeGroup
google.cloud.dataproc.v1.SessionController.GetSession
google.cloud.dataproc.v1.SessionController.ListSessions
google.cloud.dataproc.v1.SessionTemplateController.GetSessionTemplate
google.cloud.dataproc.v1.SessionTemplateController.ListSessionTemplates
google.cloud.dataproc.v1.WorkflowTemplateService.GetWorkflowTemplate
google.cloud.dataproc.v1.WorkflowTemplateService.ListWorkflowTemplates
google.cloud.dataproc.v1beta2.AutoscalingPolicyService.GetAutoscalingPolicy
google.cloud.dataproc.v1beta2.ClusterController.GetCluster
google.cloud.dataproc.v1beta2.ClusterController.ListClusters
google.cloud.dataproc.v1beta2.JobController.GetJob
google.cloud.dataproc.v1beta2.JobController.ListJobs
google.cloud.dataproc.v1beta2.WorkflowTemplateService.GetWorkflowTemplate
google.cloud.dataproc.v1beta2.WorkflowTemplateService.ListWorkflowTemplates
google.iam.v1.IAMPolicy.GetIamPolicy
google.longrunning.Operations.GetOperation
google.longrunning.Operations.ListOperations
ADMIN_WRITE google.cloud.dataproc.v1.AnalysisService.AnalyzeBatch
google.cloud.dataproc.v1.AutoscalingPolicyService.CreateAutoscalingPolicy
google.cloud.dataproc.v1.AutoscalingPolicyService.DeleteAutoscalingPolicy
google.cloud.dataproc.v1.AutoscalingPolicyService.UpdateAutoscalingPolicy
google.cloud.dataproc.v1.BatchController.CreateBatch
google.cloud.dataproc.v1.BatchController.DeleteBatch
google.cloud.dataproc.v1.ClusterController.CreateCluster
google.cloud.dataproc.v1.ClusterController.DeleteCluster
google.cloud.dataproc.v1.ClusterController.DiagnoseCluster
google.cloud.dataproc.v1.ClusterController.InjectCredentials
google.cloud.dataproc.v1.ClusterController.RepairCluster
google.cloud.dataproc.v1.ClusterController.StartCluster
google.cloud.dataproc.v1.ClusterController.StopCluster
google.cloud.dataproc.v1.ClusterController.UpdateCluster
google.cloud.dataproc.v1.JobController.CancelJob
google.cloud.dataproc.v1.JobController.DeleteJob
google.cloud.dataproc.v1.JobController.SubmitJob
google.cloud.dataproc.v1.JobController.SubmitJobAsOperation
google.cloud.dataproc.v1.JobController.UpdateJob
google.cloud.dataproc.v1.NodeGroupController.CreateNodeGroup
google.cloud.dataproc.v1.NodeGroupController.RepairNodeGroup
google.cloud.dataproc.v1.NodeGroupController.ResizeNodeGroup
google.cloud.dataproc.v1.SessionController.CreateSession
google.cloud.dataproc.v1.SessionController.DeleteSession
google.cloud.dataproc.v1.SessionController.TerminateSession
google.cloud.dataproc.v1.SessionTemplateController.CreateSessionTemplate
google.cloud.dataproc.v1.SessionTemplateController.DeleteSessionTemplate
google.cloud.dataproc.v1.SessionTemplateController.UpdateSessionTemplate
google.cloud.dataproc.v1.WorkflowTemplateService.CreateWorkflowTemplate
google.cloud.dataproc.v1.WorkflowTemplateService.DeleteWorkflowTemplate
google.cloud.dataproc.v1.WorkflowTemplateService.InstantiateInlineWorkflowTemplate
google.cloud.dataproc.v1.WorkflowTemplateService.InstantiateWorkflowTemplate
google.cloud.dataproc.v1.WorkflowTemplateService.UpdateWorkflowTemplate
google.cloud.dataproc.v1beta2.AutoscalingPolicyService.CreateAutoscalingPolicy
google.cloud.dataproc.v1beta2.AutoscalingPolicyService.DeleteAutoscalingPolicy
google.cloud.dataproc.v1beta2.AutoscalingPolicyService.UpdateAutoscalingPolicy
google.cloud.dataproc.v1beta2.ClusterController.CreateCluster
google.cloud.dataproc.v1beta2.ClusterController.DeleteCluster
google.cloud.dataproc.v1beta2.ClusterController.DiagnoseCluster
google.cloud.dataproc.v1beta2.ClusterController.StartCluster
google.cloud.dataproc.v1beta2.ClusterController.StopCluster
google.cloud.dataproc.v1beta2.ClusterController.UpdateCluster
google.cloud.dataproc.v1beta2.JobController.CancelJob
google.cloud.dataproc.v1beta2.JobController.SubmitJob
google.cloud.dataproc.v1beta2.JobController.SubmitJobAsOperation
google.cloud.dataproc.v1beta2.JobController.UpdateJob
google.cloud.dataproc.v1beta2.WorkflowTemplateService.CreateWorkflowTemplate
google.cloud.dataproc.v1beta2.WorkflowTemplateService.DeleteWorkflowTemplate
google.cloud.dataproc.v1beta2.WorkflowTemplateService.InstantiateInlineWorkflowTemplate
google.cloud.dataproc.v1beta2.WorkflowTemplateService.InstantiateWorkflowTemplate
google.cloud.dataproc.v1beta2.WorkflowTemplateService.UpdateWorkflowTemplate
google.iam.v1.IAMPolicy.SetIamPolicy
google.longrunning.Operations.CancelOperation
google.longrunning.Operations.DeleteOperation

API interface audit logs

For information about how and which permissions are evaluated for each method, see the Identity and Access Management documentation for Dataproc and Dataproc Serverless.

google.cloud.dataproc.v1.AnalysisService

The following audit logs are associated with methods belonging to google.cloud.dataproc.v1.AnalysisService.

AnalyzeBatch

  • Method: google.cloud.dataproc.v1.AnalysisService.AnalyzeBatch
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.batches.analyze - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.AnalysisService.AnalyzeBatch"

google.cloud.dataproc.v1.AutoscalingPolicyService

The following audit logs are associated with methods belonging to google.cloud.dataproc.v1.AutoscalingPolicyService.

CreateAutoscalingPolicy

  • Method: google.cloud.dataproc.v1.AutoscalingPolicyService.CreateAutoscalingPolicy
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.autoscalingPolicies.create - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.AutoscalingPolicyService.CreateAutoscalingPolicy"

DeleteAutoscalingPolicy

  • Method: google.cloud.dataproc.v1.AutoscalingPolicyService.DeleteAutoscalingPolicy
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.autoscalingPolicies.delete - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.AutoscalingPolicyService.DeleteAutoscalingPolicy"

GetAutoscalingPolicy

  • Method: google.cloud.dataproc.v1.AutoscalingPolicyService.GetAutoscalingPolicy
  • Audit log type: Data access
  • Permissions:
    • dataproc.autoscalingPolicies.get - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.AutoscalingPolicyService.GetAutoscalingPolicy"

ListAutoscalingPolicies

  • Method: google.cloud.dataproc.v1.AutoscalingPolicyService.ListAutoscalingPolicies
  • Audit log type: Data access
  • Permissions:
    • dataproc.autoscalingPolicies.list - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.AutoscalingPolicyService.ListAutoscalingPolicies"

UpdateAutoscalingPolicy

  • Method: google.cloud.dataproc.v1.AutoscalingPolicyService.UpdateAutoscalingPolicy
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.autoscalingPolicies.update - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.AutoscalingPolicyService.UpdateAutoscalingPolicy"

google.cloud.dataproc.v1.BatchController

The following audit logs are associated with methods belonging to google.cloud.dataproc.v1.BatchController.

CreateBatch

  • Method: google.cloud.dataproc.v1.BatchController.CreateBatch
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.batches.create - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.BatchController.CreateBatch"

DeleteBatch

  • Method: google.cloud.dataproc.v1.BatchController.DeleteBatch
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.batches.delete - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.BatchController.DeleteBatch"

GetBatch

  • Method: google.cloud.dataproc.v1.BatchController.GetBatch
  • Audit log type: Data access
  • Permissions:
    • dataproc.batches.get - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.BatchController.GetBatch"

ListBatches

  • Method: google.cloud.dataproc.v1.BatchController.ListBatches
  • Audit log type: Data access
  • Permissions:
    • dataproc.batches.list - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.BatchController.ListBatches"

google.cloud.dataproc.v1.ClusterController

The following audit logs are associated with methods belonging to google.cloud.dataproc.v1.ClusterController.

CreateCluster

  • Method: google.cloud.dataproc.v1.ClusterController.CreateCluster
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.autoscalingPolicies.use - ADMIN_READ
    • dataproc.clusters.create - ADMIN_WRITE
    • dataproc.clusters.get - ADMIN_READ
    • dataproc.operations.get - ADMIN_READ
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.ClusterController.CreateCluster"

DeleteCluster

  • Method: google.cloud.dataproc.v1.ClusterController.DeleteCluster
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.clusters.delete - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.ClusterController.DeleteCluster"

DiagnoseCluster

  • Method: google.cloud.dataproc.v1.ClusterController.DiagnoseCluster
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.clusters.use - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.ClusterController.DiagnoseCluster"

GetCluster

  • Method: google.cloud.dataproc.v1.ClusterController.GetCluster
  • Audit log type: Data access
  • Permissions:
    • dataproc.clusters.get - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.ClusterController.GetCluster"

InjectCredentials

  • Method: google.cloud.dataproc.v1.ClusterController.InjectCredentials
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.clusters.use - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.ClusterController.InjectCredentials"

ListClusters

  • Method: google.cloud.dataproc.v1.ClusterController.ListClusters
  • Audit log type: Data access
  • Permissions:
    • dataproc.clusters.list - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.ClusterController.ListClusters"

RepairCluster

  • Method: google.cloud.dataproc.v1.ClusterController.RepairCluster
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.clusters.update - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.ClusterController.RepairCluster"

StartCluster

  • Method: google.cloud.dataproc.v1.ClusterController.StartCluster
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.clusters.start - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.ClusterController.StartCluster"

StopCluster

  • Method: google.cloud.dataproc.v1.ClusterController.StopCluster
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.clusters.stop - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.ClusterController.StopCluster"

UpdateCluster

  • Method: google.cloud.dataproc.v1.ClusterController.UpdateCluster
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.clusters.update - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.ClusterController.UpdateCluster"

google.cloud.dataproc.v1.JobController

The following audit logs are associated with methods belonging to google.cloud.dataproc.v1.JobController.

CancelJob

  • Method: google.cloud.dataproc.v1.JobController.CancelJob
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.jobs.cancel - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.JobController.CancelJob"

DeleteJob

  • Method: google.cloud.dataproc.v1.JobController.DeleteJob
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.jobs.delete - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.JobController.DeleteJob"

GetJob

  • Method: google.cloud.dataproc.v1.JobController.GetJob
  • Audit log type: Data access
  • Permissions:
    • dataproc.jobs.get - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.JobController.GetJob"

ListJobs

  • Method: google.cloud.dataproc.v1.JobController.ListJobs
  • Audit log type: Data access
  • Permissions:
    • dataproc.jobs.list - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.JobController.ListJobs"

SubmitJob

  • Method: google.cloud.dataproc.v1.JobController.SubmitJob
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.clusters.use - ADMIN_WRITE
    • dataproc.jobs.create - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.JobController.SubmitJob"

SubmitJobAsOperation

  • Method: google.cloud.dataproc.v1.JobController.SubmitJobAsOperation
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.clusters.use - ADMIN_WRITE
    • dataproc.jobs.create - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.JobController.SubmitJobAsOperation"

UpdateJob

  • Method: google.cloud.dataproc.v1.JobController.UpdateJob
  • Audit log type: Data access
  • Permissions:
    • dataproc.jobs.update - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.JobController.UpdateJob"

google.cloud.dataproc.v1.NodeGroupController

The following audit logs are associated with methods belonging to google.cloud.dataproc.v1.NodeGroupController.

CreateNodeGroup

  • Method: google.cloud.dataproc.v1.NodeGroupController.CreateNodeGroup
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.nodeGroups.create - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.NodeGroupController.CreateNodeGroup"

GetNodeGroup

  • Method: google.cloud.dataproc.v1.NodeGroupController.GetNodeGroup
  • Audit log type: Data access
  • Permissions:
    • dataproc.nodeGroups.get - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.NodeGroupController.GetNodeGroup"

RepairNodeGroup

  • Method: google.cloud.dataproc.v1.NodeGroupController.RepairNodeGroup
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.nodeGroups.update - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.NodeGroupController.RepairNodeGroup"

ResizeNodeGroup

  • Method: google.cloud.dataproc.v1.NodeGroupController.ResizeNodeGroup
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.nodeGroups.update - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.NodeGroupController.ResizeNodeGroup"

google.cloud.dataproc.v1.SessionController

The following audit logs are associated with methods belonging to google.cloud.dataproc.v1.SessionController.

CreateSession

  • Method: google.cloud.dataproc.v1.SessionController.CreateSession
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.sessions.create - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.SessionController.CreateSession"

DeleteSession

  • Method: google.cloud.dataproc.v1.SessionController.DeleteSession
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.sessions.delete - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.SessionController.DeleteSession"

GetSession

  • Method: google.cloud.dataproc.v1.SessionController.GetSession
  • Audit log type: Data access
  • Permissions:
    • dataproc.sessions.get - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.SessionController.GetSession"

ListSessions

  • Method: google.cloud.dataproc.v1.SessionController.ListSessions
  • Audit log type: Data access
  • Permissions:
    • dataproc.sessions.list - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.SessionController.ListSessions"

TerminateSession

  • Method: google.cloud.dataproc.v1.SessionController.TerminateSession
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.sessions.terminate - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.SessionController.TerminateSession"

google.cloud.dataproc.v1.SessionTemplateController

The following audit logs are associated with methods belonging to google.cloud.dataproc.v1.SessionTemplateController.

CreateSessionTemplate

  • Method: google.cloud.dataproc.v1.SessionTemplateController.CreateSessionTemplate
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.sessionTemplates.create - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.SessionTemplateController.CreateSessionTemplate"

DeleteSessionTemplate

  • Method: google.cloud.dataproc.v1.SessionTemplateController.DeleteSessionTemplate
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.sessionTemplates.delete - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.SessionTemplateController.DeleteSessionTemplate"

GetSessionTemplate

  • Method: google.cloud.dataproc.v1.SessionTemplateController.GetSessionTemplate
  • Audit log type: Data access
  • Permissions:
    • dataproc.sessionTemplates.get - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.SessionTemplateController.GetSessionTemplate"

ListSessionTemplates

  • Method: google.cloud.dataproc.v1.SessionTemplateController.ListSessionTemplates
  • Audit log type: Data access
  • Permissions:
    • dataproc.sessionTemplates.list - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.SessionTemplateController.ListSessionTemplates"

UpdateSessionTemplate

  • Method: google.cloud.dataproc.v1.SessionTemplateController.UpdateSessionTemplate
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.sessionTemplates.update - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.SessionTemplateController.UpdateSessionTemplate"

google.cloud.dataproc.v1.WorkflowTemplateService

The following audit logs are associated with methods belonging to google.cloud.dataproc.v1.WorkflowTemplateService.

CreateWorkflowTemplate

  • Method: google.cloud.dataproc.v1.WorkflowTemplateService.CreateWorkflowTemplate
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.workflowTemplates.create - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.WorkflowTemplateService.CreateWorkflowTemplate"

DeleteWorkflowTemplate

  • Method: google.cloud.dataproc.v1.WorkflowTemplateService.DeleteWorkflowTemplate
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.workflowTemplates.delete - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.WorkflowTemplateService.DeleteWorkflowTemplate"

GetWorkflowTemplate

  • Method: google.cloud.dataproc.v1.WorkflowTemplateService.GetWorkflowTemplate
  • Audit log type: Data access
  • Permissions:
    • dataproc.workflowTemplates.get - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.WorkflowTemplateService.GetWorkflowTemplate"

InstantiateInlineWorkflowTemplate

  • Method: google.cloud.dataproc.v1.WorkflowTemplateService.InstantiateInlineWorkflowTemplate
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.workflowTemplates.instantiateInline - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.WorkflowTemplateService.InstantiateInlineWorkflowTemplate"

InstantiateWorkflowTemplate

  • Method: google.cloud.dataproc.v1.WorkflowTemplateService.InstantiateWorkflowTemplate
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.workflowTemplates.instantiate - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.WorkflowTemplateService.InstantiateWorkflowTemplate"

ListWorkflowTemplates

  • Method: google.cloud.dataproc.v1.WorkflowTemplateService.ListWorkflowTemplates
  • Audit log type: Data access
  • Permissions:
    • dataproc.workflowTemplates.list - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.WorkflowTemplateService.ListWorkflowTemplates"

UpdateWorkflowTemplate

  • Method: google.cloud.dataproc.v1.WorkflowTemplateService.UpdateWorkflowTemplate
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.workflowTemplates.update - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1.WorkflowTemplateService.UpdateWorkflowTemplate"

google.cloud.dataproc.v1beta2.AutoscalingPolicyService

The following audit logs are associated with methods belonging to google.cloud.dataproc.v1beta2.AutoscalingPolicyService.

CreateAutoscalingPolicy

  • Method: google.cloud.dataproc.v1beta2.AutoscalingPolicyService.CreateAutoscalingPolicy
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.autoscalingPolicies.create - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.AutoscalingPolicyService.CreateAutoscalingPolicy"

DeleteAutoscalingPolicy

  • Method: google.cloud.dataproc.v1beta2.AutoscalingPolicyService.DeleteAutoscalingPolicy
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.autoscalingPolicies.delete - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.AutoscalingPolicyService.DeleteAutoscalingPolicy"

GetAutoscalingPolicy

  • Method: google.cloud.dataproc.v1beta2.AutoscalingPolicyService.GetAutoscalingPolicy
  • Audit log type: Data access
  • Permissions:
    • dataproc.autoscalingPolicies.get - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.AutoscalingPolicyService.GetAutoscalingPolicy"

UpdateAutoscalingPolicy

  • Method: google.cloud.dataproc.v1beta2.AutoscalingPolicyService.UpdateAutoscalingPolicy
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.autoscalingPolicies.update - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.AutoscalingPolicyService.UpdateAutoscalingPolicy"

google.cloud.dataproc.v1beta2.ClusterController

The following audit logs are associated with methods belonging to google.cloud.dataproc.v1beta2.ClusterController.

CreateCluster

  • Method: google.cloud.dataproc.v1beta2.ClusterController.CreateCluster
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.clusters.create - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.ClusterController.CreateCluster"

DeleteCluster

  • Method: google.cloud.dataproc.v1beta2.ClusterController.DeleteCluster
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.clusters.delete - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.ClusterController.DeleteCluster"

DiagnoseCluster

  • Method: google.cloud.dataproc.v1beta2.ClusterController.DiagnoseCluster
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.clusters.use - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.ClusterController.DiagnoseCluster"

GetCluster

  • Method: google.cloud.dataproc.v1beta2.ClusterController.GetCluster
  • Audit log type: Data access
  • Permissions:
    • dataproc.clusters.get - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.ClusterController.GetCluster"

ListClusters

  • Method: google.cloud.dataproc.v1beta2.ClusterController.ListClusters
  • Audit log type: Data access
  • Permissions:
    • dataproc.clusters.list - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.ClusterController.ListClusters"

StartCluster

  • Method: google.cloud.dataproc.v1beta2.ClusterController.StartCluster
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.clusters.start - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.ClusterController.StartCluster"

StopCluster

  • Method: google.cloud.dataproc.v1beta2.ClusterController.StopCluster
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.clusters.stop - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.ClusterController.StopCluster"

UpdateCluster

  • Method: google.cloud.dataproc.v1beta2.ClusterController.UpdateCluster
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.clusters.update - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.ClusterController.UpdateCluster"

google.cloud.dataproc.v1beta2.JobController

The following audit logs are associated with methods belonging to google.cloud.dataproc.v1beta2.JobController.

CancelJob

  • Method: google.cloud.dataproc.v1beta2.JobController.CancelJob
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.jobs.cancel - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.JobController.CancelJob"

GetJob

  • Method: google.cloud.dataproc.v1beta2.JobController.GetJob
  • Audit log type: Data access
  • Permissions:
    • dataproc.jobs.get - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.JobController.GetJob"

ListJobs

  • Method: google.cloud.dataproc.v1beta2.JobController.ListJobs
  • Audit log type: Data access
  • Permissions:
    • dataproc.jobs.list - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.JobController.ListJobs"

SubmitJob

  • Method: google.cloud.dataproc.v1beta2.JobController.SubmitJob
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.clusters.use - ADMIN_WRITE
    • dataproc.jobs.create - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.JobController.SubmitJob"

SubmitJobAsOperation

  • Method: google.cloud.dataproc.v1beta2.JobController.SubmitJobAsOperation
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.clusters.use - ADMIN_WRITE
    • dataproc.jobs.create - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.JobController.SubmitJobAsOperation"

UpdateJob

  • Method: google.cloud.dataproc.v1beta2.JobController.UpdateJob
  • Audit log type: Data access
  • Permissions:
    • dataproc.jobs.update - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.JobController.UpdateJob"

google.cloud.dataproc.v1beta2.WorkflowTemplateService

The following audit logs are associated with methods belonging to google.cloud.dataproc.v1beta2.WorkflowTemplateService.

CreateWorkflowTemplate

  • Method: google.cloud.dataproc.v1beta2.WorkflowTemplateService.CreateWorkflowTemplate
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.workflowTemplates.create - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.WorkflowTemplateService.CreateWorkflowTemplate"

DeleteWorkflowTemplate

  • Method: google.cloud.dataproc.v1beta2.WorkflowTemplateService.DeleteWorkflowTemplate
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.workflowTemplates.delete - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.WorkflowTemplateService.DeleteWorkflowTemplate"

GetWorkflowTemplate

  • Method: google.cloud.dataproc.v1beta2.WorkflowTemplateService.GetWorkflowTemplate
  • Audit log type: Data access
  • Permissions:
    • dataproc.workflowTemplates.get - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.WorkflowTemplateService.GetWorkflowTemplate"

InstantiateInlineWorkflowTemplate

  • Method: google.cloud.dataproc.v1beta2.WorkflowTemplateService.InstantiateInlineWorkflowTemplate
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.workflowTemplates.instantiateInline - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.WorkflowTemplateService.InstantiateInlineWorkflowTemplate"

InstantiateWorkflowTemplate

  • Method: google.cloud.dataproc.v1beta2.WorkflowTemplateService.InstantiateWorkflowTemplate
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.workflowTemplates.instantiate - ADMIN_WRITE
  • Method is a long-running or streaming operation: Long-running operation
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.WorkflowTemplateService.InstantiateWorkflowTemplate"

ListWorkflowTemplates

  • Method: google.cloud.dataproc.v1beta2.WorkflowTemplateService.ListWorkflowTemplates
  • Audit log type: Data access
  • Permissions:
    • dataproc.workflowTemplates.list - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.WorkflowTemplateService.ListWorkflowTemplates"

UpdateWorkflowTemplate

  • Method: google.cloud.dataproc.v1beta2.WorkflowTemplateService.UpdateWorkflowTemplate
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.workflowTemplates.update - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.cloud.dataproc.v1beta2.WorkflowTemplateService.UpdateWorkflowTemplate"

google.iam.v1.IAMPolicy

The following audit logs are associated with methods belonging to google.iam.v1.IAMPolicy.

GetIamPolicy

  • Method: google.iam.v1.IAMPolicy.GetIamPolicy
  • Audit log type: Data access
  • Permissions:
    • dataproc.jobs.getIamPolicy - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.iam.v1.IAMPolicy.GetIamPolicy"

SetIamPolicy

  • Method: google.iam.v1.IAMPolicy.SetIamPolicy
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.clusters.setIamPolicy - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.iam.v1.IAMPolicy.SetIamPolicy"

google.longrunning.Operations

The following audit logs are associated with methods belonging to google.longrunning.Operations.

CancelOperation

  • Method: google.longrunning.Operations.CancelOperation
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.batches.cancel - ADMIN_WRITE
    • dataproc.operations.cancel - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.longrunning.Operations.CancelOperation"

DeleteOperation

  • Method: google.longrunning.Operations.DeleteOperation
  • Audit log type: Admin activity
  • Permissions:
    • dataproc.operations.delete - ADMIN_WRITE
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.longrunning.Operations.DeleteOperation"

GetOperation

  • Method: google.longrunning.Operations.GetOperation
  • Audit log type: Data access
  • Permissions:
    • dataproc.operations.get - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.longrunning.Operations.GetOperation"

ListOperations

  • Method: google.longrunning.Operations.ListOperations
  • Audit log type: Data access
  • Permissions:
    • dataproc.operations.list - ADMIN_READ
  • Method is a long-running or streaming operation: No.
  • Filter for this method: protoPayload.methodName="google.longrunning.Operations.ListOperations"

Methods that don't produce audit logs

A method might not produce audit logs for one or more of the following reasons:

  • It is a high volume method involving signifcant log generation and storage costs.
  • It has low auditing value.
  • Another audit or platform log already provides method coverage.

The following methods don't produce audit logs:

  • google.cloud.dataproc.v1beta2.ClusterController.InjectCredentials