Stay organized with collections
Save and categorize content based on your preferences.
This document describes how to monitor and troubleshoot Serverless for Apache Spark
interactive sessions
using the Spark UI.
Spark UI
The Spark UI collects Apache Spark execution details from Serverless for Apache Spark
interactive sessions. There is no charge for the Spark UI feature,
which is enabled by default. Data collected by the Spark UI feature is retained
for 90 days.
Required Identity and Access Management permissions and roles
The following permissions are required to use the Spark UI feature with interactive
sessions:
Data collection permission: dataproc.sessions.sparkApplicationWrite. This
permission must be granted to the service account that runs interactive sessions.
It is included in the
Dataproc Worker
role, which is automatically granted to the Compute Engine default service account
that Serverless for Apache Spark uses by default. However, if you specify a
custom service account
for your session
or session runtime template,
you must add this dataproc.sessions.sparkApplicationWrite permission to that service account
(typically, by granting the service account the Dataproc Worker role).
Spark UI access permission: dataproc.sessions.sparkApplicationRead. This
permission must be granted to a user to access the Spark UI in the
Google Cloud console. It is included in the
Dataproc Viewer, Dataproc Editor and Dataproc Administrator
roles. To open the Spark UI in the Google Cloud console, you must have one of
these roles or have a custom role that includes this permission.
Open the Spark UI
The Spark UI page is available in the Google Cloud console.
Click an Interactive Session ID to open the Interactive Session Details page.
Click View Spark UI in the top menu.
Is the View Spark UI link disabled? If a
required permission is not granted,
or if you clear the Enable Spark UI checkbox on the interactive session details page or set
the spark.dataproc.appContext.enabled property to false (default: true) when you
create a session or
create a session runtime template,
the View Spark UI button will be disabled.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-08-01 UTC."],[[["The Spark UI is a free feature that collects and displays Apache Spark execution details from Dataproc Serverless interactive sessions, retaining data for 90 days, and is enabled by default."],["To use the Spark UI with interactive sessions, the service account running the session needs the `dataproc.sessions.sparkApplicationWrite` permission, and users accessing the UI need the `dataproc.sessions.sparkApplicationRead` permission."],["You can access the Spark UI by navigating to the Dataproc Interactive Sessions in the Google Cloud console, selecting an interactive session, and clicking \"View Spark UI\" in the top menu."],["The \"View Spark UI\" button will be disabled if the necessary permissions are missing or if the Spark UI feature has been disabled during session creation by unchecking the \"Enable Spark UI\" checkbox or setting the `spark.dataproc.appContext.enabled` property to false."]]],[]]
