Tetap teratur dengan koleksi
Simpan dan kategorikan konten berdasarkan preferensi Anda.
Dokumen ini menjelaskan cara memantau dan memecahkan masalah
sesi interaktif
Serverless untuk Apache Spark menggunakan UI Spark.
UI Spark
UI Spark mengumpulkan detail eksekusi Apache Spark dari sesi interaktif Serverless for Apache Spark. Fitur Spark UI tidak dikenai biaya dan diaktifkan secara default. Data yang dikumpulkan oleh fitur UI Spark dipertahankan selama 90 hari.
Izin dan peran Identity and Access Management yang diperlukan
Izin berikut diperlukan untuk menggunakan fitur UI Spark dengan sesi interaktif:
Izin pengumpulan data: dataproc.sessions.sparkApplicationWrite. Izin ini harus diberikan ke akun layanan yang menjalankan sesi interaktif.
Peran ini disertakan dalam peran
Dataproc Worker, yang otomatis diberikan ke akun layanan default Compute Engine
yang digunakan Serverless for Apache Spark secara default. Namun, jika Anda menentukan
akun layanan kustom
untuk sesi
atau template runtime sesi,
Anda harus menambahkan izin dataproc.sessions.sparkApplicationWrite ini ke akun layanan tersebut
(biasanya, dengan memberikan peran Worker Dataproc ke akun layanan).
Izin akses UI Spark: dataproc.sessions.sparkApplicationRead. Izin ini harus diberikan kepada pengguna untuk mengakses UI Spark di konsolGoogle Cloud . Izin ini disertakan dalam peran
Dataproc Viewer, Dataproc Editor, dan Dataproc Administrator. Untuk membuka UI Spark di konsol Google Cloud , Anda harus memiliki salah satu peran ini atau memiliki peran kustom yang mencakup izin ini.
Membuka UI Spark
Halaman Spark UI tersedia di konsol Google Cloud .
Klik ID Sesi Interaktif untuk membuka halaman Detail Sesi Interaktif.
Klik Lihat UI Spark di menu atas.
Apakah link View Spark UI dinonaktifkan? Jika
izin yang diperlukan tidak diberikan,
atau jika Anda menghapus centang kotak Aktifkan UI Spark di halaman detail sesi interaktif atau menetapkan
properti spark.dataproc.appContext.enabled ke false (default: true) saat Anda
membuat sesi atau
membuat template runtime sesi,
tombol Lihat UI Spark akan dinonaktifkan.
[[["Mudah dipahami","easyToUnderstand","thumb-up"],["Memecahkan masalah saya","solvedMyProblem","thumb-up"],["Lainnya","otherUp","thumb-up"]],[["Sulit dipahami","hardToUnderstand","thumb-down"],["Informasi atau kode contoh salah","incorrectInformationOrSampleCode","thumb-down"],["Informasi/contoh yang saya butuhkan tidak ada","missingTheInformationSamplesINeed","thumb-down"],["Masalah terjemahan","translationIssue","thumb-down"],["Lainnya","otherDown","thumb-down"]],["Terakhir diperbarui pada 2025-09-04 UTC."],[[["\u003cp\u003eThe Spark UI is a free feature that collects and displays Apache Spark execution details from Dataproc Serverless interactive sessions, retaining data for 90 days, and is enabled by default.\u003c/p\u003e\n"],["\u003cp\u003eTo use the Spark UI with interactive sessions, the service account running the session needs the \u003ccode\u003edataproc.sessions.sparkApplicationWrite\u003c/code\u003e permission, and users accessing the UI need the \u003ccode\u003edataproc.sessions.sparkApplicationRead\u003c/code\u003e permission.\u003c/p\u003e\n"],["\u003cp\u003eYou can access the Spark UI by navigating to the Dataproc Interactive Sessions in the Google Cloud console, selecting an interactive session, and clicking "View Spark UI" in the top menu.\u003c/p\u003e\n"],["\u003cp\u003eThe "View Spark UI" button will be disabled if the necessary permissions are missing or if the Spark UI feature has been disabled during session creation by unchecking the "Enable Spark UI" checkbox or setting the \u003ccode\u003espark.dataproc.appContext.enabled\u003c/code\u003e property to false.\u003c/p\u003e\n"]]],[],null,["# Monitor and troubleshoot interactive sessions\n\nThis document describes how to monitor and troubleshoot Serverless for Apache Spark [interactive sessions](/dataproc-serverless/docs/quickstarts/jupyterlab-sessions) using the Spark UI.\n\n\u003cbr /\u003e\n\nSpark UI\n--------\n\nThe Spark UI collects Apache Spark execution details from Serverless for Apache Spark\ninteractive sessions. There is no charge for the Spark UI feature,\nwhich is enabled by default. Data collected by the Spark UI feature is retained\nfor 90 days.\n| **Note:** The Spark UI also collects and displays execution details from Serverless for Apache Spark batch workloads. See [Monitor and troubleshoot batch workloads](/dataproc-serverless/docs/guides/monitor-troubleshoot-batches) for more information.\n\n### Required Identity and Access Management permissions and roles\n\nThe following permissions are required to use the Spark UI feature with interactive\nsessions:\n\n- Data collection permission: `dataproc.sessions.sparkApplicationWrite`. This\n permission must be granted to the service account that runs interactive sessions.\n It is included in the\n [`Dataproc Worker`](/iam/docs/understanding-roles#dataproc.worker)\n role, which is automatically granted to the Compute Engine default service account\n that Serverless for Apache Spark uses by default. However, if you specify a\n [custom service account](/dataproc-serverless/docs/concepts/service-account)\n for your [session](/sdk/gcloud/reference/beta/dataproc/sessions/create#--service-account)\n or [session runtime template](/dataproc-serverless/docs/quickstarts/jupyterlab-sessions#dataproc_create_serverless_runtime_template_yaml-Complex%20YAML),\n you must add this `dataproc.sessions.sparkApplicationWrite` permission to that service account\n (typically, by granting the service account the Dataproc `Worker` role).\n\n- Spark UI access permission: `dataproc.sessions.sparkApplicationRead`. This\n permission must be granted to a user to access the Spark UI in the\n Google Cloud console. It is included in the\n [`Dataproc Viewer`, `Dataproc Editor` and `Dataproc Administrator`](/dataproc-serverless/docs/concepts/iam#roles)\n roles. To open the Spark UI in the Google Cloud console, you must have one of\n these roles or have a custom role that includes this permission.\n\n### Open the Spark UI\n\nThe Spark UI page is available in the Google Cloud console.\n\n1. [Go to Dataproc Interactive Sessions](https://console.cloud.google.com/dataproc/interactive)\n\n2. Click an **Interactive Session ID** to open the **Interactive Session Details** page.\n3. Click **View Spark UI** in the top menu.\n\n**Is the *View Spark UI* link disabled?** If a\n[required permission is not granted](#required-iam-permissions-and-roles),\nor if you clear the **Enable Spark UI** checkbox on the interactive session details page or set\nthe `spark.dataproc.appContext.enabled` property to `false` (default: `true`) when you\n[create a session](/sdk/gcloud/reference/beta/dataproc/sessions/create/spark#--property) or\n[create a session runtime template](/dataproc-serverless/docs/quickstarts/jupyterlab-sessions#create_a_serverless_runtime_template),\nthe **View Spark UI** button will be disabled."]]
