Tetap teratur dengan koleksi
Simpan dan kategorikan konten berdasarkan preferensi Anda.
Halaman ini menjelaskan cara mengaktifkan Cloud Logging untuk cluster Dataproc Cloud Data Fusion dan mengakses log pipeline lanjutan.
Mengaktifkan Cloud Logging Dataproc
Untuk melihat masalah pipeline dan cluster di Cloud Logging, aktifkan log lanjutan di instance Cloud Data Fusion baru atau yang sudah ada. Untuk mengaktifkan log lanjutan di instance yang ada, lakukan tindakan berikut:
Di konsol Google Cloud , buka halaman Instance Cloud Data Fusion.
Di bagian Pemantauan dan logging lanjutan, untuk
Dataproc Cloud Logging, klik
editEdit.
Di jendela Cloud Logging, centang kotak Enable Cloud Logging.
Klik Simpan.
Melihat log
Setiap operasi pipeline Cloud Data Fusion diberi RunID unik.
Setelah men-deploy dan menjalankan pipeline, temukan RunID-nya. Kemudian, di logging, gunakan RunID untuk melihat log pipeline Anda.
Mendapatkan RunID pipeline
Buka instance Anda:
Di konsol Google Cloud , buka halaman Cloud Data Fusion.
Untuk membuka instance di Cloud Data Fusion Studio,
klik Instance, lalu klik View instance.
Di menu drop-down All resources, pilih Cloud Dataproc Cluster >cdap-PIPELINE_NAME-YOUR_RUNID.
Opsional: Memfilter log
Gunakan menu filter untuk memfilter log Anda. Anda dapat memfilter menurut berbagai tingkat keparahan log atau menurut komponen seperti datafusion-pipeline-logs.
[[["Mudah dipahami","easyToUnderstand","thumb-up"],["Memecahkan masalah saya","solvedMyProblem","thumb-up"],["Lainnya","otherUp","thumb-up"]],[["Sulit dipahami","hardToUnderstand","thumb-down"],["Informasi atau kode contoh salah","incorrectInformationOrSampleCode","thumb-down"],["Informasi/contoh yang saya butuhkan tidak ada","missingTheInformationSamplesINeed","thumb-down"],["Masalah terjemahan","translationIssue","thumb-down"],["Lainnya","otherDown","thumb-down"]],["Terakhir diperbarui pada 2025-08-12 UTC."],[[["\u003cp\u003eThis guide explains how to enable Cloud Logging for Cloud Data Fusion Dataproc clusters, allowing you to view pipeline and cluster logs.\u003c/p\u003e\n"],["\u003cp\u003eYou can enable advanced logging on new or existing Cloud Data Fusion instances by editing the "Dataproc Cloud Logging" settings in the instance details.\u003c/p\u003e\n"],["\u003cp\u003eEach pipeline run is assigned a unique RunID, which is used to locate specific pipeline logs within Cloud Logging.\u003c/p\u003e\n"],["\u003cp\u003eTo view logs, you must go to the Cloud Logging Logs Explorer, select the correct Dataproc Cluster resource, and then can filter it down by severity or components.\u003c/p\u003e\n"],["\u003cp\u003eLogs can be downloaded directly from the Cloud Logging interface if needed.\u003c/p\u003e\n"]]],[],null,["# View advanced pipeline logs in Cloud Logging\n\nThis page describes how to enable Cloud Logging for your\nCloud Data Fusion Dataproc clusters and access advanced\npipeline logs.\n\nEnable Dataproc Cloud Logging\n-----------------------------\n\nTo view pipeline and cluster issues in Cloud Logging, enable advanced logs\nin new or existing Cloud Data Fusion instances. To enable advanced logs in\nan existing instance, do the following:\n\n1. In the Google Cloud console, go to the Cloud Data Fusion\n **Instances** page.\n\n [Go to Instances](https://console.cloud.google.com/data-fusion/locations/-/instances)\n2. Click the instance name.\n\n3. In the **Advanced monitoring and logging** section, for\n **Dataproc Cloud Logging** , click\n edit **Edit**.\n\n4. In the **Cloud Logging** window, select the\n **Enable Cloud Logging** checkbox.\n\n5. Click **Save**.\n\nView logs\n---------\n\nEvery Cloud Data Fusion pipeline run is assigned a unique `RunID`.\nAfter you deploy and run your pipeline, find its `RunID`. Then, in\nLogging, use the `RunID` to view your pipeline\nlogs.\n\n### Get the pipeline's RunID\n\n1. Go to your instance:\n 1. In the Google Cloud console, go to the Cloud Data Fusion page.\n\n 2. To open the instance in the Cloud Data Fusion Studio,\n click **Instances** , and then click **View instance**.\n\n [Go to Instances](https://console.cloud.google.com/data-fusion/locations/-/instances)\n2. Click **List**.\n3. Click the pipeline for which you want to get the Run ID.\n4. Click **Summary**.\n5. In the **Run history** section, click **Table**.\n6. To copy the Run ID, right-click the **RunID** , and click **Copy**.\n\n### View the logs in Logs Explorer\n\n1. In the Google Cloud console, go to the\n **Cloud Logging \\\u003e Logs Explorer** page:\n\n [Go Logs Explorer](https://console.cloud.google.com/logs/query)\n2. In the **All resources** drop-down,\n select\n **Cloud Dataproc Cluster \\\u003e **`cdap-`\u003cvar translate=\"no\"\u003ePIPELINE_NAME\u003c/var\u003e`-`\u003cvar translate=\"no\"\u003eYOUR_RUNID\u003c/var\u003e****.\n\n### Optional: Filter the logs\n\nUse the filter menus to filter your logs. You can filter by various log\nseverity levels\nor by components such as `datafusion-pipeline-logs`.\n\n### Optional: Download the logs\n\nClick **Download logs**.\n\nFor more information, see\n[downloading log entries](/logging/docs/view/logs-explorer-interface#download_logs).\n\nWhat's next\n-----------\n\n- Learn how to [view audit logs](/data-fusion/docs/how-to/audit-logging).\n- Learn how to [view pipeline logs from the Cloud Data Fusion Pipeline Studio](/data-fusion/docs/how-to/view-and-download-pipeline-logs)."]]
