Conferir registros de pipeline avançados no Cloud Logging
Mantenha tudo organizado com as coleções
Salve e categorize o conteúdo com base nas suas preferências.
Nesta página, descrevemos como ativar o Cloud Logging para seus clusters do Dataproc do Cloud Data Fusion e acessar registros de pipeline avançados.
Ativar o Cloud Logging para Dataproc
Para conferir problemas de pipeline e cluster no Cloud Logging, ative os registros avançados
em instâncias novas ou atuais do Cloud Data Fusion. Para ativar os registros avançados em
uma instância atual, faça o seguinte:
No Google Cloud console, acesse a página Instâncias do Cloud Data Fusion.
Na seção Monitoramento e registro avançados, para o Dataproc Cloud Logging, clique em editEditar.
Na janela Cloud Logging, marque a caixa de seleção Ativar o Cloud Logging.
Clique em Salvar.
Ver registros
Cada execução do pipeline do Cloud Data Fusion recebe um RunID exclusivo.
Depois de implantar e executar o pipeline, encontre o RunID dele. Em seguida, no Logging, use o RunID para ver os registros do pipeline.
Conseguir o RunID do pipeline
Acesse sua instância:
No console Google Cloud , acesse a página do Cloud Data Fusion.
Para abrir a instância no Cloud Data Fusion Studio, clique em Instâncias e em Ver instância.
No menu suspenso Todos os recursos, selecione Cluster do Cloud Dataproc >cdap-PIPELINE_NAME-YOUR_RUNID.
Opcional: filtrar os registros
Use os menus de filtro para filtrar os registros. É possível filtrar por vários níveis de gravidade
de registro
ou por componentes, como datafusion-pipeline-logs.
[[["Fácil de entender","easyToUnderstand","thumb-up"],["Meu problema foi resolvido","solvedMyProblem","thumb-up"],["Outro","otherUp","thumb-up"]],[["Difícil de entender","hardToUnderstand","thumb-down"],["Informações incorretas ou exemplo de código","incorrectInformationOrSampleCode","thumb-down"],["Não contém as informações/amostras de que eu preciso","missingTheInformationSamplesINeed","thumb-down"],["Problema na tradução","translationIssue","thumb-down"],["Outro","otherDown","thumb-down"]],["Última atualização 2025-08-12 UTC."],[[["\u003cp\u003eThis guide explains how to enable Cloud Logging for Cloud Data Fusion Dataproc clusters, allowing you to view pipeline and cluster logs.\u003c/p\u003e\n"],["\u003cp\u003eYou can enable advanced logging on new or existing Cloud Data Fusion instances by editing the "Dataproc Cloud Logging" settings in the instance details.\u003c/p\u003e\n"],["\u003cp\u003eEach pipeline run is assigned a unique RunID, which is used to locate specific pipeline logs within Cloud Logging.\u003c/p\u003e\n"],["\u003cp\u003eTo view logs, you must go to the Cloud Logging Logs Explorer, select the correct Dataproc Cluster resource, and then can filter it down by severity or components.\u003c/p\u003e\n"],["\u003cp\u003eLogs can be downloaded directly from the Cloud Logging interface if needed.\u003c/p\u003e\n"]]],[],null,["# View advanced pipeline logs in Cloud Logging\n\nThis page describes how to enable Cloud Logging for your\nCloud Data Fusion Dataproc clusters and access advanced\npipeline logs.\n\nEnable Dataproc Cloud Logging\n-----------------------------\n\nTo view pipeline and cluster issues in Cloud Logging, enable advanced logs\nin new or existing Cloud Data Fusion instances. To enable advanced logs in\nan existing instance, do the following:\n\n1. In the Google Cloud console, go to the Cloud Data Fusion\n **Instances** page.\n\n [Go to Instances](https://console.cloud.google.com/data-fusion/locations/-/instances)\n2. Click the instance name.\n\n3. In the **Advanced monitoring and logging** section, for\n **Dataproc Cloud Logging** , click\n edit **Edit**.\n\n4. In the **Cloud Logging** window, select the\n **Enable Cloud Logging** checkbox.\n\n5. Click **Save**.\n\nView logs\n---------\n\nEvery Cloud Data Fusion pipeline run is assigned a unique `RunID`.\nAfter you deploy and run your pipeline, find its `RunID`. Then, in\nLogging, use the `RunID` to view your pipeline\nlogs.\n\n### Get the pipeline's RunID\n\n1. Go to your instance:\n 1. In the Google Cloud console, go to the Cloud Data Fusion page.\n\n 2. To open the instance in the Cloud Data Fusion Studio,\n click **Instances** , and then click **View instance**.\n\n [Go to Instances](https://console.cloud.google.com/data-fusion/locations/-/instances)\n2. Click **List**.\n3. Click the pipeline for which you want to get the Run ID.\n4. Click **Summary**.\n5. In the **Run history** section, click **Table**.\n6. To copy the Run ID, right-click the **RunID** , and click **Copy**.\n\n### View the logs in Logs Explorer\n\n1. In the Google Cloud console, go to the\n **Cloud Logging \\\u003e Logs Explorer** page:\n\n [Go Logs Explorer](https://console.cloud.google.com/logs/query)\n2. In the **All resources** drop-down,\n select\n **Cloud Dataproc Cluster \\\u003e **`cdap-`\u003cvar translate=\"no\"\u003ePIPELINE_NAME\u003c/var\u003e`-`\u003cvar translate=\"no\"\u003eYOUR_RUNID\u003c/var\u003e****.\n\n### Optional: Filter the logs\n\nUse the filter menus to filter your logs. You can filter by various log\nseverity levels\nor by components such as `datafusion-pipeline-logs`.\n\n### Optional: Download the logs\n\nClick **Download logs**.\n\nFor more information, see\n[downloading log entries](/logging/docs/view/logs-explorer-interface#download_logs).\n\nWhat's next\n-----------\n\n- Learn how to [view audit logs](/data-fusion/docs/how-to/audit-logging).\n- Learn how to [view pipeline logs from the Cloud Data Fusion Pipeline Studio](/data-fusion/docs/how-to/view-and-download-pipeline-logs)."]]
