Stay organized with collections
Save and categorize content based on your preferences.
This page shows you how to resolve issues with Cloud Data Fusion upgrades.
Dataproc cluster to gets stuck in provisioning state after upgrading from 6.1
The following issue occurs when you upgrade from version 6.1 to version 6.2.0 or
later:
Network tags aren't preserved when you upgrade, causing your
Dataproc cluster to get stuck in provisioning state. This error
can happen especially when your environment has restrictive networking and
security policies.
Instead, in each updated instance, manually add your network tags to each of the
compute profiles it uses.
Add the network tags to a compute profile by following these steps:
In the Google Cloud console, go to the Cloud Data Fusion
Instances page.
Click View Instance.
Click System Admin.
Click the Configuration tab.
Expand the System Compute Profiles field.
Click Create New Profile. A page of provisioners opens.
Click Dataproc.
Enter your profile information, including the network tags.
Click Create.
After adding the tags, use the updated profile in your pipeline. The new tags
are preserved in future releases.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-03-21 UTC."],[[["This page details how to resolve issues with Cloud Data Fusion upgrades, specifically when upgrading from version 6.1 to 6.2.0 or later."],["Upgrading Cloud Data Fusion from version 6.1 can cause Dataproc clusters to get stuck in the provisioning state because network tags are not preserved."],["To resolve this issue, manually add your network tags to each of the compute profiles used by the updated instances within the Cloud Data Fusion system."],["After adding the tags to the compute profiles, ensure the updated profiles are used in your pipelines, and the new tags will be preserved in future releases."]]],[]]
