Stay organized with collections
Save and categorize content based on your preferences.
Sharpen your skills as Data Engineer
Looking to learn new skills, explore the latest trends, or prepare for your next
career opportunity as a Data Engineer? Our essential guide has you covered, with
$300 in free Google Cloud credits
to get you started.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],[],[[["\u003cp\u003eThis guide provides resources for Data Engineers to learn new skills, explore trends, and advance their careers, all with $300 in free Google Cloud credits to get started.\u003c/p\u003e\n"],["\u003cp\u003eYou can kickstart your cloud journey with practical guides, tutorials, and interactive walkthroughs on big data and analytics, including building a data warehouse and analytics lakehouse.\u003c/p\u003e\n"],["\u003cp\u003eExplore generative AI by creating machine learning models, generating text, and building gen AI applications using GitHub code and BigQuery DataFrames.\u003c/p\u003e\n"],["\u003cp\u003eAccess open-source resources for Beam, Hadoop, and Spark, including Dataflow and Dataproc templates and pipelines, and use Beam Playground to test transforms.\u003c/p\u003e\n"],["\u003cp\u003eFormalize your learning through Google Cloud courses and certifications, such as on-demand courses, labs, and skill badges and take advantage of $300 in free credits and 20+ always-free products on Google Cloud.\u003c/p\u003e\n"]]],[],null,["# Google Cloud Data Engineer persona\n\nSharpen your skills as Data Engineer\n====================================\n\n\nLooking to learn new skills, explore the latest trends, or prepare for your next\ncareer opportunity as a Data Engineer? \nOur essential guide has you covered, with\n[$300 in free Google Cloud credits](/free) to get you started.\n[Get started on Google Cloud](/free) \n\nStart in the cloud\n------------------\n\n\nKickstart your cloud journey with practical how-to guides, quickstarts, and tutorials. \n[Guide\nDive into training\nExplore these quickstarts, tutorials, and interactive walkthroughs on big data and analytics.](https://www.cloudskillsboost.google/paths/16?utm_source=cgc&utm_medium=website&utm_campaign=cgclearnbyrole&utm_content=dataeng) \n[Deploy solution\nBuild a data warehouse\nSet up a data warehouse using data loaded and transformed in BigQuery. Analyze results using dashboards in Looker Studio.](/solutions/data-warehouse?hl=en) \n[Deploy solution\nBuild an analytics lakehouse\nCreate an analytics lakehouse that can be used for analytic queries, machine learning, and visualization.](/solutions/analytics-lakehouse?hl=en)\n\nPut generative AI to work\n-------------------------\n\n\nExpand your skill set and build whatever you want --- with a little help from gen AI. \nExpand all \n\n#### Create a machine learning model\n\n\nLearn how to use BigQuery ML to create and execute machine learning models in\nBigQuery by using SQL queries.\n[Start tutorial](/bigquery/docs/create-machine-learning-model)\n\n#### Use gen AI to generate text\n\n\nLearn how to generate text by creating a remote model based on the text-bison\nlarge language model.\n[Learn more](/bigquery/docs/generate-text-tutorial)\n\n#### Build gen AI apps for search, speech, vision, and more\n\n\nDive into GitHub code and resources for gen AI workflows on Google Cloud.\n[Learn more](https://github.com/GoogleCloudPlatform/generative-ai?utm_source=vib&utm_medium=email&utm_campaign=FY23-Q1-global-PROD82-emailnurture-dl-data_engineer_developer_campaigns_mc&utm_content=gemini)\n\n#### Get started with BigQuery DataFrames\n\n\nUse familiar Pythonic APIs (pandas, scikit-learn) for data transformation and ML\nat BigQuery scale.\n[Learn more](https://github.com/googleapis/python-bigquery-dataframes/blob/main/notebooks/getting_started/getting_started_bq_dataframes.ipynb) \n[Ready to get started?](https://console.cloud.google.com/welcome/new?pli=1)\n\nTap into open source\n--------------------\n\n\nExplore open source playgrounds, projects, and repositories for Beam, Hadoop, Spark, and\nmore. \nExpand all \n\n#### Get started with open source on Google Cloud\n\n\nExplore, access, and add Google Cloud Platform repositories on GitHub.\n[Visit GitHub](https://github.com/GoogleCloudPlatform)\n\n#### Get solving with Dataflow templates\n\n\nSave time on in-cloud data tasks with these Dataflow templates from Google on\nGitHub.\n[Visit GitHub](https://github.com/GoogleCloudPlatform/DataflowTemplates?utm_source=vib&utm_medium=email&utm_campaign=FY23-Q1-global-PROD82-emailnurture-dl-data_engineer_developer_campaigns_mc&utm_content=dataflow)\n\n#### Use Dataproc templates and pipelines\n\n\nSolve simple in-cloud data tasks with these Dataproc templates and pipelines from\nGoogle on GitHub.\n[Visit GitHub](https://github.com/GoogleCloudPlatform/dataproc-templates?utm_source=vib&utm_medium=email&utm_campaign=FY23-Q1-global-PROD82-emailnurture-dl-data_engineer_developer_campaigns_mc&utm_content=dataproc)\n\n#### Test your skills with open source SDKs\n\n\nUse Beam Playground to try out Beam transforms and examples without needing to\ninstall Apache Beam in your environment.\n[Visit Beam Playground](https://play.beam.apache.org/?path=SDK_JAVA_MinimalWordCount&sdk=java%3Futm_source%3Dvib) \n\nFormalize your learning\n-----------------------\n\n\nProve your skills with these Data Engineering courses and certifications. \n\nWarm up\n\nGain hands-on experience using Google Cloud technologies with a curated collection of on-demand courses, labs, and skill badges. \n[Visit Google Cloud Skills Boost\n*arrow_forward*](https://www.cloudskillsboost.google/paths/16) \n\nGet certified\n\nShowcase your expertise as a professional Data Engineer with a Google Cloud certification. \n[Prepare for the exam\n*arrow_forward*](https://www.googlecloudcommunity.com/gc/Community-Blogs/Your-guide-to-preparing-for-the-Google-Cloud-Professional-Data/ba-p/543105) [Get certified\n*arrow_forward*](/learn/certification/data-engineer) \n\nGo the extra mile\n\nAccess hands-on training, practical tips, and free workshops at Beam College, and test your skills with these coding exercises. \n[Enroll in beam college\n*arrow_forward*](https://beamcollege.dev/) [Start Apache Beam Katas\n*arrow_forward*](https://beam.apache.org/blog/beam-kata-release/)\n\nNot sure where to start?\n------------------------\n\n\nA great place for Data Engineers to start is by building in the cloud. \n\n##### Build a data warehouse\n\n\nSet up a data warehouse using data loaded and transformed in BigQuery. Analyze\nresults using dashboards in Looker Studio. \n[Learn more\n*arrow_forward*](/solutions/data-warehouse?hl=en) \n\n##### Build an analytics lakehouse\n\n\nCreate an analytics lakehouse that can be used for analytic queries, machine\nlearning, and visualization. \n[Learn more\n*arrow_forward*](/solutions/analytics-lakehouse?hl=en)\n\n##### Enjoy $300 in free credits\n\n\nDon't forget to take advantage of $300 in free credits and 20+ always-free products\nwhen running workloads on Google Cloud. \n[Sign up](https://console.cloud.google.com/getting-started)"]]
