Stay organized with collections
Save and categorize content based on your preferences.
All Dataproc clusters come with the
BigQuery connector for Hadoop built in. This means
you can quickly read and write BigQuery data to and from
Dataproc.
Use Spark
See Using the BigQuery Connector with Spark
for an example on using Spark with the BigQuery connector for Hadoop.
This example should work for Dataproc clusters.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-09-01 UTC."],[[["\u003cp\u003eCloud Dataproc clusters include a built-in BigQuery connector for Hadoop, facilitating seamless data transfer between BigQuery and Cloud Dataproc.\u003c/p\u003e\n"],["\u003cp\u003eSpark users can leverage the BigQuery connector with Cloud Dataproc clusters, as demonstrated in the provided example.\u003c/p\u003e\n"],["\u003cp\u003eJava MapReduce jobs can also utilize the BigQuery connector with Cloud Dataproc clusters, with an example provided for reference.\u003c/p\u003e\n"],["\u003cp\u003eAdditional details about the BigQuery Hadoop Connector are available in its dedicated documentation.\u003c/p\u003e\n"]]],[],null,["All Dataproc clusters come with the\n[BigQuery connector for Hadoop](/hadoop/bigquery-connector) built in. This means\nyou can quickly read and write BigQuery data to and from\nDataproc.\n\nUse Spark\n\nSee [Using the BigQuery Connector with Spark](/dataproc/docs/tutorials/bigquery-connector-spark-example)\nfor an example on using Spark with the BigQuery connector for Hadoop.\nThis example should work for Dataproc clusters.\n\nUse Java MapReduce\n\nSee [Writing a MapReduce Job with the BigQuery Connector](/dataproc/docs/tutorials/bigquery-connector-mapreduce-example)\nfor an example on using Java MapReduce with the BigQuery connector for\nHadoop. This example should work for Dataproc clusters.\n\nAdditional information\n\nSee the [BigQuery Hadoop Connector](/dataproc/docs/connectors/bigquery)\ndocumentation."]]
