Google Cloud Serverless for Apache Spark documentation
Use Serverless for Apache Spark to run Spark batch workloads without provisioning
and managing your own cluster. Specify workload parameters, and then submit the
workload to the Serverless for Apache Spark service. The service will run the
workload on a managed compute infrastructure, autoscaling resources as needed.
Serverless for Apache Spark charges apply only to the time when the workload is
executing.
Learn more
Start your proof of concept with $300 in free credit
-
Get access to Gemini 2.0 Flash Thinking
-
Free monthly usage of popular products, including AI APIs and BigQuery
-
No automatic charges, no commitment
Keep exploring with 20+ always-free products
Access 20+ free products for common use cases, including AI APIs, VMs, data warehouses,
and more.
Training
Training and tutorials
Serverless for Apache Spark Quickstart Interactive Tutorial
Interactive tutorial for getting started with Serverless for Apache Spark.
Use case
Use cases
Dataproc Templates on GitHub
Serverless for Apache Spark ready-to-use, config-driven Spark templates.
Use case
Use cases
Serverless for Apache Spark Labs on GitHub
Serverless for Apache Spark hands-on labs built around common use cases.
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2025-08-25 UTC.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-08-25 UTC."],[[["\u003cp\u003eDataproc Serverless allows you to run Spark batch workloads without the need to provision or manage your own clusters.\u003c/p\u003e\n"],["\u003cp\u003eThe service runs workloads on managed infrastructure, automatically scaling resources as needed.\u003c/p\u003e\n"],["\u003cp\u003eYou are only charged for the time your workload is actively executing with Dataproc Serverless.\u003c/p\u003e\n"],["\u003cp\u003eDataproc Serverless offers a variety of resources, including guides, REST/RPC APIs, pricing details, and release notes to facilitate your work.\u003c/p\u003e\n"]]],[],null,["# Google Cloud Serverless for Apache Spark documentation\n======================================================\n\n[Read product documentation](/dataproc-serverless/docs/overview) [Dataproc](/dataproc/docs \"View this page for Dataproc\") \\| Serverless for Apache Spark \\| [Dataproc Metastore](/dataproc-metastore/docs \"View this page for Dataproc Metastore\")\n\n\nUse Serverless for Apache Spark to run Spark batch workloads without provisioning\nand managing your own cluster. Specify workload parameters, and then submit the\nworkload to the Serverless for Apache Spark service. The service will run the\nworkload on a managed compute infrastructure, autoscaling resources as needed.\nServerless for Apache Spark charges apply only to the time when the workload is\nexecuting.\n[Learn more](/dataproc-serverless/docs/overview)\n[Get started for free](https://console.cloud.google.com/freetrial) \n\n#### Start your proof of concept with $300 in free credit\n\n- Get access to Gemini 2.0 Flash Thinking\n- Free monthly usage of popular products, including AI APIs and BigQuery\n- No automatic charges, no commitment \n[View free product offers](/free/docs/free-cloud-features#free-tier) \n\n#### Keep exploring with 20+ always-free products\n\n\nAccess 20+ free products for common use cases, including AI APIs, VMs, data warehouses,\nand more.\n\nDocumentation resources\n-----------------------\n\nFind quickstarts and guides, review key references, and get help with common issues. \nformat_list_numbered\n\n### Guides\n\n-\n\n [What is Serverless for Apache Spark?](/dataproc-serverless/docs/overview)\n\n-\n\n [Run an Apache Spark batch workload](/dataproc-serverless/docs/quickstarts/spark-batch)\n\n-\n\n [Use the BigQuery connector with Serverless for Apache Spark](/dataproc-serverless/docs/guides/bigquery-connector-spark-example)\n\n-\n\n [Use custom containers with Serverless for Apache Spark](/dataproc-serverless/docs/guides/custom-containers)\n\nfind_in_page\n\n### Reference\n\n-\n\n [REST API](/dataproc-serverless/docs/reference/rest/v1/projects.locations.batches)\n\n-\n\n [RPC API](/dataproc-serverless/docs/reference/rpc#google.cloud.dataproc.v1.batchcontroller)\n\n-\n\n [Serverless for Apache Spark \\& Cloud SDK](/dataproc-serverless/docs/gcloud)\n\ninfo\n\n### Resources\n\n-\n\n [Serverless for Apache Spark Pricing](/dataproc-serverless/pricing)\n\n-\n\n [Serverless for Apache Spark Quotas](/dataproc-serverless/quotas)\n\n-\n\n [Release notes](/dataproc-serverless/docs/release-notes)\n\n-\n\n [Get support](/dataproc-serverless/docs/support/getting-support)\n\n- \n\nRelated resources\n-----------------\n\nTraining and tutorials \nUse cases \nExplore self-paced training, use cases, reference architectures, and code samples with examples of how to use and connect Google Cloud services. Training \nTraining and tutorials\n\n### Serverless for Apache Spark Quickstart Interactive Tutorial\n\n\nInteractive tutorial for getting started with Serverless for Apache Spark.\n\n\n[Learn more](https://console.cloud.google.com/?walkthrough_id=dataproc--dataproc_serverless_quickstart) \nUse case \nUse cases\n\n### Dataproc Templates on GitHub\n\n\nServerless for Apache Spark ready-to-use, config-driven Spark templates.\n\n\n[Learn more](https://github.com/GoogleCloudPlatform/dataproc-templates/blob/main/README.md) \nUse case \nUse cases\n\n### Serverless for Apache Spark Labs on GitHub\n\n\nServerless for Apache Spark hands-on labs built around common use cases.\n\n\n[Learn more](https://github.com/GoogleCloudPlatform/serverless-spark-workshop)"]]