2.3.x release versions

Component 2.3.3-debian12/-ubuntu22/-rocky9
2025/06/09		 2.3.2-debian12/-ubuntu22/-rocky9
2025/06/09		 2.3.1-debian12/-ubuntu22/-rocky9
2025/06/09		 2.3.0-debian12/-ubuntu22/-rocky9
2025/06/09
Apache Atlas
initialization action		 2.2.0 2.2.0 2.2.0 2.2.0
Apache Flink
optional component		 1.17.0 1.17.0 1.17.0 1.17.0
Apache Hadoop
installed		 3.3.6 3.3.6 3.3.6 3.3.6
Apache Hive
installed		 3.1.3 3.1.3 3.1.3 3.1.3
Apache Hive WebHCat
optional component		 3.1.3 3.1.3 3.1.3 3.1.3
Apache Hudi
optional component		 0.15.0 0.15.0 0.15.0 0.15.0
Apache Iceberg
optional component		 1.6.1 1.6.1 1.6.1 1.6.1
Apache Kafka
initialization action		 3.1.0 3.1.0 3.1.0 3.1.0
Apache Pig
optional component		 0.18.0-SNAPSHOT 0.18.0-SNAPSHOT 0.18.0-SNAPSHOT 0.18.0-SNAPSHOT
Apache Spark
installed		 3.5.3 3.5.3 3.5.3 3.5.3
Apache Sqoop
initialization action 		1.5.0-SNAPSHOT 1.5.0-SNAPSHOT 1.5.0-SNAPSHOT 1.5.0-SNAPSHOT
Apache Tez
installed		 0.10.2 0.10.2 0.10.2 0.10.2
BigQuery Connector
installed		 0.42.3 0.42.0 0.42.0 0.42.0
Cloud Storage Connector
installed		 3.1.0 3.1.0 3.1.0 3.1.0
Conscrypt
installed		 2.5.2 2.5.2 2.5.2 2.5.2
Delta Lake
optional component		 3.2.0 3.2.0 3.2.0 3.2.0
Docker
optional component		 28.1 28.1 28.1 28.1
Hue
initialization action		 4.11.0 4.11.0 4.11.0 4.11.0
Java
installed		 11 11 11 11
JupyterLab Notebook
optional component		 3.6 3.6 3.6 3.6
Oozie
initialization action		 5.2.1 5.2.1 5.2.1 5.2.1
Python
installed		 micromamba 2.0.5 with Python 3.11 micromamba 2.0.5 with Python 3.11 micromamba 2.0.5 with Python 3.11 micromamba 2.0.5 with Python 3.11
R
installed		 R 4.3 R 4.3 R 4.3 R 4.3
Ranger
optional component		 2.4.0 2.4.0 2.4.0 2.4.0
Scala
installed		 2.12.18 2.12.18 2.12.18 2.12.18
Solr
optional component		 9.4.1 9.4.1 9.4.1 9.4.1
Trino
optional component		 432 432 432 432
Zeppelin Notebook
optional component		 0.10.1 0.10.1 0.10.1 0.10.1
Zookeeper
optional component		 3.9.3 3.9.3 3.9.3 3.9.3

Important changes in 2.3:

  • Version 2.3 is a lightweight image that contains only core components, reducing exposure to Common Vulnerabilities and Exposures (CVEs). For higher security compliance requirements, use the image version 2.3or later, when creating a Dataproc cluster.

  • If you choose to install optional components when creating a Dataproc cluster with 2.3 image, they will be downloaded and installed during cluster creation. This might increase the cluster startup time. To avoid this delay, you can create a custom image with the optional components pre-installed. This is achieved by running generate_custom_image.py with the --optional-components flag.

Notes:

  • The following are the optional components in 2.3 images:

    • Apache Flink
    • Apache Hive WebHCat
    • Apache Hudi
    • Apache Iceberg
    • Apache Pig
    • Delta Lake
    • Docker
    • JupyterLab Notebook
    • Ranger
    • Solr
    • Zeppelin Notebook
    • Zookeeper

  • yarn.nodemanager.recovery.enabled and HDFS Audit Logging are enabled by default in 2.3 images.

  • micromamba, instead of conda in previous image versions, is installed as part of the Python installation.

  • Docker and Zeppelin installation issues:

    • Installation fails if the cluster has no public internet access. As a workaround, create a cluster that uses a custom image with optional components pre-installed. You can do this by running generate_custom_image.py with the --optional-components flag.
    • Installation can fail if the cluster is pinned to an older sub-minor image version: Packages are installed on demand from public OSS repositories, and a package might not be available upstream to support the installation. As a workaround, create a cluster that uses a custom image with optional components pre-installed in the custom image. To do this, run generate_custom_image.py with the --optional-components flag.