Serverlose Spark-Laufzeitversionen in Dataproc

Spark-Laufzeitversion 2.2

Komponente 2.2.1
2024/04/04		 2.2.0
2024/03/27
 2.2.0-RC15
2024/03/20		 2.2.0-RC14
2024/03/14		 2.2.0-RC13
2024/03/07
Apache Spark 3.5.1 3.5.1 3.5.0 3.5.0 3.5.0
Cloud Storage-Connector 3.0.0 3.0.0 3.0.0 3.0.0 3.0.0
BigQuery-Connector 0.36.1 0.36.1 0.35.0 0.35.0 0.35.0
Java 17 17 17 17 17
Conda 24,10 24,10 23,11 23,11 23,11
Python 3,12 3,12 3,12 3,12 3,12
R 4,30 4,30 4,30 4,30 4,30
Scala 2,13 2,13 2,13 2,13 2,13

Spark-Laufzeitversion 2.1

Komponente 2.1.44
2024/04/04		 2.1.43
2024/03/27
 2.1.42
2024/03/20		 2.1.41
2024/03/14		 2.1.40
2024/03/07
Apache Spark 3.4.0 3.4.0 3.4.0 3.4.0 3.4.0
Cloud Storage-Connector 2.2.20 2.2.20 2.2.20 2.2.20 2.2.20
BigQuery-Connector 0.28.1 0.28.1 0.28.1 0.28.1 0.28.1
Java 17 17 17 17 17
Conda 23,30 23,30 23,30 23,30 23,30
Python 3,11 3,11 3,11 3,11 3,11
R 4.2 4.2 4.2 4.2 4.2
Scala 2,13 2,13 2,13 2,13 2,13

Spark-Laufzeitversion 2.0

Komponente 2.0.65
2024/04/04		 2.0.64
2024/03/27
 2.0.63
2024/03/20		 2.0.62
2024/03/14		 2.0.61
2024/03/07
Apache Spark 3.3.4 3.3.4 3.3.4 3.3.2 3.3.2
Cloud Storage-Connector 2.2.20 2.2.20 2.2.20 2.2.20 2.2.20
Java 17 17 17 17 17
Conda 22,9 22,9 22,9 22,9 22,9
Python 3,10 3,10 3,10 3,10 3,10
R 4.1 4.1 4.1 4.1 4.1
Scala 2,13 2,13 2,13 2,13 2,13

Spark-Laufzeitversion 1.2

Komponente 1.2.1
2024/04/04		 1.2.0
2024/03/27
 1.2.0-RC1
2024/03/20

Apache Spark 3.5.1 3.5.1 3.5.0
Cloud Storage-Connector 3.0.0 3.0.0 3.0.0
BigQuery-Connector 0.36.1 0.36.1 0.35.1
Java 17 17 17
Conda 24,10 24,10 23,11
Python 3,12 3,12 3,12
R 4,30 4,30 4,30
Scala 2,12 2,12 2,12

Spark-Laufzeitversion 1.1

Komponente 1.1.57
2024/04/04		 1.1.56
2024/03/27
 1.1.55
2024/03/20		 1.1.54
2024/03/14		 1.1.53
2024/03/07
Apache Spark 3.3.4 3.3.4 3.3.4 3.3.2 3.3.2
Cloud Storage-Connector 2.2.20 2.2.20 2.2.20 2.2.20 2.2.20
BigQuery-Connector 0.28.1 0.28.1 0.28.1 0.28.1 0.28.1
Java 11 11 11 11 11
Conda 22,11 22,11 22,11 22,11 22,11
Python 3,10 3,10 3,10 3,10 3,10
R 4.2 4.2 4.2 4.2 4.2
Scala 2,12 2,12 2,12 2,12 2,12