A Dataproc job for running Apache Hadoop MapReduce
<https://hadoop.apache.org/docs/current/hadoop-mapreduce-
client/hadoop-mapreduce-client-core/MapReduceTutorial.html>
jobs on
Apache Hadoop YARN <https://hadoop.apache.org/docs/r2.7.1/hadoop-
yarn/hadoop-yarn-site/YARN.html>
.
The HCFS URI of the jar file containing the main class. Examples: ‘gs://foo-bucket/analytics-binaries/extract-useful- metrics-mr.jar’ ‘hdfs:/tmp/test-samples/custom-wordcount.jar’ ‘file:///home/usr/lib/hadoop-mapreduce/hadoop-mapreduce- examples.jar’
Optional. The arguments to pass to the driver. Do not include
arguments, such as -libjars
or -Dfoo=bar
, that can be
set as job properties, since a collision may occur that causes
an incorrect job submission.
Optional. HCFS (Hadoop Compatible Filesystem) URIs of files to be copied to the working directory of Hadoop drivers and distributed tasks. Useful for naively parallel tasks.
Optional. A mapping of property names to values, used to
configure Hadoop. Properties that conflict with values set by
the Dataproc API may be overwritten. Can include properties
set in /etc/hadoop/conf/*-site
and classes in user code.
Classes
PropertiesEntry
API documentation for dataproc_v1beta2.types.HadoopJob.PropertiesEntry
class.