A Dataproc job for running Apache Hive queries on YARN.
JSON representation
{"continueOnFailure": boolean,"scriptVariables": {string: string,...},"properties": {string: string,...},"jarFileUris": [string],// Union field queries can be only one of the following:"queryFileUri": string,"queryList": {object (QueryList)}// End of list of possible types for union field queries.}
Fields
continueOnFailure
boolean
Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
scriptVariables
map (key: string, value: string)
Optional. Mapping of query variable names to values (equivalent to the Hive command: SET name="value";).
An object containing a list of "key": value pairs. Example: { "name": "wrench", "mass": "1.3kg", "count": "3" }.
properties
map (key: string, value: string)
Optional. A mapping of property names and values, used to configure Hive. Properties that conflict with values set by the Dataproc API might be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/hive/conf/hive-site.xml, and classes in user code.
An object containing a list of "key": value pairs. Example: { "name": "wrench", "mass": "1.3kg", "count": "3" }.
jarFileUris[]
string
Optional. HCFS URIs of jar files to add to the CLASSPATH of the Hive server and Hadoop MapReduce (MR) tasks. Can contain Hive SerDes and UDFs.
Union field queries. Required. The sequence of Hive queries to execute, specified as either an HCFS file URI or a list of queries. queries can be only one of the following:
queryFileUri
string
The HCFS URI of the script that contains Hive queries.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-02-27 UTC."],[[["This Dataproc job executes Apache Hive queries on YARN, supporting both single query scripts and lists of queries."],["The `continueOnFailure` field determines whether the job will continue executing queries if one fails, with a default of `false`."],["`scriptVariables` allows the definition of query variables, akin to Hive's `SET` command, using a map of string keys and values."],["`properties` can be used to set custom Hive configurations, overriding default properties, in a key-value map format."],["`jarFileUris` can be supplied to add custom jar files to be used by the Hive server and MapReduce tasks."]]],[]]
