Class SparkSqlBatch (5.12.0)
Stay organized with collections
Save and categorize content based on your preferences.
SparkSqlBatch(mapping=None, *, ignore_unknown_fields=False, **kwargs)
A configuration for running Apache Spark
SQL <https://spark.apache.org/sql/>
__ queries as a batch workload.
Attributes |
Name |
Description |
query_file_uri |
str
Required. The HCFS URI of the script that
contains Spark SQL queries to execute.
|
query_variables |
MutableMapping[str, str]
Optional. Mapping of query variable names to values
(equivalent to the Spark SQL command:
SET name="value"; ).
|
jar_file_uris |
MutableSequence[str]
Optional. HCFS URIs of jar files to be added
to the Spark CLASSPATH.
|
Classes
QueryVariablesEntry
QueryVariablesEntry(mapping=None, *, ignore_unknown_fields=False, **kwargs)
The abstract base class for a message.
Parameters |
Name |
Description |
kwargs |
dict
Keys and values corresponding to the fields of the message.
|
mapping |
Union[dict, .Message ]
A dictionary or message to be used to determine the values for this message.
|
ignore_unknown_fields |
Optional(bool)
If True, do not raise errors for unknown fields. Only applied if mapping is a mapping type or there are keyword parameters.
|
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2024-09-30 UTC.
[{
"type": "thumb-down",
"id": "hardToUnderstand",
"label":"Hard to understand"
},{
"type": "thumb-down",
"id": "incorrectInformationOrSampleCode",
"label":"Incorrect information or sample code"
},{
"type": "thumb-down",
"id": "missingTheInformationSamplesINeed",
"label":"Missing the information/samples I need"
},{
"type": "thumb-down",
"id": "otherDown",
"label":"Other"
}]
[{
"type": "thumb-up",
"id": "easyToUnderstand",
"label":"Easy to understand"
},{
"type": "thumb-up",
"id": "solvedMyProblem",
"label":"Solved my problem"
},{
"type": "thumb-up",
"id": "otherUp",
"label":"Other"
}]
{"lastModified": "Last updated 2024-09-30 UTC."}
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2024-09-30 UTC."]]