Send feedback
Class PslWrite (0.4.5)
Stay organized with collections
Save and categorize content based on your preferences.
Version 0.4.5 keyboard_arrow_down
public class PslWrite implements WriteBuilder , SupportsStreamingUpdateAsAppend , BatchWrite , StreamingWrite
Pub/Sub Lite class for writing.
Note that SupportsStreamingUpdateAsAppend is the same hack that kafka
uses to opt-in to writing aggregates without requiring windowing.
Inheritance
java.lang.Object >
PslWrite
Implements
org.apache.spark.sql.connector.write.WriteBuilder ,org.apache.spark.sql.internal.connector.SupportsStreamingUpdateAsAppend ,org.apache.spark.sql.connector.write.BatchWrite ,org.apache.spark.sql.connector.write.streaming.StreamingWrite Constructors
PslWrite(StructType inputSchema, PslWriteDataSourceOptions writeOptions)
public PslWrite ( StructType inputSchema , PslWriteDataSourceOptions writeOptions )
Parameters
Methods
abort(long epochId, WriterCommitMessage[] messages)
public void abort ( long epochId , WriterCommitMessage [] messages )
Parameters
Name Description epochIdlong messagesorg.apache.spark.sql.connector.write.WriterCommitMessage []
abort(WriterCommitMessage[] messages)
public void abort ( WriterCommitMessage [] messages )
Parameter
Name Description messagesorg.apache.spark.sql.connector.write.WriterCommitMessage []
buildForBatch()
public BatchWrite buildForBatch ()
Returns
Type Description org.apache.spark.sql.connector.write.BatchWrite
buildForStreaming()
public StreamingWrite buildForStreaming ()
Returns
Type Description org.apache.spark.sql.connector.write.streaming.StreamingWrite
commit(long epochId, WriterCommitMessage[] messages)
public void commit ( long epochId , WriterCommitMessage [] messages )
Parameters
Name Description epochIdlong messagesorg.apache.spark.sql.connector.write.WriterCommitMessage []
commit(WriterCommitMessage[] messages)
public void commit ( WriterCommitMessage [] messages )
Parameter
Name Description messagesorg.apache.spark.sql.connector.write.WriterCommitMessage []
createBatchWriterFactory(PhysicalWriteInfo info)
public DataWriterFactory createBatchWriterFactory ( PhysicalWriteInfo info )
Parameter
Name Description infoorg.apache.spark.sql.connector.write.PhysicalWriteInfo
Returns
Type Description org.apache.spark.sql.connector.write.DataWriterFactory
createStreamingWriterFactory(PhysicalWriteInfo info)
public StreamingDataWriterFactory createStreamingWriterFactory ( PhysicalWriteInfo info )
Parameter
Name Description infoorg.apache.spark.sql.connector.write.PhysicalWriteInfo
Returns
Type Description org.apache.spark.sql.connector.write.streaming.StreamingDataWriterFactory
Send feedback
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License , and code samples are licensed under the Apache 2.0 License . For details, see the Google Developers Site Policies . Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2024-11-19 UTC.
Need to tell us more?
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2024-11-19 UTC."],[],[]]
