Send feedback
Class PslMicroBatchReader (0.3.4)
Stay organized with collections
Save and categorize content based on your preferences.
Version 0.3.4 keyboard_arrow_down
public class PslMicroBatchReader implements MicroBatchReader
Inheritance
java.lang.Object >
PslMicroBatchReader
Implements
org.apache.spark.sql.sources.v2.reader.streaming.MicroBatchReader Constructors
PslMicroBatchReader(CursorClient cursorClient, MultiPartitionCommitter committer, PartitionSubscriberFactory partitionSubscriberFactory, PerTopicHeadOffsetReader headOffsetReader, SubscriptionPath subscriptionPath, FlowControlSettings flowControlSettings, long maxMessagesPerBatch)
public PslMicroBatchReader ( CursorClient cursorClient , MultiPartitionCommitter committer , PartitionSubscriberFactory partitionSubscriberFactory , PerTopicHeadOffsetReader headOffsetReader , SubscriptionPath subscriptionPath , FlowControlSettings flowControlSettings , long maxMessagesPerBatch )
Parameters
Methods
commit(Offset end)
public void commit ( Offset end )
Parameter
Name Description end org.apache.spark.sql.sources.v2.reader.streaming.Offset
deserializeOffset(String json)
public Offset deserializeOffset ( String json )
Parameter
Returns
Type Description org.apache.spark.sql.sources.v2.reader.streaming.Offset
getEndOffset()
public Offset getEndOffset ()
Returns
Type Description org.apache.spark.sql.sources.v2.reader.streaming.Offset
getStartOffset()
public Offset getStartOffset ()
Returns
Type Description org.apache.spark.sql.sources.v2.reader.streaming.Offset
public List<InputPartition<InternalRow> > planInputPartitions ()
Returns
Type Description List <org.apache.spark.sql.sources.v2.reader.InputPartition <org.apache.spark.sql.catalyst.InternalRow >>
readSchema()
public StructType readSchema ()
Returns
Type Description org.apache.spark.sql.types.StructType
setOffsetRange(Optional<Offset> start, Optional<Offset> end)
public void setOffsetRange ( Optional<Offset> start , Optional<Offset> end )
Parameters
Name Description start Optional <org.apache.spark.sql.sources.v2.reader.streaming.Offset >end Optional <org.apache.spark.sql.sources.v2.reader.streaming.Offset >
stop()
Send feedback
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License , and code samples are licensed under the Apache 2.0 License . For details, see the Google Developers Site Policies . Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2024-11-19 UTC.
Need to tell us more?
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2024-11-19 UTC."],[],[]]
