io.debezium.connector.postgresql

Class RecordsSnapshotProducer

java.lang.Object

io.debezium.connector.postgresql.RecordsProducer

io.debezium.connector.postgresql.RecordsSnapshotProducer

@ThreadSafe
public class RecordsSnapshotProducer
extends RecordsProducer

Producer of source records from a database snapshot. Once completed, this producer can optionally continue streaming records, using another RecordsStreamProducer instance.

Author:

Horia Chiorean (hchiorea@redhat.com)

Field Summary

Fields

Modifier and Type	Field and Description
private static String	CONTEXT_NAME
private AtomicReference<org.apache.kafka.connect.source.SourceRecord>	currentRecord
private ExecutorService	executorService
private Optional<RecordsStreamProducer>	streamProducer

Fields inherited from class io.debezium.connector.postgresql.RecordsProducer

logger, sourceInfo, taskContext

Constructor Summary

Constructors

Constructor and Description
RecordsSnapshotProducer(PostgresTaskContext taskContext, SourceInfo sourceInfo, boolean continueStreamingAfterCompletion)

Method Summary

Modifier and Type	Method and Description
private void	cleanup()
protected void	commit() Notification that offsets have been committed to Kafka.
protected void	generateReadRecord(TableId tableId, Object[] rowData)
private Void	handleException(Throwable t)
private void	readTable(TableId tableId, ResultSet rs, Consumer<org.apache.kafka.connect.source.SourceRecord> consumer, AtomicInteger rowsCounter)
private Statement	readTableStatement(Connection conn)
private void	sendCurrentRecord(Consumer<org.apache.kafka.connect.source.SourceRecord> consumer)
protected void	start(Consumer<org.apache.kafka.connect.source.SourceRecord> recordConsumer) Starts up this producer.
private void	startStreaming(Consumer<org.apache.kafka.connect.source.SourceRecord> consumer)
protected void	stop() Requests that this producer be stopped.
private void	takeSnapshot(Consumer<org.apache.kafka.connect.source.SourceRecord> consumer)
private Object	valueForColumn(ResultSet rs, int colIdx, ResultSetMetaData metaData)

Methods inherited from class io.debezium.connector.postgresql.RecordsProducer

clock, createEnvelope, schema, topicSelector

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CONTEXT_NAME

private static final String CONTEXT_NAME

See Also:

Constant Field Values

executorService

private final ExecutorService executorService

streamProducer

private final Optional<RecordsStreamProducer> streamProducer

currentRecord

private AtomicReference<org.apache.kafka.connect.source.SourceRecord> currentRecord

Constructor Detail

RecordsSnapshotProducer

public RecordsSnapshotProducer(PostgresTaskContext taskContext,
                               SourceInfo sourceInfo,
                               boolean continueStreamingAfterCompletion)

Method Detail

start

protected void start(Consumer<org.apache.kafka.connect.source.SourceRecord> recordConsumer)

Description copied from class: RecordsProducer

Starts up this producer. This is normally done by a PostgresConnectorTask instance. Subclasses should start enqueuing records via a separate thread at the end of this method.

Specified by:

start in class RecordsProducer

Parameters:

recordConsumer - a consumer of SourceRecord instances, may not be null

handleException

private Void handleException(Throwable t)

startStreaming

private void startStreaming(Consumer<org.apache.kafka.connect.source.SourceRecord> consumer)

commit

protected void commit()

Description copied from class: RecordsProducer

Notification that offsets have been committed to Kafka.

Specified by:

commit in class RecordsProducer

stop

protected void stop()

Description copied from class: RecordsProducer

Requests that this producer be stopped. This is normally a request coming from a PostgresConnectorTask instance

Specified by:

stop in class RecordsProducer

cleanup

private void cleanup()

takeSnapshot

private void takeSnapshot(Consumer<org.apache.kafka.connect.source.SourceRecord> consumer)

readTableStatement

private Statement readTableStatement(Connection conn)
                              throws SQLException

Throws:

SQLException

readTable

private void readTable(TableId tableId,
                       ResultSet rs,
                       Consumer<org.apache.kafka.connect.source.SourceRecord> consumer,
                       AtomicInteger rowsCounter)
                throws SQLException

Throws:

SQLException

valueForColumn

private Object valueForColumn(ResultSet rs,
                              int colIdx,
                              ResultSetMetaData metaData)
                       throws SQLException

Throws:

SQLException

generateReadRecord

protected void generateReadRecord(TableId tableId,
                                  Object[] rowData)

sendCurrentRecord

private void sendCurrentRecord(Consumer<org.apache.kafka.connect.source.SourceRecord> consumer)