org.nuxeo.ecm.platform.importer.mqueues.mqueues.kafka

Class KafkaMQTailer<M extends Externalizable>

java.lang.Object

org.nuxeo.ecm.platform.importer.mqueues.mqueues.kafka.KafkaMQTailer<M>

All Implemented Interfaces:

AutoCloseable, org.apache.kafka.clients.consumer.ConsumerRebalanceListener, MQTailer<M>

public class KafkaMQTailer<M extends Externalizable>
extends Object
implements MQTailer<M>, org.apache.kafka.clients.consumer.ConsumerRebalanceListener

Since:

9.2

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	KafkaMQTailer(String prefix, String group, Properties consumerProps)

Method Summary

Modifier and Type	Method and Description
Collection<MQPartition>	assignments() Returns the list of MQueue name/partition tuples currently assigned to this tailer.
void	close()
boolean	closed() Returns true if the tailer has been closed.
void	commit() Commit current positions for all partitions (last message offset returned by read).
MQOffset	commit(MQPartition partition) Commit current position for the partition.
static <M extends Externalizable> KafkaMQTailer<M>	createAndAssign(String prefix, Collection<MQPartition> partitions, String group, Properties consumerProps)
static <M extends Externalizable> KafkaMQTailer<M>	createAndSubscribe(String prefix, Collection<String> names, String group, Properties consumerProps, MQRebalanceListener listener)
String	group() Returns the consumer group.
void	onPartitionsAssigned(Collection<org.apache.kafka.common.TopicPartition> newPartitions)
void	onPartitionsRevoked(Collection<org.apache.kafka.common.TopicPartition> partitions)
MQRecord<M>	read(Duration timeout) Read a message from assigned partitions within the timeout.
void	seek(MQPartition partition, MQOffset offset)
void	toEnd() Set the current positions to the end of all partitions.
void	toLastCommitted() Set the current positions to previously committed positions.
void	toStart() Set the current position to the fist message of all partitions.
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

KafkaMQTailer

protected KafkaMQTailer(String prefix,
                        String group,
                        Properties consumerProps)

Method Detail

createAndAssign

public static <M extends Externalizable> KafkaMQTailer<M> createAndAssign(String prefix,
                                                                          Collection<MQPartition> partitions,
                                                                          String group,
                                                                          Properties consumerProps)

createAndSubscribe

public static <M extends Externalizable> KafkaMQTailer<M> createAndSubscribe(String prefix,
                                                                             Collection<String> names,
                                                                             String group,
                                                                             Properties consumerProps,
                                                                             MQRebalanceListener listener)

read

public MQRecord<M> read(Duration timeout)
                 throws InterruptedException

Description copied from interface: MQTailer

Read a message from assigned partitions within the timeout.

Specified by:

read in interface MQTailer<M extends Externalizable>

Returns:

null if there is no message in the queue after the timeout.

Throws:

InterruptedException

toEnd

public void toEnd()

Description copied from interface: MQTailer

Set the current positions to the end of all partitions.

Specified by:

toEnd in interface MQTailer<M extends Externalizable>

toStart

public void toStart()

Description copied from interface: MQTailer

Set the current position to the fist message of all partitions.

Specified by:

toStart in interface MQTailer<M extends Externalizable>

toLastCommitted

public void toLastCommitted()

Description copied from interface: MQTailer

Set the current positions to previously committed positions.

Specified by:

toLastCommitted in interface MQTailer<M extends Externalizable>

seek

public void seek(MQPartition partition,
                 MQOffset offset)

commit

public void commit()

Description copied from interface: MQTailer

Commit current positions for all partitions (last message offset returned by read).

Specified by:

commit in interface MQTailer<M extends Externalizable>

commit

public MQOffset commit(MQPartition partition)

Description copied from interface: MQTailer

Commit current position for the partition.

Specified by:

commit in interface MQTailer<M extends Externalizable>

Returns:

the committed offset, can return null if there was no previous read done on this partition.

assignments

public Collection<MQPartition> assignments()

Description copied from interface: MQTailer

Returns the list of MQueue name/partition tuples currently assigned to this tailer. Assignments can change only if the tailer has been created using MQManager.subscribe(java.lang.String, java.util.Collection<java.lang.String>, org.nuxeo.ecm.platform.importer.mqueues.mqueues.MQRebalanceListener).

Specified by:

assignments in interface MQTailer<M extends Externalizable>

group

public String group()

Description copied from interface: MQTailer

Returns the consumer group.

Specified by:

group in interface MQTailer<M extends Externalizable>

closed

public boolean closed()

Description copied from interface: MQTailer

Returns true if the tailer has been closed.

Specified by:

closed in interface MQTailer<M extends Externalizable>

close

public void close()
           throws Exception

Specified by:

close in interface AutoCloseable

Throws:

Exception

toString

public String toString()

Overrides:

toString in class Object

onPartitionsRevoked

public void onPartitionsRevoked(Collection<org.apache.kafka.common.TopicPartition> partitions)

Specified by:

onPartitionsRevoked in interface org.apache.kafka.clients.consumer.ConsumerRebalanceListener

onPartitionsAssigned

public void onPartitionsAssigned(Collection<org.apache.kafka.common.TopicPartition> newPartitions)

Specified by:

onPartitionsAssigned in interface org.apache.kafka.clients.consumer.ConsumerRebalanceListener