org.nuxeo.lib.stream.log.internals

Class AbstractLogManager

java.lang.Object

org.nuxeo.lib.stream.log.internals.AbstractLogManager

All Implemented Interfaces:

AutoCloseable, LogManager

Direct Known Subclasses:

ChronicleLogManager, KafkaLogManager

public abstract class AbstractLogManager
extends Object
implements LogManager

Field Summary

Fields

Modifier and Type	Field and Description
protected Map<String,CloseableLogAppender>	appenders
protected Set<LogTailer>	tailers
protected Map<LogPartitionGroup,LogTailer>	tailersAssignments

Constructor Summary

Constructors

Constructor and Description
AbstractLogManager()

Method Summary

Modifier and Type	Method and Description
protected void	checkInvalidAssignment(String group, LogPartition partition)
void	close()
protected abstract void	create(String name, int size)
protected abstract <M extends Externalizable> CloseableLogAppender<M>	createAppender(String name)
boolean	createIfNotExists(String name, int size) Creates a new Log with size partitions if the Log does not exists.
<M extends Externalizable> LogTailer<M>	createTailer(String group, Collection<LogPartition> partitions) Create a tailer for a consumer group and assign multiple partitions.
boolean	delete(String name) Try to delete a Log.
protected abstract <M extends Externalizable> LogTailer<M>	doCreateTailer(Collection<LogPartition> partitions, String group)
protected abstract <M extends Externalizable> LogTailer<M>	doSubscribe(String group, Collection<String> names, RebalanceListener listener)
<M extends Externalizable> LogAppender<M>	getAppender(String name) Get an appender for the Log named name.
<M extends Externalizable> List<Latency>	getLatencyPerPartition(String name, String group, Function<M,Long> timestampExtractor, Function<M,String> keyExtractor) Returns the lag with latency.
<M extends Externalizable> LogTailer<M>	subscribe(String group, Collection<String> names, RebalanceListener listener) Create a tailer for a consumer group and subscribe to multiple Logs.
boolean	supportSubscribe() Returns true if the Log LogManager.subscribe(java.lang.String, java.util.Collection<java.lang.String>, org.nuxeo.lib.stream.log.RebalanceListener) method is supported.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.nuxeo.lib.stream.log.LogManager

createTailer, createTailer, exists, getLag, getLagPerPartition, getLatency, listAll, listConsumerGroups

Field Detail

appenders

protected final Map<String,CloseableLogAppender> appenders

tailersAssignments

protected final Map<LogPartitionGroup,LogTailer> tailersAssignments

tailers

protected final Set<LogTailer> tailers

Constructor Detail

AbstractLogManager

public AbstractLogManager()

Method Detail

create

protected abstract void create(String name,
                               int size)

createAppender

protected abstract <M extends Externalizable> CloseableLogAppender<M> createAppender(String name)

doCreateTailer

protected abstract <M extends Externalizable> LogTailer<M> doCreateTailer(Collection<LogPartition> partitions,
                                                                          String group)

doSubscribe

protected abstract <M extends Externalizable> LogTailer<M> doSubscribe(String group,
                                                                       Collection<String> names,
                                                                       RebalanceListener listener)

createIfNotExists

public boolean createIfNotExists(String name,
                                 int size)

Description copied from interface: LogManager

Creates a new Log with size partitions if the Log does not exists. Returns true it the Log has been created.

Specified by:

createIfNotExists in interface LogManager

delete

public boolean delete(String name)

Description copied from interface: LogManager

Try to delete a Log. Returns true if successfully deleted, might not be possible depending on the implementation.

Specified by:

delete in interface LogManager

createTailer

public <M extends Externalizable> LogTailer<M> createTailer(String group,
                                                            Collection<LogPartition> partitions)

Description copied from interface: LogManager

Create a tailer for a consumer group and assign multiple partitions. Note that partitions can be from different Logs. A tailer is NOT thread safe.

Specified by:

createTailer in interface LogManager

supportSubscribe

public boolean supportSubscribe()

Description copied from interface: LogManager

Returns true if the Log LogManager.subscribe(java.lang.String, java.util.Collection<java.lang.String>, org.nuxeo.lib.stream.log.RebalanceListener) method is supported.

Specified by:

supportSubscribe in interface LogManager

subscribe

public <M extends Externalizable> LogTailer<M> subscribe(String group,
                                                         Collection<String> names,
                                                         RebalanceListener listener)

Description copied from interface: LogManager

Create a tailer for a consumer group and subscribe to multiple Logs. The partitions assignment is done dynamically depending on the number of subscribers. The partitions can change during tailers life, this is called a rebalancing. A listener can be used to be notified on assignment changes.

A tailer is NOT thread safe.

You should not mix LogManager.createTailer(java.lang.String, java.util.Collection<org.nuxeo.lib.stream.log.LogPartition>) and subscribe usage using the same group.

Specified by:

subscribe in interface LogManager

checkInvalidAssignment

protected void checkInvalidAssignment(String group,
                                      LogPartition partition)

getAppender

public <M extends Externalizable> LogAppender<M> getAppender(String name)

Description copied from interface: LogManager

Get an appender for the Log named name. An appender is thread safe.

Specified by:

getAppender in interface LogManager

getLatencyPerPartition

public <M extends Externalizable> List<Latency> getLatencyPerPartition(String name,
                                                                       String group,
                                                                       Function<M,Long> timestampExtractor,
                                                                       Function<M,String> keyExtractor)

Description copied from interface: LogManager

Returns the lag with latency. Timestamps used to compute the latencies are extracted from the records. This requires to read one record per partition so it costs more than LogManager.getLagPerPartition(String, String).
Two functions need to be provided to extract the timestamp and a key from a record.

Specified by:

getLatencyPerPartition in interface LogManager

close

public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface LogManager