Package cz.o2.proxima.direct.core.commitlog

Class CommitLogObservers

java.lang.Object

cz.o2.proxima.direct.core.commitlog.CommitLogObservers

public class CommitLogObservers
extends java.lang.Object

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	CommitLogObservers.ForwardingObserver	A @{link LogObserver} that delegates calls to underlying delegate.
static class	CommitLogObservers.TerminationStrategy	A strategy to use when maximal error count is reached.

Method Summary

Modifier and Type	Method	Description
static CommitLogObserver	synchronizedObserver(CommitLogObserver delegate)
static CommitLogObserver	withNumRetriedExceptions(java.lang.String name, int numRetries, UnaryFunction<java.lang.Throwable,CommitLogObservers.TerminationStrategy> onRetriesExhausted, CommitLogObserver delegate)	Create a CommitLogObserver that handles retries on Exceptions thrown during processing.
static CommitLogObserver	withNumRetriedExceptions(java.lang.String name, int numRetries, CommitLogObserver delegate)	Create a CommitLogObserver that handles retries on Exceptions thrown during processing.
static CommitLogObserver	withNumRetriedThrowables(java.lang.String name, int numRetries, UnaryFunction<java.lang.Throwable,CommitLogObservers.TerminationStrategy> onRetriesExhausted, CommitLogObserver delegate)	Create a CommitLogObserver that handles retries on Throwables thrown during processing.
static CommitLogObserver	withSortBuffer(CommitLogObserver upstream, java.time.Duration allowedLateness)	Create CommitLogObserver that observes data in event time order.
static CommitLogObserver	withSortBuffer(CommitLogObserver upstream, java.time.Duration allowedLateness, BiConsumer<StreamElement,CommitLogObserver.OnNextContext> latecomerConsumer)	Create CommitLogObserver that observes data in event time order.
static CommitLogObserver	withSortBuffer(CommitLogObserver upstream, java.time.Duration allowedLateness, Consumer<StreamElement> latecomerConsumer)	Create CommitLogObserver that observes data in event time order.
static CommitLogObserver	withSortBufferWithinPartition(CommitLogObserver upstream, java.time.Duration allowedLateness)	Create CommitLogObserver that observes data in event time order per partition.
static CommitLogObserver	withSortBufferWithinPartition(CommitLogObserver upstream, java.time.Duration allowedLateness, BiConsumer<StreamElement,CommitLogObserver.OnNextContext> latecomerConsumer)	Create CommitLogObserver that observes data in event time order per partition.
static CommitLogObserver	withSortBufferWithinPartition(CommitLogObserver upstream, java.time.Duration allowedLateness, Consumer<StreamElement> latecomerConsumer)	Create CommitLogObserver that observes data in event time order per partition.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

withNumRetriedExceptions

public static CommitLogObserver withNumRetriedExceptions(java.lang.String name,
                                                         int numRetries,
                                                         CommitLogObserver delegate)

Create a CommitLogObserver that handles retries on Exceptions thrown during processing. If retries are exhausted, the last caught Exception is rethrown.

Parameters:

name - name of the consumer

numRetries - number of retries that should be attempted

delegate - the CommitLogObserver to handle to processing

Returns:

CommitLogObserver that will retry processing

withNumRetriedExceptions

public static CommitLogObserver withNumRetriedExceptions(java.lang.String name,
                                                         int numRetries,
                                                         UnaryFunction<java.lang.Throwable,CommitLogObservers.TerminationStrategy> onRetriesExhausted,
                                                         CommitLogObserver delegate)

Create a CommitLogObserver that handles retries on Exceptions thrown during processing. If retries are exhausted, the last caught Exception is rethrown.

Parameters:

name - name of the consumer

numRetries - number of retries that should be attempted

onRetriesExhausted - handler for Throwable caught during processing and not retried

delegate - the CommitLogObserver to handle to processing

Returns:

CommitLogObserver that will retry processing

withNumRetriedThrowables

public static CommitLogObserver withNumRetriedThrowables(java.lang.String name,
                                                         int numRetries,
                                                         UnaryFunction<java.lang.Throwable,CommitLogObservers.TerminationStrategy> onRetriesExhausted,
                                                         CommitLogObserver delegate)

Create a CommitLogObserver that handles retries on Throwables thrown during processing. If retries are exhausted, the last caught Throwable is rethrown.

Parameters:

name - name of the consumer

numRetries - number of retries that should be attempted

onRetriesExhausted - handler for Throwable caught during processing and not retried

delegate - the CommitLogObserver to handle to processing

Returns:

CommitLogObserver that will retry processing

withSortBuffer

public static CommitLogObserver withSortBuffer(CommitLogObserver upstream,
                                               java.time.Duration allowedLateness)

Create CommitLogObserver that observes data in event time order.

Data are first buffered into temporal buffer and hold until watermark - allowed lateness.

Parameters:

upstream - the upstream observer that observes ordered data

allowedLateness - mixture of event time and processing time lateness

Returns:

the observer to use for CommitLogReader.observe(String, CommitLogObserver)

withSortBuffer

public static CommitLogObserver withSortBuffer(CommitLogObserver upstream,
                                               java.time.Duration allowedLateness,
                                               Consumer<StreamElement> latecomerConsumer)

Create CommitLogObserver that observes data in event time order.

Data are first buffered into temporal buffer and hold until watermark - allowed lateness.

Parameters:

upstream - the upstream observer that observes ordered data

allowedLateness - mixture of event time and processing time lateness

latecomerConsumer - consumer of data that had to be dropped due to allowed lateness *

Returns:

the observer to use for CommitLogReader.observe(String, CommitLogObserver)

withSortBuffer

public static CommitLogObserver withSortBuffer(CommitLogObserver upstream,
                                               java.time.Duration allowedLateness,
                                               BiConsumer<StreamElement,CommitLogObserver.OnNextContext> latecomerConsumer)

Create CommitLogObserver that observes data in event time order.

Data are first buffered into temporal buffer and hold until watermark - allowed lateness.

Parameters:

upstream - the upstream observer that observes ordered data

allowedLateness - mixture of event time and processing time lateness

latecomerConsumer - consumer of data that had to be dropped due to allowed lateness *

Returns:

the observer to use for CommitLogReader.observe(String, CommitLogObserver)

withSortBufferWithinPartition

public static CommitLogObserver withSortBufferWithinPartition(CommitLogObserver upstream,
                                                              java.time.Duration allowedLateness)

Create CommitLogObserver that observes data in event time order per partition.

Data are first buffered into temporal buffer and hold until watermark - allowed lateness.

Parameters:

upstream - the upstream observer that observes ordered data

allowedLateness - mixture of event time and processing time lateness

Returns:

the observer to use for CommitLogReader.observe(String, CommitLogObserver)

withSortBufferWithinPartition

public static CommitLogObserver withSortBufferWithinPartition(CommitLogObserver upstream,
                                                              java.time.Duration allowedLateness,
                                                              Consumer<StreamElement> latecomerConsumer)

Create CommitLogObserver that observes data in event time order per partition.

Data are first buffered into temporal buffer and hold until watermark - allowed lateness.

Parameters:

upstream - the upstream observer that observes ordered data

allowedLateness - mixture of event time and processing time lateness

latecomerConsumer - consumer of data that had to be dropped due to allowed lateness *

Returns:

the observer to use for CommitLogReader.observe(String, CommitLogObserver)

withSortBufferWithinPartition

public static CommitLogObserver withSortBufferWithinPartition(CommitLogObserver upstream,
                                                              java.time.Duration allowedLateness,
                                                              BiConsumer<StreamElement,CommitLogObserver.OnNextContext> latecomerConsumer)

Create CommitLogObserver that observes data in event time order per partition.

Data are first buffered into temporal buffer and hold until watermark - allowed lateness.

Parameters:

upstream - the upstream observer that observes ordered data

allowedLateness - mixture of event time and processing time lateness

latecomerConsumer - consumer of data that had to be dropped due to allowed lateness *

Returns:

the observer to use for CommitLogReader.observe(String, CommitLogObserver)

synchronizedObserver

public static CommitLogObserver synchronizedObserver(CommitLogObserver delegate)