Package cz.o2.proxima.direct.core.batch

Class BatchLogObservers

java.lang.Object

cz.o2.proxima.direct.core.batch.BatchLogObservers

@Internal
public class BatchLogObservers
extends java.lang.Object

Utility class related to BatchLogObservers.

Method Summary

Modifier and Type	Method	Description
static BatchLogObserver.OnNextContext	defaultContext(Partition partition)	Create BatchLogObserver.OnNextContext which holds watermark back on Watermarks.MIN_WATERMARK until the end of data.
static BatchLogObserver.OnNextContext	withWatermark(Partition partition, Offset offset, long watermark)	Create BatchLogObserver.OnNextContext which sets watermark ti given epoch millis.
static BatchLogObserver.OnNextContext	withWatermarkSupplier(Partition partition, Offset offset, WatermarkSupplier watermark)	Create BatchLogObserver.OnNextContext which moves watermark according to given WatermarkSupplier.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

defaultContext

public static BatchLogObserver.OnNextContext defaultContext(Partition partition)

Create BatchLogObserver.OnNextContext which holds watermark back on Watermarks.MIN_WATERMARK until the end of data. This is the default behavior of batch readers when there is no way to time-order data.

Parameters:

partition - the partition to create context for

Returns:

a wrapped BatchLogObserver.OnNextContext for given partition

withWatermarkSupplier

public static BatchLogObserver.OnNextContext withWatermarkSupplier(Partition partition,
                                                                   Offset offset,
                                                                   WatermarkSupplier watermark)

Create BatchLogObserver.OnNextContext which moves watermark according to given WatermarkSupplier.

Parameters:

partition - the partition to create context for

offset - offset of a current element

watermark - WatermarkSupplier for watermark at any given time. The supplier can assume that each element gets consumed immediately after being passed to BatchLogObserver.onNext(cz.o2.proxima.core.storage.StreamElement)

Returns:

a wrapped BatchLogObserver.OnNextContext for given partition and given watermark supplier

withWatermark

public static BatchLogObserver.OnNextContext withWatermark(Partition partition,
                                                           Offset offset,
                                                           long watermark)

Create BatchLogObserver.OnNextContext which sets watermark ti given epoch millis.

Parameters:

partition - the partition to create context for

offset - offset of a current element

watermark - epoch millis to set the watermark to

Returns:

a wrapped BatchLogObserver.OnNextContext for given partition with given watermark