Package cz.o2.proxima.beam.core.direct.io
-
Interface Summary Interface Description BatchLogRead.BatchLogReadPipelineOptions -
Class Summary Class Description BatchLogRead APTransform
that reads from aBatchLogReader
using splittable DoFn.BatchLogRead.BatchLogReadOptionsFactory BatchRestrictionTracker BatchRestrictionTracker.PartitionList CommitLogRead APTransform
that reads from aCommitLogReader
using splittable DoFn.DirectBatchUnboundedSource Source reading fromBatchLogReader
in unbounded manner.DirectBatchUnboundedSource.Checkpoint DirectBatchUnboundedSource.CheckpointCoder Use gzip to compress the serialized checkpoint, as it might easily grow in size (batch partitions might contain many files).DirectDataAccessorFactory ADataAccessorFactory
usingDirectDataOperator
.DirectDataAccessorWrapper Wrapper of direct data accessor to beam one.OffsetRestrictionTracker OffsetRestrictionTracker.OffsetRange