Package cz.o2.proxima.beam.core.direct.io
-
Class Summary Class Description BatchLogRead APTransform
that reads from aBatchLogReader
using splittable DoFn.BatchRestrictionTracker BatchRestrictionTracker.PartitionList CommitLogRead APTransform
that reads from aCommitLogReader
using splittable DoFn.DirectBatchUnboundedSource Source reading fromBatchLogReader
in unbounded manner.DirectBatchUnboundedSource.Checkpoint DirectBatchUnboundedSource.CheckpointCoder Use gzip to compress the serialized checkpoint, as it might easily grow in size (batch partitions might contain many files).DirectDataAccessorFactory ADataAccessorFactory
usingDirectDataOperator
.DirectDataAccessorWrapper Wrapper of direct data accessor to beam one.OffsetRestrictionTracker OffsetRestrictionTracker.OffsetRange